ALEXANDRIA, Va., Dec. 23 -- United States Patent no. 12,505,149, issued on Dec. 23, was assigned to ADOBE INC. (San Jose, Calif.).
"Multi-modal sound effects recommendation" was invented by Julia Lepley Wilkins (Brooklyn, N.Y.), Oriol Nieto-Caballero (Oakland, Calif.) and Justin Salamon (San Francisco).
According to the abstract* released by the U.S. Patent & Trademark Office: "A sound effects system recommends sound effects using a multi-modal embedding space for projecting visuals, text, and audio. Given an input query comprising a visual (i.e., an image/video) and/or text, an encoder generates a query embedding in the multi-modal embedding space in which sound effects have been projected into sound effect embeddings. A relevant sound e...