Shulou(Shulou.com)11/24 Report--

CTOnews.com November 6 news, Meta in a blog announced the new open source audio compression technology EnCodec, claiming that compressed file size is 10 times smaller than MP3 format.

Meta's Basic Artificial Intelligence Research (FAIR) team has achieved success in AI-driven audio hypercompression, building a three-part system and training it end-to-end to compress audio data to target sizes, which can then be decoded using neural networks.

Meta's new technology EnCodec achieves about 10 times the compression rate compared to MP3 at 64 kbps, with no quality loss.

EnCodec consists of three parts:

Encoder: Takes uncompressed data and converts it into a higher dimensional and lower frame rate representation.

Quantizer: compresses this representation to a target size, reconstructing the original signal by training the quantizer to give the desired size (or set of sizes) while retaining the most important information. This compressed representation is stored on disk or sent over the network, equivalent to a.mp3 file on a computer.

Decoder: converts the compressed signal back to a waveform as similar as possible to the original signal, the key to lossy compression is to identify changes that humans cannot perceive because perfect reconstruction is impossible at low bit rates. To this end, EnCodec uses discriminators to improve the perceptual quality of the generated samples, creating a cat-and-mouse game in which the job of the discriminators is to distinguish between real samples and reconstructed samples. The compression model attempts to fool the discriminator by generating samples that push reconstructed samples to be perceptually more similar to the original samples.

CTOnews.com understands Meta says the technology doesn't yet cover video, but is currently in the works, with the goal of improving audio experiences such as video conferencing, streaming movies, and playing games with friends in VR.

Address: Click here to view

GitHub open source page: click here to view

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.