Profile cover photo
Profile photo
Steven Van Vaerenbergh
99 followers
99 followers
About
Posts

Post has attachment
We learn rich natural sound representations by capitalizing on large amounts of unlabeled sound data collected in the wild. We leverage the natural synchronization between vision and sound to learn an acoustic representation using two-million unlabeled videos. Unlabeled video has the advantage that it can be economically acquired at massive scales, yet contains useful signals about natural sound. We propose a student-teacher training procedure which transfers discriminative visual knowledge from well established visual recognition models into the sound modality using unlabeled video as a bridge. Our sound representation yields significant performance improvements over the state-of-the-art results on standard benchmarks for acoustic scene/object classification. Visualizations suggest some high-level semantics automatically emerge in the sound network, even though it is trained without ground truth labels.

https://projects.csail.mit.edu/soundnet/

Post has attachment
Audio super-resolution: Reconstructing a high-resolution audio waveform given a lower-resolution waveform as input.

Paper: https://openreview.net/pdf?id=S1gNakBFx
Code: https://github.com/jhetherly/EnglishSpeechUpsampler

Post has attachment
Music Genre Classifier (Github)

Post has attachment

Post has attachment
Magenta releases a playable set of neural synthesizer instruments.

Post has attachment

Post has attachment

Post has attachment
Abstract: "Composing music is an inspired yet challenging task, in that the process involves many considerations such as assigning pitches, determining rhythm, and arranging accompaniment. Algorithmic composition aims to develop algorithms for music composition. Recently, algorithmic composition using artificial intelligence technologies received considerable attention. In particular, computational intelligence is widely used and achieves promising results in the creation of music. This paper attempts to provide a survey on the computational intelligence techniques used in music composition. First, the existing approaches are reviewed in light of the major musical elements considered in composition, to wit, musical form, melody, and accompaniment. Second, the review highlights the components of evolutionary algorithms and neural networks designed for music composition."

Post has attachment

Post has attachment
Thousands of everyday sounds, organized using machine learning.
Wait while more posts are being loaded