Profile

Cover photo
Werner Van Belle
143,409 views
AboutPosts

Stream

Werner Van Belle

Shared publicly  - 
 
The following chart are some of the results of creating a denoising autoencoder.
The idea is that a neural network is trained to map a 1482 dimensional input space to a 352 dimensional space in such a way that it will recover 30% of randomly removed data. Once that first stage is trained, its output is used to train the second stage which maps the data to 84 dimensions. The last stage bring it further down to 21 dimensions. The advantage of this method is that such denoising autoencoders grab patterns in the input, which are then at a higher level combined into higher level patterns.
I have been testing various optimizers. The results below show how much of a signal can be recovered. To do that, we take the 1482 dimensional dataset map it through to 21 dimensions and then map it back to 1482 dimensions. After that we compare the original and recovered signal. The error we get is then compared against the most simple predictor; namely the average of the signal.
Now, the first thing we noticed is that although rmsprop style approaches go extremely fast, they do result in an average signal (literally, they just decode the signal by producing the average). Secondly, stochastic data corruption should of course not be combined with an optimizer that compensates for such noise (which the rmsprop and momentum methods do to a certain extend).
In the end, sgd turns out to retain the most 'local patterns', yet converges too slowly. Using adam improves the convergence speed. In this case, because mean-normalizing the data fucks up the results we actually modified adam to calculate the variance correctly.
This is of course all very beginner style stuff. Probably in a year or so I will look back at this and think: what the hell was I thinking when I did that ?
1
Add a comment...

Werner Van Belle

Shared publicly  - 
 
Estimating Invariant Principal Components Using Diagonal Regression results in the same projection as correlation PCA.  *

In May 2016 I studied the working paper 'Estimating Invariant Principal Components Using Diagonal Regression' by Michael Leznik and Chris Tofallis from the Department of Management Systems The Business School University of Hertfordshire. The reason I was interested in this work is because they apparently found a different approach to the problem of PCA scale sensitivity than correlation PCA. In this brief note I explain how these two methods are the same.
1
Add a comment...

Werner Van Belle

Shared publicly  - 
 
Version 4.6.8 - This update provides you with the kick-ass feature to modify the speed of the mix through cues. Furthermore, now a sound engine can be assigned to each individual track. Video at https://www.youtube.com/watch?v=lEZj_mUJI2E Detailed info at http://bpmdj.yellowcouch.org/tempo-line.html
1
Add a comment...

Werner Van Belle

Shared publicly  - 
 
Hello, recently we ported BpmDj to Desktop. To do that we decided to use JavaFx. After two months our product was ready and our experience mostly positive. Here, I would like to share our experience with using JavaFx. http://werner.yellowcouch.org/log/javafx-a-first-look/
Porting BpmDj to the Desktop required me to think about what platform to use. We settled on JavaFx because it has 3D support. Not that we needed that immediatelly, but it is something we might want to add to BpmDj somewhere in the far future. At first sight JavaFx is fairly solid.
1
Add a comment...

Werner Van Belle

Shared publicly  - 
 
Sorry for the repost. The download link was wrong.
Interested in testing BpmDj ?
1- download the file bpmdj.jar from http://bpmdj.yellowcouch.org/files/deployed/bpmdj.jar
2- create a directory 'IWillFinallyTestThisGreatSoftware'
3- copy the bpmdj.jar into that directory and double click it.
4- it will ask you were your secret stash of mp3s is. Be honost and point it to a good location.
5- bpmdj now happily works its way through all your lovely music
6- start a mix by... well read the manual or watch the tutorial at http://bpmdj.yellowcouch.org/speaking-tutorial.html
1
Add a comment...

Werner Van Belle

Shared publicly  - 
 
Pulseaudio is such a crap piece of software. I wonder whether this is a test to see how much crap you can put in a linuxdistribution without a mass revolt.
1
Add a comment...

Werner Van Belle

Shared publicly  - 
See a deep blue sea. Mixed with BpmDj: http://bpmdj.yellowcouch.org/
1
Add a comment...

Werner Van Belle

Shared publicly  - 
 
A new lovely mix made by undersigned. Throwback 90-ies: https://www.mixcloud.com/5dbb/bulldozer-launched/
Another mix made with BpmDj. It includes isomorphic crossfading. Transitions that include a progressive offset shift between the tracks. Crosslimited fades, tempo changes and a beautiful picture by NASA.
1
Add a comment...

Werner Van Belle

Shared publicly  - 
Biology has its fearsome animals, bacteria and viruses, and physics has its mind-bendingly powerful forces. But let’s not forgot how utterly terrifying chemistry can be This video from SciShow explores the deadliest and most dangerous chemicals known to science. Among the chemicals are the highly volatile, the ridiculously toxic, the stupidly corrosive, and the one chemical so dangerous the Nazis decided it was too scary.
1
Add a comment...

Werner Van Belle

Shared publicly  - 
 
IntelliJ -> great product. However the bullshit that Google has added to it (called Android Studio) is just still so unstable. Selecting a horizontal layout with the mouse and dragging it into itself leads to a crash. Probably an infinite recursion. Does that company actually hire competent people ? Or do they prefer naivity of their employees ?
1
Add a comment...

Werner Van Belle

Shared publicly  - 
 
Here it goes... Interested in testing BpmDj;
1- download the file bpmdj.jar from https://bpmdj.yellowcouch.org/files/deployed/bpmdj.jar
2- create a directory 'IWillFinallyTestThisGreatSoftware'
3- copy the bpmdj.jar into that directory and double click it (on windows).
4- it will ask you were your secret stach of mp3s is. Be honost and point him to a good location.
5- bpmdj now happily works its way through all your lovely music
6- start a mix by... well read the manual or watch the tutorial at http://bpmdj.yellowcouch.org/speaking-tutorial.html
1
Add a comment...
Story
Tagline
Als uw hond kan schrijven.... dan is het eerder een pen.
Links