Following curiosity wherever it leads
Welcome to ML Meanders, a quiet corner of the internet for exploring machine learning ideas. This isn't about polished takes, it's about genuine curiosity and thinking out loud.
In this post, we discuss the issue of checkerboard artefacts introduced by transpose convolution layers as well as proposed solutions to this problem. Experiments on audio synthesis are also given, further motivating these methods.
An exploration of Noise Contrastive Estimation (NCE) and how it enables Contrastive Predictive Coding (CPC) for learning useful representations from high-dimensional sequential data like speech.