The scope of this thesis is to build a general-purpose audio library that incorporates state-of-the-art Deep Learning techniques and architectures to handle the audio waveform. More specifically, the library should be able to provide training, testing, and inference scripts of models that: perform (i) classification, (ii) unsupervised embeddings extraction, and (iii) audio synthesis.