Generating discrete sequences: language and music

Go to class
Write Review

Free Online Course: Generating discrete sequences: language and music provided by edX is a comprehensive online course, which lasts for 8 weeks long, 8-9 hours a week. The course is taught in English and is free of charge. Generating discrete sequences: language and music is taught by Ivan P. Yamshchikov.

Overview
  • This course covers modern approaches to the generation of sequential data. It includes the generation of natural language as a sequence of subword tokens and music as a sequence of notes. We mostly focus on modern deep learning methods and pay a lot of attention to challenges and open questions in the field. The main goal of the course is to expose students to novel techniques in sequence generation and help them develop skills to use these techniques in practice. The course aims to bring students to the point where they have a general understanding of sequence generation and are ready to do a deeper dive into any particular area they are interested in: language, music or bioinformatic sequences.

Syllabus
  • Word2Vec, BPE, Markov chain-nased Language Models, RNN, LSTM, autoencoder, self-attention, transformer, BERT