The course will review a selection of recent advances in natural language processing, including transformer architectures, pre-training methods (e.g. BERT), and natural language generation.