Behind the Secrets of Large Language Models

TU Dresden | Wintersemester 2024 / 2025 Behind the Secrets of Large Language Models

This course provides a practical and in-depth understanding of large language models that power modern natural language processing systems. Students will explore the architecture, training methodologies, capabilities, and ethical implications of LLMs. The course combines theoretical knowledge with hands-on experience to equip students with the skills necessary to develop, analyze, and apply LLMs in various contexts.

 

By the end of this course, students will be able to:

  1. Understand the architecture and key components of large language models.
  2. Analyze the training processes, including data collection, model optimization, and fine-tuning.
  3. Evaluate the performance and limitations of LLMs in different NLP tasks.
  4. Apply LLMs to real-world problems, such as text generation, summarization, and translation. 
  5. Discuss the ethical considerations and societal impacts of deploying LLMs

Prerequisites

  • Introduction to Machine Learning or equivalent
  • Basic understanding of neural networks
  • Programming experience in Python

This course provides an in-depth understanding of large language models (LLMs) that power modern natural language processing (NLP) systems. Students will explore the architecture, training methodologies, capabilities, and ethical implications of LLMs. The course combines theoretical knowledge with hands-on experience to equip students with the skills necessary to develop, analyze, and apply LLMs in various contexts.

Display more information
Loading Assessment overview
Loading overview