# Vlad Kulikov Open Courses

> A bilingual, public AI/ML lecture library by Vlad Kulikov: Modern LLMs, Reinforcement Learning for LLM, and Information Theory for Machine Learning.

Canonical website: https://vladkulikov.com/. English home: /. Russian home: /ru/.
The live lecture text was updated on 2026-10-15. There are 49 modules in each language (98 lecture pages).
English and Russian versions cover corresponding modules. Module keys are stable identifiers; use the visible reading order rather than sorting module keys numerically.
HTML pages contain complete lectures, formulas, illustrations, and navigation without requiring JavaScript. Public Markdown source files are linked below as optional machine-readable sources.
This website publishes lectures, illustrations and module quizzes with answer checking. Choice and numeric questions are checked locally in the browser; open questions and code tasks have author-written answers for self-checking. Code is not executed. Progress is local to the browser and shared across the two languages. Worked exercises and existing notebooks are also published: answers and notebook text expand on request, original files download without code execution. Information Theory Python examples form part of the corresponding exercise answers. There are 469 exercise/project items and 55 notebooks per language, plus 9 shared Python solution files.

## Library
- [English library](https://vladkulikov.com/): Author profile and course catalog.
- [Библиотека на русском](https://vladkulikov.com/ru/): Автор и каталог курсов.
- [Sitemap](https://vladkulikov.com/sitemap.xml): All canonical library, course, lecture, quiz, exercise and notebook pages.

## Современные LLM (RU)
- [Course overview](https://vladkulikov.com/ru/courses/modern-llms/): Архитектура, обучение, инференс, агенты и оценивание современных языковых моделей.
- [Модуль 1. Современный ландшафт LLM](https://vladkulikov.com/ru/courses/modern-llms/module-01/): Lecture 01; source: https://vladkulikov.com/content/modern-llms/ru/module-01.md
- [Модуль 1. Современный ландшафт LLM: quizzes](https://vladkulikov.com/ru/courses/modern-llms/module-01/tests/): 19 authored questions; structured source: https://vladkulikov.com/quizzes/modern-llms/ru/module-01.json
- [Модуль 1. Современный ландшафт LLM: exercises](https://vladkulikov.com/ru/courses/modern-llms/module-01/exercises/): 6 authored items; structured source: https://vladkulikov.com/practice/modern-llms/ru/module-01.exercises.json
- [Модуль 1. Современный ландшафт LLM: notebooks](https://vladkulikov.com/ru/courses/modern-llms/module-01/notebooks/): 2 authored items; structured source: https://vladkulikov.com/practice/modern-llms/ru/module-01.notebooks.json
- [Модуль 2. Токенизация и эмбеддинги](https://vladkulikov.com/ru/courses/modern-llms/module-02/): Lecture 02; source: https://vladkulikov.com/content/modern-llms/ru/module-02.md
- [Модуль 2. Токенизация и эмбеддинги: quizzes](https://vladkulikov.com/ru/courses/modern-llms/module-02/tests/): 16 authored questions; structured source: https://vladkulikov.com/quizzes/modern-llms/ru/module-02.json
- [Модуль 2. Токенизация и эмбеддинги: exercises](https://vladkulikov.com/ru/courses/modern-llms/module-02/exercises/): 6 authored items; structured source: https://vladkulikov.com/practice/modern-llms/ru/module-02.exercises.json
- [Модуль 2. Токенизация и эмбеддинги: notebooks](https://vladkulikov.com/ru/courses/modern-llms/module-02/notebooks/): 2 authored items; structured source: https://vladkulikov.com/practice/modern-llms/ru/module-02.notebooks.json
- [Модуль 3. Базовый Transformer](https://vladkulikov.com/ru/courses/modern-llms/module-18/): Lecture 03; source: https://vladkulikov.com/content/modern-llms/ru/module-18.md
- [Модуль 3. Базовый Transformer: quizzes](https://vladkulikov.com/ru/courses/modern-llms/module-18/tests/): 46 authored questions; structured source: https://vladkulikov.com/quizzes/modern-llms/ru/module-18.json
- [Модуль 3. Базовый Transformer: exercises](https://vladkulikov.com/ru/courses/modern-llms/module-18/exercises/): 8 authored items; structured source: https://vladkulikov.com/practice/modern-llms/ru/module-18.exercises.json
- [Модуль 3. Базовый Transformer: notebooks](https://vladkulikov.com/ru/courses/modern-llms/module-18/notebooks/): 1 authored items; structured source: https://vladkulikov.com/practice/modern-llms/ru/module-18.notebooks.json
- [Модуль 4. Позиционные представления: от синусоид к нескольким осям](https://vladkulikov.com/ru/courses/modern-llms/module-03/): Lecture 04; source: https://vladkulikov.com/content/modern-llms/ru/module-03.md
- [Модуль 4. Позиционные представления: от синусоид к нескольким осям: quizzes](https://vladkulikov.com/ru/courses/modern-llms/module-03/tests/): 23 authored questions; structured source: https://vladkulikov.com/quizzes/modern-llms/ru/module-03.json
- [Модуль 4. Позиционные представления: от синусоид к нескольким осям: exercises](https://vladkulikov.com/ru/courses/modern-llms/module-03/exercises/): 5 authored items; structured source: https://vladkulikov.com/practice/modern-llms/ru/module-03.exercises.json
- [Модуль 4. Позиционные представления: от синусоид к нескольким осям: notebooks](https://vladkulikov.com/ru/courses/modern-llms/module-03/notebooks/): 2 authored items; structured source: https://vladkulikov.com/practice/modern-llms/ru/module-03.notebooks.json
- [Модуль 5. Современные механизмы внимания](https://vladkulikov.com/ru/courses/modern-llms/module-04/): Lecture 05; source: https://vladkulikov.com/content/modern-llms/ru/module-04.md
- [Модуль 5. Современные механизмы внимания: quizzes](https://vladkulikov.com/ru/courses/modern-llms/module-04/tests/): 23 authored questions; structured source: https://vladkulikov.com/quizzes/modern-llms/ru/module-04.json
- [Модуль 5. Современные механизмы внимания: exercises](https://vladkulikov.com/ru/courses/modern-llms/module-04/exercises/): 7 authored items; structured source: https://vladkulikov.com/practice/modern-llms/ru/module-04.exercises.json
- [Модуль 5. Современные механизмы внимания: notebooks](https://vladkulikov.com/ru/courses/modern-llms/module-04/notebooks/): 2 authored items; structured source: https://vladkulikov.com/practice/modern-llms/ru/module-04.notebooks.json
- [Модуль 6. Нормализация, активации и анатомия блока](https://vladkulikov.com/ru/courses/modern-llms/module-05/): Lecture 06; source: https://vladkulikov.com/content/modern-llms/ru/module-05.md
- [Модуль 6. Нормализация, активации и анатомия блока: quizzes](https://vladkulikov.com/ru/courses/modern-llms/module-05/tests/): 22 authored questions; structured source: https://vladkulikov.com/quizzes/modern-llms/ru/module-05.json
- [Модуль 6. Нормализация, активации и анатомия блока: exercises](https://vladkulikov.com/ru/courses/modern-llms/module-05/exercises/): 7 authored items; structured source: https://vladkulikov.com/practice/modern-llms/ru/module-05.exercises.json
- [Модуль 6. Нормализация, активации и анатомия блока: notebooks](https://vladkulikov.com/ru/courses/modern-llms/module-05/notebooks/): 2 authored items; structured source: https://vladkulikov.com/practice/modern-llms/ru/module-05.notebooks.json
- [Модуль 7. Mixture of Experts](https://vladkulikov.com/ru/courses/modern-llms/module-06/): Lecture 07; source: https://vladkulikov.com/content/modern-llms/ru/module-06.md
- [Модуль 7. Mixture of Experts: quizzes](https://vladkulikov.com/ru/courses/modern-llms/module-06/tests/): 21 authored questions; structured source: https://vladkulikov.com/quizzes/modern-llms/ru/module-06.json
- [Модуль 7. Mixture of Experts: exercises](https://vladkulikov.com/ru/courses/modern-llms/module-06/exercises/): 6 authored items; structured source: https://vladkulikov.com/practice/modern-llms/ru/module-06.exercises.json
- [Модуль 7. Mixture of Experts: notebooks](https://vladkulikov.com/ru/courses/modern-llms/module-06/notebooks/): 2 authored items; structured source: https://vladkulikov.com/practice/modern-llms/ru/module-06.notebooks.json
- [Модуль 8. Альтернативы Transformer: SSM, Mamba и гибриды](https://vladkulikov.com/ru/courses/modern-llms/module-07/): Lecture 08; source: https://vladkulikov.com/content/modern-llms/ru/module-07.md
- [Модуль 8. Альтернативы Transformer: SSM, Mamba и гибриды: quizzes](https://vladkulikov.com/ru/courses/modern-llms/module-07/tests/): 19 authored questions; structured source: https://vladkulikov.com/quizzes/modern-llms/ru/module-07.json
- [Модуль 8. Альтернативы Transformer: SSM, Mamba и гибриды: exercises](https://vladkulikov.com/ru/courses/modern-llms/module-07/exercises/): 5 authored items; structured source: https://vladkulikov.com/practice/modern-llms/ru/module-07.exercises.json
- [Модуль 8. Альтернативы Transformer: SSM, Mamba и гибриды: notebooks](https://vladkulikov.com/ru/courses/modern-llms/module-07/notebooks/): 2 authored items; structured source: https://vladkulikov.com/practice/modern-llms/ru/module-07.notebooks.json
- [Модуль 9. Претрейн: данные, законы масштабирования, оптимизаторы](https://vladkulikov.com/ru/courses/modern-llms/module-08/): Lecture 09; source: https://vladkulikov.com/content/modern-llms/ru/module-08.md
- [Модуль 9. Претрейн: данные, законы масштабирования, оптимизаторы: quizzes](https://vladkulikov.com/ru/courses/modern-llms/module-08/tests/): 18 authored questions; structured source: https://vladkulikov.com/quizzes/modern-llms/ru/module-08.json
- [Модуль 9. Претрейн: данные, законы масштабирования, оптимизаторы: exercises](https://vladkulikov.com/ru/courses/modern-llms/module-08/exercises/): 5 authored items; structured source: https://vladkulikov.com/practice/modern-llms/ru/module-08.exercises.json
- [Модуль 9. Претрейн: данные, законы масштабирования, оптимизаторы: notebooks](https://vladkulikov.com/ru/courses/modern-llms/module-08/notebooks/): 2 authored items; structured source: https://vladkulikov.com/practice/modern-llms/ru/module-08.notebooks.json
- [Модуль 10. KV-кэши и эффективный инференс](https://vladkulikov.com/ru/courses/modern-llms/module-09/): Lecture 10; source: https://vladkulikov.com/content/modern-llms/ru/module-09.md
- [Модуль 10. KV-кэши и эффективный инференс: quizzes](https://vladkulikov.com/ru/courses/modern-llms/module-09/tests/): 20 authored questions; structured source: https://vladkulikov.com/quizzes/modern-llms/ru/module-09.json
- [Модуль 10. KV-кэши и эффективный инференс: exercises](https://vladkulikov.com/ru/courses/modern-llms/module-09/exercises/): 5 authored items; structured source: https://vladkulikov.com/practice/modern-llms/ru/module-09.exercises.json
- [Модуль 10. KV-кэши и эффективный инференс: notebooks](https://vladkulikov.com/ru/courses/modern-llms/module-09/notebooks/): 2 authored items; structured source: https://vladkulikov.com/practice/modern-llms/ru/module-09.notebooks.json
- [Модуль 11. Спекулятивное декодирование и квантизация](https://vladkulikov.com/ru/courses/modern-llms/module-10/): Lecture 11; source: https://vladkulikov.com/content/modern-llms/ru/module-10.md
- [Модуль 11. Спекулятивное декодирование и квантизация: quizzes](https://vladkulikov.com/ru/courses/modern-llms/module-10/tests/): 19 authored questions; structured source: https://vladkulikov.com/quizzes/modern-llms/ru/module-10.json
- [Модуль 11. Спекулятивное декодирование и квантизация: exercises](https://vladkulikov.com/ru/courses/modern-llms/module-10/exercises/): 5 authored items; structured source: https://vladkulikov.com/practice/modern-llms/ru/module-10.exercises.json
- [Модуль 11. Спекулятивное декодирование и квантизация: notebooks](https://vladkulikov.com/ru/courses/modern-llms/module-10/notebooks/): 2 authored items; structured source: https://vladkulikov.com/practice/modern-llms/ru/module-10.notebooks.json
- [Модуль 12. Диффузионные LLM](https://vladkulikov.com/ru/courses/modern-llms/module-07b/): Lecture 12; source: https://vladkulikov.com/content/modern-llms/ru/module-07b.md
- [Модуль 12. Диффузионные LLM: quizzes](https://vladkulikov.com/ru/courses/modern-llms/module-07b/tests/): 19 authored questions; structured source: https://vladkulikov.com/quizzes/modern-llms/ru/module-07b.json
- [Модуль 12. Диффузионные LLM: exercises](https://vladkulikov.com/ru/courses/modern-llms/module-07b/exercises/): 6 authored items; structured source: https://vladkulikov.com/practice/modern-llms/ru/module-07b.exercises.json
- [Модуль 12. Диффузионные LLM: notebooks](https://vladkulikov.com/ru/courses/modern-llms/module-07b/notebooks/): 2 authored items; structured source: https://vladkulikov.com/practice/modern-llms/ru/module-07b.notebooks.json
- [Модуль 13. SFT и работа с данными](https://vladkulikov.com/ru/courses/modern-llms/module-11/): Lecture 13; source: https://vladkulikov.com/content/modern-llms/ru/module-11.md
- [Модуль 13. SFT и работа с данными: quizzes](https://vladkulikov.com/ru/courses/modern-llms/module-11/tests/): 19 authored questions; structured source: https://vladkulikov.com/quizzes/modern-llms/ru/module-11.json
- [Модуль 13. SFT и работа с данными: exercises](https://vladkulikov.com/ru/courses/modern-llms/module-11/exercises/): 5 authored items; structured source: https://vladkulikov.com/practice/modern-llms/ru/module-11.exercises.json
- [Модуль 13. SFT и работа с данными: notebooks](https://vladkulikov.com/ru/courses/modern-llms/module-11/notebooks/): 2 authored items; structured source: https://vladkulikov.com/practice/modern-llms/ru/module-11.notebooks.json
- [Модуль 14. Обучение по обратной связи: RLHF, DPO, RLOO и GRPO](https://vladkulikov.com/ru/courses/modern-llms/module-12/): Lecture 14; source: https://vladkulikov.com/content/modern-llms/ru/module-12.md
- [Модуль 14. Обучение по обратной связи: RLHF, DPO, RLOO и GRPO: quizzes](https://vladkulikov.com/ru/courses/modern-llms/module-12/tests/): 19 authored questions; structured source: https://vladkulikov.com/quizzes/modern-llms/ru/module-12.json
- [Модуль 14. Обучение по обратной связи: RLHF, DPO, RLOO и GRPO: exercises](https://vladkulikov.com/ru/courses/modern-llms/module-12/exercises/): 5 authored items; structured source: https://vladkulikov.com/practice/modern-llms/ru/module-12.exercises.json
- [Модуль 14. Обучение по обратной связи: RLHF, DPO, RLOO и GRPO: notebooks](https://vladkulikov.com/ru/courses/modern-llms/module-12/notebooks/): 2 authored items; structured source: https://vladkulikov.com/practice/modern-llms/ru/module-12.notebooks.json
- [Модуль 15. Модели рассуждения и вычисления во время инференса (test-time compute)](https://vladkulikov.com/ru/courses/modern-llms/module-13/): Lecture 15; source: https://vladkulikov.com/content/modern-llms/ru/module-13.md
- [Модуль 15. Модели рассуждения и вычисления во время инференса (test-time compute): quizzes](https://vladkulikov.com/ru/courses/modern-llms/module-13/tests/): 19 authored questions; structured source: https://vladkulikov.com/quizzes/modern-llms/ru/module-13.json
- [Модуль 15. Модели рассуждения и вычисления во время инференса (test-time compute): exercises](https://vladkulikov.com/ru/courses/modern-llms/module-13/exercises/): 8 authored items; structured source: https://vladkulikov.com/practice/modern-llms/ru/module-13.exercises.json
- [Модуль 15. Модели рассуждения и вычисления во время инференса (test-time compute): notebooks](https://vladkulikov.com/ru/courses/modern-llms/module-13/notebooks/): 2 authored items; structured source: https://vladkulikov.com/practice/modern-llms/ru/module-13.notebooks.json
- [Модуль 16. Мультимодальные LLM: зрение, аудио и видео](https://vladkulikov.com/ru/courses/modern-llms/module-14/): Lecture 16; source: https://vladkulikov.com/content/modern-llms/ru/module-14.md
- [Модуль 16. Мультимодальные LLM: зрение, аудио и видео: quizzes](https://vladkulikov.com/ru/courses/modern-llms/module-14/tests/): 19 authored questions; structured source: https://vladkulikov.com/quizzes/modern-llms/ru/module-14.json
- [Модуль 16. Мультимодальные LLM: зрение, аудио и видео: exercises](https://vladkulikov.com/ru/courses/modern-llms/module-14/exercises/): 6 authored items; structured source: https://vladkulikov.com/practice/modern-llms/ru/module-14.exercises.json
- [Модуль 16. Мультимодальные LLM: зрение, аудио и видео: notebooks](https://vladkulikov.com/ru/courses/modern-llms/module-14/notebooks/): 2 authored items; structured source: https://vladkulikov.com/practice/modern-llms/ru/module-14.notebooks.json
- [Модуль 17. Эмбеддинги, поиск и RAG](https://vladkulikov.com/ru/courses/modern-llms/module-15/): Lecture 17; source: https://vladkulikov.com/content/modern-llms/ru/module-15.md
- [Модуль 17. Эмбеддинги, поиск и RAG: quizzes](https://vladkulikov.com/ru/courses/modern-llms/module-15/tests/): 19 authored questions; structured source: https://vladkulikov.com/quizzes/modern-llms/ru/module-15.json
- [Модуль 17. Эмбеддинги, поиск и RAG: exercises](https://vladkulikov.com/ru/courses/modern-llms/module-15/exercises/): 5 authored items; structured source: https://vladkulikov.com/practice/modern-llms/ru/module-15.exercises.json
- [Модуль 17. Эмбеддинги, поиск и RAG: notebooks](https://vladkulikov.com/ru/courses/modern-llms/module-15/notebooks/): 2 authored items; structured source: https://vladkulikov.com/practice/modern-llms/ru/module-15.notebooks.json
- [Модуль 18. Агенты и работа с инструментами](https://vladkulikov.com/ru/courses/modern-llms/module-16/): Lecture 18; source: https://vladkulikov.com/content/modern-llms/ru/module-16.md
- [Модуль 18. Агенты и работа с инструментами: quizzes](https://vladkulikov.com/ru/courses/modern-llms/module-16/tests/): 20 authored questions; structured source: https://vladkulikov.com/quizzes/modern-llms/ru/module-16.json
- [Модуль 18. Агенты и работа с инструментами: exercises](https://vladkulikov.com/ru/courses/modern-llms/module-16/exercises/): 5 authored items; structured source: https://vladkulikov.com/practice/modern-llms/ru/module-16.exercises.json
- [Модуль 18. Агенты и работа с инструментами: notebooks](https://vladkulikov.com/ru/courses/modern-llms/module-16/notebooks/): 2 authored items; structured source: https://vladkulikov.com/practice/modern-llms/ru/module-16.notebooks.json
- [Модуль 19. Оценка современных LLM: от бенчмарка к инженерному решению](https://vladkulikov.com/ru/courses/modern-llms/module-17/): Lecture 19; source: https://vladkulikov.com/content/modern-llms/ru/module-17.md
- [Модуль 19. Оценка современных LLM: от бенчмарка к инженерному решению: quizzes](https://vladkulikov.com/ru/courses/modern-llms/module-17/tests/): 20 authored questions; structured source: https://vladkulikov.com/quizzes/modern-llms/ru/module-17.json
- [Модуль 19. Оценка современных LLM: от бенчмарка к инженерному решению: exercises](https://vladkulikov.com/ru/courses/modern-llms/module-17/exercises/): 5 authored items; structured source: https://vladkulikov.com/practice/modern-llms/ru/module-17.exercises.json
- [Модуль 19. Оценка современных LLM: от бенчмарка к инженерному решению: notebooks](https://vladkulikov.com/ru/courses/modern-llms/module-17/notebooks/): 2 authored items; structured source: https://vladkulikov.com/practice/modern-llms/ru/module-17.notebooks.json
- [Модуль 20. LLM целиком: от токенов до обучения и генерации](https://vladkulikov.com/ru/courses/modern-llms/module-20/): Lecture 20; source: https://vladkulikov.com/content/modern-llms/ru/module-20.md
- [Модуль 20. LLM целиком: от токенов до обучения и генерации: quizzes](https://vladkulikov.com/ru/courses/modern-llms/module-20/tests/): 15 authored questions; structured source: https://vladkulikov.com/quizzes/modern-llms/ru/module-20.json
- [Модуль 20. LLM целиком: от токенов до обучения и генерации: exercises](https://vladkulikov.com/ru/courses/modern-llms/module-20/exercises/): 6 authored items; structured source: https://vladkulikov.com/practice/modern-llms/ru/module-20.exercises.json
- [Модуль 20. LLM целиком: от токенов до обучения и генерации: notebooks](https://vladkulikov.com/ru/courses/modern-llms/module-20/notebooks/): 5 authored items; structured source: https://vladkulikov.com/practice/modern-llms/ru/module-20.notebooks.json

## Modern LLMs (EN)
- [Course overview](https://vladkulikov.com/courses/modern-llms/): Architecture, training, inference, agents, and evaluation of modern language-model systems.
- [Module 1. The Modern LLM Landscape](https://vladkulikov.com/courses/modern-llms/module-01/): Lecture 01; source: https://vladkulikov.com/content/modern-llms/en/module-01.md
- [Module 1. The Modern LLM Landscape: quizzes](https://vladkulikov.com/courses/modern-llms/module-01/tests/): 19 authored questions; structured source: https://vladkulikov.com/quizzes/modern-llms/en/module-01.json
- [Module 1. The Modern LLM Landscape: exercises](https://vladkulikov.com/courses/modern-llms/module-01/exercises/): 6 authored items; structured source: https://vladkulikov.com/practice/modern-llms/en/module-01.exercises.json
- [Module 1. The Modern LLM Landscape: notebooks](https://vladkulikov.com/courses/modern-llms/module-01/notebooks/): 2 authored items; structured source: https://vladkulikov.com/practice/modern-llms/en/module-01.notebooks.json
- [Module 2. Tokenization and Embeddings](https://vladkulikov.com/courses/modern-llms/module-02/): Lecture 02; source: https://vladkulikov.com/content/modern-llms/en/module-02.md
- [Module 2. Tokenization and Embeddings: quizzes](https://vladkulikov.com/courses/modern-llms/module-02/tests/): 16 authored questions; structured source: https://vladkulikov.com/quizzes/modern-llms/en/module-02.json
- [Module 2. Tokenization and Embeddings: exercises](https://vladkulikov.com/courses/modern-llms/module-02/exercises/): 6 authored items; structured source: https://vladkulikov.com/practice/modern-llms/en/module-02.exercises.json
- [Module 2. Tokenization and Embeddings: notebooks](https://vladkulikov.com/courses/modern-llms/module-02/notebooks/): 2 authored items; structured source: https://vladkulikov.com/practice/modern-llms/en/module-02.notebooks.json
- [Module 3. The Basic Transformer](https://vladkulikov.com/courses/modern-llms/module-18/): Lecture 03; source: https://vladkulikov.com/content/modern-llms/en/module-18.md
- [Module 3. The Basic Transformer: quizzes](https://vladkulikov.com/courses/modern-llms/module-18/tests/): 46 authored questions; structured source: https://vladkulikov.com/quizzes/modern-llms/en/module-18.json
- [Module 3. The Basic Transformer: exercises](https://vladkulikov.com/courses/modern-llms/module-18/exercises/): 8 authored items; structured source: https://vladkulikov.com/practice/modern-llms/en/module-18.exercises.json
- [Module 3. The Basic Transformer: notebooks](https://vladkulikov.com/courses/modern-llms/module-18/notebooks/): 1 authored items; structured source: https://vladkulikov.com/practice/modern-llms/en/module-18.notebooks.json
- [Module 4. Positional representations: from sinusoids to multiple axes](https://vladkulikov.com/courses/modern-llms/module-03/): Lecture 04; source: https://vladkulikov.com/content/modern-llms/en/module-03.md
- [Module 4. Positional representations: from sinusoids to multiple axes: quizzes](https://vladkulikov.com/courses/modern-llms/module-03/tests/): 23 authored questions; structured source: https://vladkulikov.com/quizzes/modern-llms/en/module-03.json
- [Module 4. Positional representations: from sinusoids to multiple axes: exercises](https://vladkulikov.com/courses/modern-llms/module-03/exercises/): 5 authored items; structured source: https://vladkulikov.com/practice/modern-llms/en/module-03.exercises.json
- [Module 4. Positional representations: from sinusoids to multiple axes: notebooks](https://vladkulikov.com/courses/modern-llms/module-03/notebooks/): 2 authored items; structured source: https://vladkulikov.com/practice/modern-llms/en/module-03.notebooks.json
- [Module 5. Modern Attention Mechanisms](https://vladkulikov.com/courses/modern-llms/module-04/): Lecture 05; source: https://vladkulikov.com/content/modern-llms/en/module-04.md
- [Module 5. Modern Attention Mechanisms: quizzes](https://vladkulikov.com/courses/modern-llms/module-04/tests/): 23 authored questions; structured source: https://vladkulikov.com/quizzes/modern-llms/en/module-04.json
- [Module 5. Modern Attention Mechanisms: exercises](https://vladkulikov.com/courses/modern-llms/module-04/exercises/): 7 authored items; structured source: https://vladkulikov.com/practice/modern-llms/en/module-04.exercises.json
- [Module 5. Modern Attention Mechanisms: notebooks](https://vladkulikov.com/courses/modern-llms/module-04/notebooks/): 2 authored items; structured source: https://vladkulikov.com/practice/modern-llms/en/module-04.notebooks.json
- [Module 6. Normalization, activations, and the anatomy of a Transformer block](https://vladkulikov.com/courses/modern-llms/module-05/): Lecture 06; source: https://vladkulikov.com/content/modern-llms/en/module-05.md
- [Module 6. Normalization, activations, and the anatomy of a Transformer block: quizzes](https://vladkulikov.com/courses/modern-llms/module-05/tests/): 22 authored questions; structured source: https://vladkulikov.com/quizzes/modern-llms/en/module-05.json
- [Module 6. Normalization, activations, and the anatomy of a Transformer block: exercises](https://vladkulikov.com/courses/modern-llms/module-05/exercises/): 7 authored items; structured source: https://vladkulikov.com/practice/modern-llms/en/module-05.exercises.json
- [Module 6. Normalization, activations, and the anatomy of a Transformer block: notebooks](https://vladkulikov.com/courses/modern-llms/module-05/notebooks/): 2 authored items; structured source: https://vladkulikov.com/practice/modern-llms/en/module-05.notebooks.json
- [Module 7. Mixture of Experts](https://vladkulikov.com/courses/modern-llms/module-06/): Lecture 07; source: https://vladkulikov.com/content/modern-llms/en/module-06.md
- [Module 7. Mixture of Experts: quizzes](https://vladkulikov.com/courses/modern-llms/module-06/tests/): 21 authored questions; structured source: https://vladkulikov.com/quizzes/modern-llms/en/module-06.json
- [Module 7. Mixture of Experts: exercises](https://vladkulikov.com/courses/modern-llms/module-06/exercises/): 6 authored items; structured source: https://vladkulikov.com/practice/modern-llms/en/module-06.exercises.json
- [Module 7. Mixture of Experts: notebooks](https://vladkulikov.com/courses/modern-llms/module-06/notebooks/): 2 authored items; structured source: https://vladkulikov.com/practice/modern-llms/en/module-06.notebooks.json
- [Module 8. Beyond the Transformer: SSMs, Mamba, and Hybrid Sequence Models](https://vladkulikov.com/courses/modern-llms/module-07/): Lecture 08; source: https://vladkulikov.com/content/modern-llms/en/module-07.md
- [Module 8. Beyond the Transformer: SSMs, Mamba, and Hybrid Sequence Models: quizzes](https://vladkulikov.com/courses/modern-llms/module-07/tests/): 19 authored questions; structured source: https://vladkulikov.com/quizzes/modern-llms/en/module-07.json
- [Module 8. Beyond the Transformer: SSMs, Mamba, and Hybrid Sequence Models: exercises](https://vladkulikov.com/courses/modern-llms/module-07/exercises/): 5 authored items; structured source: https://vladkulikov.com/practice/modern-llms/en/module-07.exercises.json
- [Module 8. Beyond the Transformer: SSMs, Mamba, and Hybrid Sequence Models: notebooks](https://vladkulikov.com/courses/modern-llms/module-07/notebooks/): 2 authored items; structured source: https://vladkulikov.com/practice/modern-llms/en/module-07.notebooks.json
- [Module 9. Pretraining: Data, Scaling Laws, and Optimizers](https://vladkulikov.com/courses/modern-llms/module-08/): Lecture 09; source: https://vladkulikov.com/content/modern-llms/en/module-08.md
- [Module 9. Pretraining: Data, Scaling Laws, and Optimizers: quizzes](https://vladkulikov.com/courses/modern-llms/module-08/tests/): 18 authored questions; structured source: https://vladkulikov.com/quizzes/modern-llms/en/module-08.json
- [Module 9. Pretraining: Data, Scaling Laws, and Optimizers: exercises](https://vladkulikov.com/courses/modern-llms/module-08/exercises/): 5 authored items; structured source: https://vladkulikov.com/practice/modern-llms/en/module-08.exercises.json
- [Module 9. Pretraining: Data, Scaling Laws, and Optimizers: notebooks](https://vladkulikov.com/courses/modern-llms/module-08/notebooks/): 2 authored items; structured source: https://vladkulikov.com/practice/modern-llms/en/module-08.notebooks.json
- [Module 10. KV Caches and Efficient Inference](https://vladkulikov.com/courses/modern-llms/module-09/): Lecture 10; source: https://vladkulikov.com/content/modern-llms/en/module-09.md
- [Module 10. KV Caches and Efficient Inference: quizzes](https://vladkulikov.com/courses/modern-llms/module-09/tests/): 20 authored questions; structured source: https://vladkulikov.com/quizzes/modern-llms/en/module-09.json
- [Module 10. KV Caches and Efficient Inference: exercises](https://vladkulikov.com/courses/modern-llms/module-09/exercises/): 5 authored items; structured source: https://vladkulikov.com/practice/modern-llms/en/module-09.exercises.json
- [Module 10. KV Caches and Efficient Inference: notebooks](https://vladkulikov.com/courses/modern-llms/module-09/notebooks/): 2 authored items; structured source: https://vladkulikov.com/practice/modern-llms/en/module-09.notebooks.json
- [Module 11. Speculative Decoding and Quantization](https://vladkulikov.com/courses/modern-llms/module-10/): Lecture 11; source: https://vladkulikov.com/content/modern-llms/en/module-10.md
- [Module 11. Speculative Decoding and Quantization: quizzes](https://vladkulikov.com/courses/modern-llms/module-10/tests/): 19 authored questions; structured source: https://vladkulikov.com/quizzes/modern-llms/en/module-10.json
- [Module 11. Speculative Decoding and Quantization: exercises](https://vladkulikov.com/courses/modern-llms/module-10/exercises/): 5 authored items; structured source: https://vladkulikov.com/practice/modern-llms/en/module-10.exercises.json
- [Module 11. Speculative Decoding and Quantization: notebooks](https://vladkulikov.com/courses/modern-llms/module-10/notebooks/): 2 authored items; structured source: https://vladkulikov.com/practice/modern-llms/en/module-10.notebooks.json
- [Module 12. Diffusion Language Models](https://vladkulikov.com/courses/modern-llms/module-07b/): Lecture 12; source: https://vladkulikov.com/content/modern-llms/en/module-07b.md
- [Module 12. Diffusion Language Models: quizzes](https://vladkulikov.com/courses/modern-llms/module-07b/tests/): 19 authored questions; structured source: https://vladkulikov.com/quizzes/modern-llms/en/module-07b.json
- [Module 12. Diffusion Language Models: exercises](https://vladkulikov.com/courses/modern-llms/module-07b/exercises/): 6 authored items; structured source: https://vladkulikov.com/practice/modern-llms/en/module-07b.exercises.json
- [Module 12. Diffusion Language Models: notebooks](https://vladkulikov.com/courses/modern-llms/module-07b/notebooks/): 2 authored items; structured source: https://vladkulikov.com/practice/modern-llms/en/module-07b.notebooks.json
- [Module 13. Supervised Fine-Tuning and Data Work](https://vladkulikov.com/courses/modern-llms/module-11/): Lecture 13; source: https://vladkulikov.com/content/modern-llms/en/module-11.md
- [Module 13. Supervised Fine-Tuning and Data Work: quizzes](https://vladkulikov.com/courses/modern-llms/module-11/tests/): 19 authored questions; structured source: https://vladkulikov.com/quizzes/modern-llms/en/module-11.json
- [Module 13. Supervised Fine-Tuning and Data Work: exercises](https://vladkulikov.com/courses/modern-llms/module-11/exercises/): 5 authored items; structured source: https://vladkulikov.com/practice/modern-llms/en/module-11.exercises.json
- [Module 13. Supervised Fine-Tuning and Data Work: notebooks](https://vladkulikov.com/courses/modern-llms/module-11/notebooks/): 2 authored items; structured source: https://vladkulikov.com/practice/modern-llms/en/module-11.notebooks.json
- [Module 14. Learning from Feedback: RLHF, DPO, RLOO, and GRPO](https://vladkulikov.com/courses/modern-llms/module-12/): Lecture 14; source: https://vladkulikov.com/content/modern-llms/en/module-12.md
- [Module 14. Learning from Feedback: RLHF, DPO, RLOO, and GRPO: quizzes](https://vladkulikov.com/courses/modern-llms/module-12/tests/): 19 authored questions; structured source: https://vladkulikov.com/quizzes/modern-llms/en/module-12.json
- [Module 14. Learning from Feedback: RLHF, DPO, RLOO, and GRPO: exercises](https://vladkulikov.com/courses/modern-llms/module-12/exercises/): 5 authored items; structured source: https://vladkulikov.com/practice/modern-llms/en/module-12.exercises.json
- [Module 14. Learning from Feedback: RLHF, DPO, RLOO, and GRPO: notebooks](https://vladkulikov.com/courses/modern-llms/module-12/notebooks/): 2 authored items; structured source: https://vladkulikov.com/practice/modern-llms/en/module-12.notebooks.json
- [Module 15. Reasoning Models and Test-Time Compute](https://vladkulikov.com/courses/modern-llms/module-13/): Lecture 15; source: https://vladkulikov.com/content/modern-llms/en/module-13.md
- [Module 15. Reasoning Models and Test-Time Compute: quizzes](https://vladkulikov.com/courses/modern-llms/module-13/tests/): 19 authored questions; structured source: https://vladkulikov.com/quizzes/modern-llms/en/module-13.json
- [Module 15. Reasoning Models and Test-Time Compute: exercises](https://vladkulikov.com/courses/modern-llms/module-13/exercises/): 8 authored items; structured source: https://vladkulikov.com/practice/modern-llms/en/module-13.exercises.json
- [Module 15. Reasoning Models and Test-Time Compute: notebooks](https://vladkulikov.com/courses/modern-llms/module-13/notebooks/): 2 authored items; structured source: https://vladkulikov.com/practice/modern-llms/en/module-13.notebooks.json
- [Module 16. Multimodal LLMs: Vision, Audio, and Video](https://vladkulikov.com/courses/modern-llms/module-14/): Lecture 16; source: https://vladkulikov.com/content/modern-llms/en/module-14.md
- [Module 16. Multimodal LLMs: Vision, Audio, and Video: quizzes](https://vladkulikov.com/courses/modern-llms/module-14/tests/): 19 authored questions; structured source: https://vladkulikov.com/quizzes/modern-llms/en/module-14.json
- [Module 16. Multimodal LLMs: Vision, Audio, and Video: exercises](https://vladkulikov.com/courses/modern-llms/module-14/exercises/): 6 authored items; structured source: https://vladkulikov.com/practice/modern-llms/en/module-14.exercises.json
- [Module 16. Multimodal LLMs: Vision, Audio, and Video: notebooks](https://vladkulikov.com/courses/modern-llms/module-14/notebooks/): 2 authored items; structured source: https://vladkulikov.com/practice/modern-llms/en/module-14.notebooks.json
- [Module 17. Embeddings, Retrieval, and RAG](https://vladkulikov.com/courses/modern-llms/module-15/): Lecture 17; source: https://vladkulikov.com/content/modern-llms/en/module-15.md
- [Module 17. Embeddings, Retrieval, and RAG: quizzes](https://vladkulikov.com/courses/modern-llms/module-15/tests/): 19 authored questions; structured source: https://vladkulikov.com/quizzes/modern-llms/en/module-15.json
- [Module 17. Embeddings, Retrieval, and RAG: exercises](https://vladkulikov.com/courses/modern-llms/module-15/exercises/): 5 authored items; structured source: https://vladkulikov.com/practice/modern-llms/en/module-15.exercises.json
- [Module 17. Embeddings, Retrieval, and RAG: notebooks](https://vladkulikov.com/courses/modern-llms/module-15/notebooks/): 2 authored items; structured source: https://vladkulikov.com/practice/modern-llms/en/module-15.notebooks.json
- [Module 18. Agents and Tool Use](https://vladkulikov.com/courses/modern-llms/module-16/): Lecture 18; source: https://vladkulikov.com/content/modern-llms/en/module-16.md
- [Module 18. Agents and Tool Use: quizzes](https://vladkulikov.com/courses/modern-llms/module-16/tests/): 20 authored questions; structured source: https://vladkulikov.com/quizzes/modern-llms/en/module-16.json
- [Module 18. Agents and Tool Use: exercises](https://vladkulikov.com/courses/modern-llms/module-16/exercises/): 5 authored items; structured source: https://vladkulikov.com/practice/modern-llms/en/module-16.exercises.json
- [Module 18. Agents and Tool Use: notebooks](https://vladkulikov.com/courses/modern-llms/module-16/notebooks/): 2 authored items; structured source: https://vladkulikov.com/practice/modern-llms/en/module-16.notebooks.json
- [Module 19. Evaluating Modern LLM Systems: From Benchmarks to Decisions](https://vladkulikov.com/courses/modern-llms/module-17/): Lecture 19; source: https://vladkulikov.com/content/modern-llms/en/module-17.md
- [Module 19. Evaluating Modern LLM Systems: From Benchmarks to Decisions: quizzes](https://vladkulikov.com/courses/modern-llms/module-17/tests/): 20 authored questions; structured source: https://vladkulikov.com/quizzes/modern-llms/en/module-17.json
- [Module 19. Evaluating Modern LLM Systems: From Benchmarks to Decisions: exercises](https://vladkulikov.com/courses/modern-llms/module-17/exercises/): 5 authored items; structured source: https://vladkulikov.com/practice/modern-llms/en/module-17.exercises.json
- [Module 19. Evaluating Modern LLM Systems: From Benchmarks to Decisions: notebooks](https://vladkulikov.com/courses/modern-llms/module-17/notebooks/): 2 authored items; structured source: https://vladkulikov.com/practice/modern-llms/en/module-17.notebooks.json
- [Module 20. The complete LLM: from tokens to training and generation](https://vladkulikov.com/courses/modern-llms/module-20/): Lecture 20; source: https://vladkulikov.com/content/modern-llms/en/module-20.md
- [Module 20. The complete LLM: from tokens to training and generation: quizzes](https://vladkulikov.com/courses/modern-llms/module-20/tests/): 15 authored questions; structured source: https://vladkulikov.com/quizzes/modern-llms/en/module-20.json
- [Module 20. The complete LLM: from tokens to training and generation: exercises](https://vladkulikov.com/courses/modern-llms/module-20/exercises/): 6 authored items; structured source: https://vladkulikov.com/practice/modern-llms/en/module-20.exercises.json
- [Module 20. The complete LLM: from tokens to training and generation: notebooks](https://vladkulikov.com/courses/modern-llms/module-20/notebooks/): 5 authored items; structured source: https://vladkulikov.com/practice/modern-llms/en/module-20.notebooks.json

## RL для LLM (RU)
- [Course overview](https://vladkulikov.com/ru/courses/rl-for-llm/): Обучение с подкреплением, оптимизация предпочтений, проверяемые награды, агенты и безопасность.
- [Модуль 1. Введение: Reinforcement Learning для LLM](https://vladkulikov.com/ru/courses/rl-for-llm/module-01/): Lecture 01; source: https://vladkulikov.com/content/rl-for-llm/ru/module-01.md
- [Модуль 1. Введение: Reinforcement Learning для LLM: quizzes](https://vladkulikov.com/ru/courses/rl-for-llm/module-01/tests/): 10 authored questions; structured source: https://vladkulikov.com/quizzes/rl-for-llm/ru/module-01.json
- [Модуль 1. Введение: Reinforcement Learning для LLM: exercises](https://vladkulikov.com/ru/courses/rl-for-llm/module-01/exercises/): 20 authored items; structured source: https://vladkulikov.com/practice/rl-for-llm/ru/module-01.exercises.json
- [Модуль 1. Введение: Reinforcement Learning для LLM: notebooks](https://vladkulikov.com/ru/courses/rl-for-llm/module-01/notebooks/): 1 authored items; structured source: https://vladkulikov.com/practice/rl-for-llm/ru/module-01.notebooks.json
- [Модуль 2. Состояние, ценность и уравнения Беллмана](https://vladkulikov.com/ru/courses/rl-for-llm/module-02/): Lecture 02; source: https://vladkulikov.com/content/rl-for-llm/ru/module-02.md
- [Модуль 2. Состояние, ценность и уравнения Беллмана: quizzes](https://vladkulikov.com/ru/courses/rl-for-llm/module-02/tests/): 12 authored questions; structured source: https://vladkulikov.com/quizzes/rl-for-llm/ru/module-02.json
- [Модуль 2. Состояние, ценность и уравнения Беллмана: exercises](https://vladkulikov.com/ru/courses/rl-for-llm/module-02/exercises/): 20 authored items; structured source: https://vladkulikov.com/practice/rl-for-llm/ru/module-02.exercises.json
- [Модуль 2. Состояние, ценность и уравнения Беллмана: notebooks](https://vladkulikov.com/ru/courses/rl-for-llm/module-02/notebooks/): 1 authored items; structured source: https://vladkulikov.com/practice/rl-for-llm/ru/module-02.notebooks.json
- [Модуль 3. Бандиты, исследование и одношаговые решения](https://vladkulikov.com/ru/courses/rl-for-llm/module-03/): Lecture 03; source: https://vladkulikov.com/content/rl-for-llm/ru/module-03.md
- [Модуль 3. Бандиты, исследование и одношаговые решения: quizzes](https://vladkulikov.com/ru/courses/rl-for-llm/module-03/tests/): 12 authored questions; structured source: https://vladkulikov.com/quizzes/rl-for-llm/ru/module-03.json
- [Модуль 3. Бандиты, исследование и одношаговые решения: exercises](https://vladkulikov.com/ru/courses/rl-for-llm/module-03/exercises/): 20 authored items; structured source: https://vladkulikov.com/practice/rl-for-llm/ru/module-03.exercises.json
- [Модуль 3. Бандиты, исследование и одношаговые решения: notebooks](https://vladkulikov.com/ru/courses/rl-for-llm/module-03/notebooks/): 1 authored items; structured source: https://vladkulikov.com/practice/rl-for-llm/ru/module-03.notebooks.json
- [Модуль 4. Градиенты политики: от REINFORCE к PPO](https://vladkulikov.com/ru/courses/rl-for-llm/module-04/): Lecture 04; source: https://vladkulikov.com/content/rl-for-llm/ru/module-04.md
- [Модуль 4. Градиенты политики: от REINFORCE к PPO: quizzes](https://vladkulikov.com/ru/courses/rl-for-llm/module-04/tests/): 12 authored questions; structured source: https://vladkulikov.com/quizzes/rl-for-llm/ru/module-04.json
- [Модуль 4. Градиенты политики: от REINFORCE к PPO: exercises](https://vladkulikov.com/ru/courses/rl-for-llm/module-04/exercises/): 20 authored items; structured source: https://vladkulikov.com/practice/rl-for-llm/ru/module-04.exercises.json
- [Модуль 4. Градиенты политики: от REINFORCE к PPO: notebooks](https://vladkulikov.com/ru/courses/rl-for-llm/module-04/notebooks/): 1 authored items; structured source: https://vladkulikov.com/practice/rl-for-llm/ru/module-04.notebooks.json
- [Модуль 5. Обучение по фиксированным данным: имитация, глубокие Q-методы и офлайн-RL](https://vladkulikov.com/ru/courses/rl-for-llm/module-05/): Lecture 05; source: https://vladkulikov.com/content/rl-for-llm/ru/module-05.md
- [Модуль 5. Обучение по фиксированным данным: имитация, глубокие Q-методы и офлайн-RL: quizzes](https://vladkulikov.com/ru/courses/rl-for-llm/module-05/tests/): 12 authored questions; structured source: https://vladkulikov.com/quizzes/rl-for-llm/ru/module-05.json
- [Модуль 5. Обучение по фиксированным данным: имитация, глубокие Q-методы и офлайн-RL: exercises](https://vladkulikov.com/ru/courses/rl-for-llm/module-05/exercises/): 20 authored items; structured source: https://vladkulikov.com/practice/rl-for-llm/ru/module-05.exercises.json
- [Модуль 5. Обучение по фиксированным данным: имитация, глубокие Q-методы и офлайн-RL: notebooks](https://vladkulikov.com/ru/courses/rl-for-llm/module-05/notebooks/): 1 authored items; structured source: https://vladkulikov.com/practice/rl-for-llm/ru/module-05.notebooks.json
- [Модуль 6. LLM как политика: токены, логарифмы вероятностей и KL](https://vladkulikov.com/ru/courses/rl-for-llm/module-06/): Lecture 06; source: https://vladkulikov.com/content/rl-for-llm/ru/module-06.md
- [Модуль 6. LLM как политика: токены, логарифмы вероятностей и KL: quizzes](https://vladkulikov.com/ru/courses/rl-for-llm/module-06/tests/): 12 authored questions; structured source: https://vladkulikov.com/quizzes/rl-for-llm/ru/module-06.json
- [Модуль 6. LLM как политика: токены, логарифмы вероятностей и KL: exercises](https://vladkulikov.com/ru/courses/rl-for-llm/module-06/exercises/): 20 authored items; structured source: https://vladkulikov.com/practice/rl-for-llm/ru/module-06.exercises.json
- [Модуль 6. LLM как политика: токены, логарифмы вероятностей и KL: notebooks](https://vladkulikov.com/ru/courses/rl-for-llm/module-06/notebooks/): 1 authored items; structured source: https://vladkulikov.com/practice/rl-for-llm/ru/module-06.notebooks.json
- [Модуль 7. Модели награды и данные о предпочтениях](https://vladkulikov.com/ru/courses/rl-for-llm/module-07/): Lecture 07; source: https://vladkulikov.com/content/rl-for-llm/ru/module-07.md
- [Модуль 7. Модели награды и данные о предпочтениях: quizzes](https://vladkulikov.com/ru/courses/rl-for-llm/module-07/tests/): 12 authored questions; structured source: https://vladkulikov.com/quizzes/rl-for-llm/ru/module-07.json
- [Модуль 7. Модели награды и данные о предпочтениях: exercises](https://vladkulikov.com/ru/courses/rl-for-llm/module-07/exercises/): 20 authored items; structured source: https://vladkulikov.com/practice/rl-for-llm/ru/module-07.exercises.json
- [Модуль 7. Модели награды и данные о предпочтениях: notebooks](https://vladkulikov.com/ru/courses/rl-for-llm/module-07/notebooks/): 1 authored items; structured source: https://vladkulikov.com/practice/rl-for-llm/ru/module-07.notebooks.json
- [Модуль 8. RLHF и прямые методы оптимизации предпочтений](https://vladkulikov.com/ru/courses/rl-for-llm/module-08/): Lecture 08; source: https://vladkulikov.com/content/rl-for-llm/ru/module-08.md
- [Модуль 8. RLHF и прямые методы оптимизации предпочтений: quizzes](https://vladkulikov.com/ru/courses/rl-for-llm/module-08/tests/): 9 authored questions; structured source: https://vladkulikov.com/quizzes/rl-for-llm/ru/module-08.json
- [Модуль 8. RLHF и прямые методы оптимизации предпочтений: exercises](https://vladkulikov.com/ru/courses/rl-for-llm/module-08/exercises/): 23 authored items; structured source: https://vladkulikov.com/practice/rl-for-llm/ru/module-08.exercises.json
- [Модуль 8. RLHF и прямые методы оптимизации предпочтений: notebooks](https://vladkulikov.com/ru/courses/rl-for-llm/module-08/notebooks/): 1 authored items; structured source: https://vladkulikov.com/practice/rl-for-llm/ru/module-08.notebooks.json
- [Модуль 9. RLVR и GRPO: проверяемые награды, групповые оценки и устойчивость](https://vladkulikov.com/ru/courses/rl-for-llm/module-09/): Lecture 09; source: https://vladkulikov.com/content/rl-for-llm/ru/module-09.md
- [Модуль 9. RLVR и GRPO: проверяемые награды, групповые оценки и устойчивость: quizzes](https://vladkulikov.com/ru/courses/rl-for-llm/module-09/tests/): 12 authored questions; structured source: https://vladkulikov.com/quizzes/rl-for-llm/ru/module-09.json
- [Модуль 9. RLVR и GRPO: проверяемые награды, групповые оценки и устойчивость: exercises](https://vladkulikov.com/ru/courses/rl-for-llm/module-09/exercises/): 20 authored items; structured source: https://vladkulikov.com/practice/rl-for-llm/ru/module-09.exercises.json
- [Модуль 9. RLVR и GRPO: проверяемые награды, групповые оценки и устойчивость: notebooks](https://vladkulikov.com/ru/courses/rl-for-llm/module-09/notebooks/): 1 authored items; structured source: https://vladkulikov.com/practice/rl-for-llm/ru/module-09.notebooks.json
- [Модуль 10. Поиск, проверка и вычислительный бюджет на этапе генерации](https://vladkulikov.com/ru/courses/rl-for-llm/module-10/): Lecture 10; source: https://vladkulikov.com/content/rl-for-llm/ru/module-10.md
- [Модуль 10. Поиск, проверка и вычислительный бюджет на этапе генерации: quizzes](https://vladkulikov.com/ru/courses/rl-for-llm/module-10/tests/): 12 authored questions; structured source: https://vladkulikov.com/quizzes/rl-for-llm/ru/module-10.json
- [Модуль 10. Поиск, проверка и вычислительный бюджет на этапе генерации: exercises](https://vladkulikov.com/ru/courses/rl-for-llm/module-10/exercises/): 20 authored items; structured source: https://vladkulikov.com/practice/rl-for-llm/ru/module-10.exercises.json
- [Модуль 10. Поиск, проверка и вычислительный бюджет на этапе генерации: notebooks](https://vladkulikov.com/ru/courses/rl-for-llm/module-10/notebooks/): 1 authored items; structured source: https://vladkulikov.com/practice/rl-for-llm/ru/module-10.notebooks.json
- [Модуль 11. RL для LLM-агентов: инструменты, среда и длинные траектории](https://vladkulikov.com/ru/courses/rl-for-llm/module-11/): Lecture 11; source: https://vladkulikov.com/content/rl-for-llm/ru/module-11.md
- [Модуль 11. RL для LLM-агентов: инструменты, среда и длинные траектории: quizzes](https://vladkulikov.com/ru/courses/rl-for-llm/module-11/tests/): 12 authored questions; structured source: https://vladkulikov.com/quizzes/rl-for-llm/ru/module-11.json
- [Модуль 11. RL для LLM-агентов: инструменты, среда и длинные траектории: exercises](https://vladkulikov.com/ru/courses/rl-for-llm/module-11/exercises/): 20 authored items; structured source: https://vladkulikov.com/practice/rl-for-llm/ru/module-11.exercises.json
- [Модуль 11. RL для LLM-агентов: инструменты, среда и длинные траектории: notebooks](https://vladkulikov.com/ru/courses/rl-for-llm/module-11/notebooks/): 1 authored items; structured source: https://vladkulikov.com/practice/rl-for-llm/ru/module-11.notebooks.json
- [Модуль 12. Инфраструктура RL для LLM: память, роллауты и асинхронность](https://vladkulikov.com/ru/courses/rl-for-llm/module-12/): Lecture 12; source: https://vladkulikov.com/content/rl-for-llm/ru/module-12.md
- [Модуль 12. Инфраструктура RL для LLM: память, роллауты и асинхронность: quizzes](https://vladkulikov.com/ru/courses/rl-for-llm/module-12/tests/): 12 authored questions; structured source: https://vladkulikov.com/quizzes/rl-for-llm/ru/module-12.json
- [Модуль 12. Инфраструктура RL для LLM: память, роллауты и асинхронность: exercises](https://vladkulikov.com/ru/courses/rl-for-llm/module-12/exercises/): 20 authored items; structured source: https://vladkulikov.com/practice/rl-for-llm/ru/module-12.exercises.json
- [Модуль 12. Инфраструктура RL для LLM: память, роллауты и асинхронность: notebooks](https://vladkulikov.com/ru/courses/rl-for-llm/module-12/notebooks/): 1 authored items; structured source: https://vladkulikov.com/practice/rl-for-llm/ru/module-12.notebooks.json
- [Модуль 13. Оценивание RL-систем для LLM: статистика, взлом награды и безопасность](https://vladkulikov.com/ru/courses/rl-for-llm/module-13/): Lecture 13; source: https://vladkulikov.com/content/rl-for-llm/ru/module-13.md
- [Модуль 13. Оценивание RL-систем для LLM: статистика, взлом награды и безопасность: quizzes](https://vladkulikov.com/ru/courses/rl-for-llm/module-13/tests/): 12 authored questions; structured source: https://vladkulikov.com/quizzes/rl-for-llm/ru/module-13.json
- [Модуль 13. Оценивание RL-систем для LLM: статистика, взлом награды и безопасность: exercises](https://vladkulikov.com/ru/courses/rl-for-llm/module-13/exercises/): 20 authored items; structured source: https://vladkulikov.com/practice/rl-for-llm/ru/module-13.exercises.json
- [Модуль 13. Оценивание RL-систем для LLM: статистика, взлом награды и безопасность: notebooks](https://vladkulikov.com/ru/courses/rl-for-llm/module-13/notebooks/): 1 authored items; structured source: https://vladkulikov.com/practice/rl-for-llm/ru/module-13.notebooks.json

## RL for LLM (EN)
- [Course overview](https://vladkulikov.com/courses/rl-for-llm/): Reinforcement learning, preference optimization, verifiable rewards, agents, and safety.
- [Module 1. Introduction: Reinforcement Learning for LLMs](https://vladkulikov.com/courses/rl-for-llm/module-01/): Lecture 01; source: https://vladkulikov.com/content/rl-for-llm/en/module-01.md
- [Module 1. Introduction: Reinforcement Learning for LLMs: quizzes](https://vladkulikov.com/courses/rl-for-llm/module-01/tests/): 10 authored questions; structured source: https://vladkulikov.com/quizzes/rl-for-llm/en/module-01.json
- [Module 1. Introduction: Reinforcement Learning for LLMs: exercises](https://vladkulikov.com/courses/rl-for-llm/module-01/exercises/): 20 authored items; structured source: https://vladkulikov.com/practice/rl-for-llm/en/module-01.exercises.json
- [Module 1. Introduction: Reinforcement Learning for LLMs: notebooks](https://vladkulikov.com/courses/rl-for-llm/module-01/notebooks/): 1 authored items; structured source: https://vladkulikov.com/practice/rl-for-llm/en/module-01.notebooks.json
- [Module 2. State, Value, and Bellman Equations](https://vladkulikov.com/courses/rl-for-llm/module-02/): Lecture 02; source: https://vladkulikov.com/content/rl-for-llm/en/module-02.md
- [Module 2. State, Value, and Bellman Equations: quizzes](https://vladkulikov.com/courses/rl-for-llm/module-02/tests/): 12 authored questions; structured source: https://vladkulikov.com/quizzes/rl-for-llm/en/module-02.json
- [Module 2. State, Value, and Bellman Equations: exercises](https://vladkulikov.com/courses/rl-for-llm/module-02/exercises/): 20 authored items; structured source: https://vladkulikov.com/practice/rl-for-llm/en/module-02.exercises.json
- [Module 2. State, Value, and Bellman Equations: notebooks](https://vladkulikov.com/courses/rl-for-llm/module-02/notebooks/): 1 authored items; structured source: https://vladkulikov.com/practice/rl-for-llm/en/module-02.notebooks.json
- [Module 3. Bandits, exploration, and one-step decisions](https://vladkulikov.com/courses/rl-for-llm/module-03/): Lecture 03; source: https://vladkulikov.com/content/rl-for-llm/en/module-03.md
- [Module 3. Bandits, exploration, and one-step decisions: quizzes](https://vladkulikov.com/courses/rl-for-llm/module-03/tests/): 12 authored questions; structured source: https://vladkulikov.com/quizzes/rl-for-llm/en/module-03.json
- [Module 3. Bandits, exploration, and one-step decisions: exercises](https://vladkulikov.com/courses/rl-for-llm/module-03/exercises/): 20 authored items; structured source: https://vladkulikov.com/practice/rl-for-llm/en/module-03.exercises.json
- [Module 3. Bandits, exploration, and one-step decisions: notebooks](https://vladkulikov.com/courses/rl-for-llm/module-03/notebooks/): 1 authored items; structured source: https://vladkulikov.com/practice/rl-for-llm/en/module-03.notebooks.json
- [Module 4. Policy gradients: from REINFORCE to PPO](https://vladkulikov.com/courses/rl-for-llm/module-04/): Lecture 04; source: https://vladkulikov.com/content/rl-for-llm/en/module-04.md
- [Module 4. Policy gradients: from REINFORCE to PPO: quizzes](https://vladkulikov.com/courses/rl-for-llm/module-04/tests/): 12 authored questions; structured source: https://vladkulikov.com/quizzes/rl-for-llm/en/module-04.json
- [Module 4. Policy gradients: from REINFORCE to PPO: exercises](https://vladkulikov.com/courses/rl-for-llm/module-04/exercises/): 20 authored items; structured source: https://vladkulikov.com/practice/rl-for-llm/en/module-04.exercises.json
- [Module 4. Policy gradients: from REINFORCE to PPO: notebooks](https://vladkulikov.com/courses/rl-for-llm/module-04/notebooks/): 1 authored items; structured source: https://vladkulikov.com/practice/rl-for-llm/en/module-04.notebooks.json
- [Module 5. Learning from fixed data: imitation, deep Q-methods, and offline RL](https://vladkulikov.com/courses/rl-for-llm/module-05/): Lecture 05; source: https://vladkulikov.com/content/rl-for-llm/en/module-05.md
- [Module 5. Learning from fixed data: imitation, deep Q-methods, and offline RL: quizzes](https://vladkulikov.com/courses/rl-for-llm/module-05/tests/): 12 authored questions; structured source: https://vladkulikov.com/quizzes/rl-for-llm/en/module-05.json
- [Module 5. Learning from fixed data: imitation, deep Q-methods, and offline RL: exercises](https://vladkulikov.com/courses/rl-for-llm/module-05/exercises/): 20 authored items; structured source: https://vladkulikov.com/practice/rl-for-llm/en/module-05.exercises.json
- [Module 5. Learning from fixed data: imitation, deep Q-methods, and offline RL: notebooks](https://vladkulikov.com/courses/rl-for-llm/module-05/notebooks/): 1 authored items; structured source: https://vladkulikov.com/practice/rl-for-llm/en/module-05.notebooks.json
- [Module 6. The LLM as a policy: tokens, log-probabilities, and KL](https://vladkulikov.com/courses/rl-for-llm/module-06/): Lecture 06; source: https://vladkulikov.com/content/rl-for-llm/en/module-06.md
- [Module 6. The LLM as a policy: tokens, log-probabilities, and KL: quizzes](https://vladkulikov.com/courses/rl-for-llm/module-06/tests/): 12 authored questions; structured source: https://vladkulikov.com/quizzes/rl-for-llm/en/module-06.json
- [Module 6. The LLM as a policy: tokens, log-probabilities, and KL: exercises](https://vladkulikov.com/courses/rl-for-llm/module-06/exercises/): 20 authored items; structured source: https://vladkulikov.com/practice/rl-for-llm/en/module-06.exercises.json
- [Module 6. The LLM as a policy: tokens, log-probabilities, and KL: notebooks](https://vladkulikov.com/courses/rl-for-llm/module-06/notebooks/): 1 authored items; structured source: https://vladkulikov.com/practice/rl-for-llm/en/module-06.notebooks.json
- [Module 7. Reward models and preference data](https://vladkulikov.com/courses/rl-for-llm/module-07/): Lecture 07; source: https://vladkulikov.com/content/rl-for-llm/en/module-07.md
- [Module 7. Reward models and preference data: quizzes](https://vladkulikov.com/courses/rl-for-llm/module-07/tests/): 12 authored questions; structured source: https://vladkulikov.com/quizzes/rl-for-llm/en/module-07.json
- [Module 7. Reward models and preference data: exercises](https://vladkulikov.com/courses/rl-for-llm/module-07/exercises/): 20 authored items; structured source: https://vladkulikov.com/practice/rl-for-llm/en/module-07.exercises.json
- [Module 7. Reward models and preference data: notebooks](https://vladkulikov.com/courses/rl-for-llm/module-07/notebooks/): 1 authored items; structured source: https://vladkulikov.com/practice/rl-for-llm/en/module-07.notebooks.json
- [Module 8. RLHF and direct preference optimization](https://vladkulikov.com/courses/rl-for-llm/module-08/): Lecture 08; source: https://vladkulikov.com/content/rl-for-llm/en/module-08.md
- [Module 8. RLHF and direct preference optimization: quizzes](https://vladkulikov.com/courses/rl-for-llm/module-08/tests/): 9 authored questions; structured source: https://vladkulikov.com/quizzes/rl-for-llm/en/module-08.json
- [Module 8. RLHF and direct preference optimization: exercises](https://vladkulikov.com/courses/rl-for-llm/module-08/exercises/): 23 authored items; structured source: https://vladkulikov.com/practice/rl-for-llm/en/module-08.exercises.json
- [Module 8. RLHF and direct preference optimization: notebooks](https://vladkulikov.com/courses/rl-for-llm/module-08/notebooks/): 1 authored items; structured source: https://vladkulikov.com/practice/rl-for-llm/en/module-08.notebooks.json
- [Module 9. RLVR and GRPO: verifiable rewards, group-relative estimates, and stability](https://vladkulikov.com/courses/rl-for-llm/module-09/): Lecture 09; source: https://vladkulikov.com/content/rl-for-llm/en/module-09.md
- [Module 9. RLVR and GRPO: verifiable rewards, group-relative estimates, and stability: quizzes](https://vladkulikov.com/courses/rl-for-llm/module-09/tests/): 12 authored questions; structured source: https://vladkulikov.com/quizzes/rl-for-llm/en/module-09.json
- [Module 9. RLVR and GRPO: verifiable rewards, group-relative estimates, and stability: exercises](https://vladkulikov.com/courses/rl-for-llm/module-09/exercises/): 20 authored items; structured source: https://vladkulikov.com/practice/rl-for-llm/en/module-09.exercises.json
- [Module 9. RLVR and GRPO: verifiable rewards, group-relative estimates, and stability: notebooks](https://vladkulikov.com/courses/rl-for-llm/module-09/notebooks/): 1 authored items; structured source: https://vladkulikov.com/practice/rl-for-llm/en/module-09.notebooks.json
- [Module 10. Search, verification, and test-time compute](https://vladkulikov.com/courses/rl-for-llm/module-10/): Lecture 10; source: https://vladkulikov.com/content/rl-for-llm/en/module-10.md
- [Module 10. Search, verification, and test-time compute: quizzes](https://vladkulikov.com/courses/rl-for-llm/module-10/tests/): 12 authored questions; structured source: https://vladkulikov.com/quizzes/rl-for-llm/en/module-10.json
- [Module 10. Search, verification, and test-time compute: exercises](https://vladkulikov.com/courses/rl-for-llm/module-10/exercises/): 20 authored items; structured source: https://vladkulikov.com/practice/rl-for-llm/en/module-10.exercises.json
- [Module 10. Search, verification, and test-time compute: notebooks](https://vladkulikov.com/courses/rl-for-llm/module-10/notebooks/): 1 authored items; structured source: https://vladkulikov.com/practice/rl-for-llm/en/module-10.notebooks.json
- [Module 11. RL for LLM agents: tools, environments, and long trajectories](https://vladkulikov.com/courses/rl-for-llm/module-11/): Lecture 11; source: https://vladkulikov.com/content/rl-for-llm/en/module-11.md
- [Module 11. RL for LLM agents: tools, environments, and long trajectories: quizzes](https://vladkulikov.com/courses/rl-for-llm/module-11/tests/): 12 authored questions; structured source: https://vladkulikov.com/quizzes/rl-for-llm/en/module-11.json
- [Module 11. RL for LLM agents: tools, environments, and long trajectories: exercises](https://vladkulikov.com/courses/rl-for-llm/module-11/exercises/): 20 authored items; structured source: https://vladkulikov.com/practice/rl-for-llm/en/module-11.exercises.json
- [Module 11. RL for LLM agents: tools, environments, and long trajectories: notebooks](https://vladkulikov.com/courses/rl-for-llm/module-11/notebooks/): 1 authored items; structured source: https://vladkulikov.com/practice/rl-for-llm/en/module-11.notebooks.json
- [Module 12. RL infrastructure for LLMs: memory, rollouts, and asynchrony](https://vladkulikov.com/courses/rl-for-llm/module-12/): Lecture 12; source: https://vladkulikov.com/content/rl-for-llm/en/module-12.md
- [Module 12. RL infrastructure for LLMs: memory, rollouts, and asynchrony: quizzes](https://vladkulikov.com/courses/rl-for-llm/module-12/tests/): 12 authored questions; structured source: https://vladkulikov.com/quizzes/rl-for-llm/en/module-12.json
- [Module 12. RL infrastructure for LLMs: memory, rollouts, and asynchrony: exercises](https://vladkulikov.com/courses/rl-for-llm/module-12/exercises/): 20 authored items; structured source: https://vladkulikov.com/practice/rl-for-llm/en/module-12.exercises.json
- [Module 12. RL infrastructure for LLMs: memory, rollouts, and asynchrony: notebooks](https://vladkulikov.com/courses/rl-for-llm/module-12/notebooks/): 1 authored items; structured source: https://vladkulikov.com/practice/rl-for-llm/en/module-12.notebooks.json
- [Module 13. Evaluating RL systems for LLMs: statistics, reward hacking, and safety](https://vladkulikov.com/courses/rl-for-llm/module-13/): Lecture 13; source: https://vladkulikov.com/content/rl-for-llm/en/module-13.md
- [Module 13. Evaluating RL systems for LLMs: statistics, reward hacking, and safety: quizzes](https://vladkulikov.com/courses/rl-for-llm/module-13/tests/): 12 authored questions; structured source: https://vladkulikov.com/quizzes/rl-for-llm/en/module-13.json
- [Module 13. Evaluating RL systems for LLMs: statistics, reward hacking, and safety: exercises](https://vladkulikov.com/courses/rl-for-llm/module-13/exercises/): 20 authored items; structured source: https://vladkulikov.com/practice/rl-for-llm/en/module-13.exercises.json
- [Module 13. Evaluating RL systems for LLMs: statistics, reward hacking, and safety: notebooks](https://vladkulikov.com/courses/rl-for-llm/module-13/notebooks/): 1 authored items; structured source: https://vladkulikov.com/practice/rl-for-llm/en/module-13.notebooks.json

## Теория информации для машинного обучения (RU)
- [Course overview](https://vladkulikov.com/ru/courses/information-theory-for-ml/): Теория информации: от энтропии и кодирования до NLP, LLM, компьютерного зрения и обучения с подкреплением.
- [Модуль 1. Введение](https://vladkulikov.com/ru/courses/information-theory-for-ml/module-01/): Lecture 01; source: https://vladkulikov.com/content/information-theory-for-ml/ru/module-01.md
- [Модуль 1. Введение: quizzes](https://vladkulikov.com/ru/courses/information-theory-for-ml/module-01/tests/): 14 authored questions; structured source: https://vladkulikov.com/quizzes/information-theory-for-ml/ru/module-01.json
- [Модуль 2. Энтропия](https://vladkulikov.com/ru/courses/information-theory-for-ml/module-02/): Lecture 02; source: https://vladkulikov.com/content/information-theory-for-ml/ru/module-02.md
- [Модуль 2. Энтропия: quizzes](https://vladkulikov.com/ru/courses/information-theory-for-ml/module-02/tests/): 20 authored questions; structured source: https://vladkulikov.com/quizzes/information-theory-for-ml/ru/module-02.json
- [Модуль 2. Энтропия: exercises](https://vladkulikov.com/ru/courses/information-theory-for-ml/module-02/exercises/): 5 authored items; structured source: https://vladkulikov.com/practice/information-theory-for-ml/ru/module-02.exercises.json
- [Модуль 3. Кросс-энтропия и KL-дивергенция](https://vladkulikov.com/ru/courses/information-theory-for-ml/module-03/): Lecture 03; source: https://vladkulikov.com/content/information-theory-for-ml/ru/module-03.md
- [Модуль 3. Кросс-энтропия и KL-дивергенция: quizzes](https://vladkulikov.com/ru/courses/information-theory-for-ml/module-03/tests/): 29 authored questions; structured source: https://vladkulikov.com/quizzes/information-theory-for-ml/ru/module-03.json
- [Модуль 3. Кросс-энтропия и KL-дивергенция: exercises](https://vladkulikov.com/ru/courses/information-theory-for-ml/module-03/exercises/): 5 authored items; structured source: https://vladkulikov.com/practice/information-theory-for-ml/ru/module-03.exercises.json
- [Модуль 4. Неравенство Йенсена: когда среднее встречает нелинейность](https://vladkulikov.com/ru/courses/information-theory-for-ml/module-04/): Lecture 04; source: https://vladkulikov.com/content/information-theory-for-ml/ru/module-04.md
- [Модуль 4. Неравенство Йенсена: когда среднее встречает нелинейность: quizzes](https://vladkulikov.com/ru/courses/information-theory-for-ml/module-04/tests/): 24 authored questions; structured source: https://vladkulikov.com/quizzes/information-theory-for-ml/ru/module-04.json
- [Модуль 4. Неравенство Йенсена: когда среднее встречает нелинейность: exercises](https://vladkulikov.com/ru/courses/information-theory-for-ml/module-04/exercises/): 5 authored items; structured source: https://vladkulikov.com/practice/information-theory-for-ml/ru/module-04.exercises.json
- [Модуль 5. Взаимная информация: сколько один объект говорит о другом](https://vladkulikov.com/ru/courses/information-theory-for-ml/module-05/): Lecture 05; source: https://vladkulikov.com/content/information-theory-for-ml/ru/module-05.md
- [Модуль 5. Взаимная информация: сколько один объект говорит о другом: quizzes](https://vladkulikov.com/ru/courses/information-theory-for-ml/module-05/tests/): 24 authored questions; structured source: https://vladkulikov.com/quizzes/information-theory-for-ml/ru/module-05.json
- [Модуль 5. Взаимная информация: сколько один объект говорит о другом: exercises](https://vladkulikov.com/ru/courses/information-theory-for-ml/module-05/exercises/): 5 authored items; structured source: https://vladkulikov.com/practice/information-theory-for-ml/ru/module-05.exercises.json
- [Модуль 6. Кодирование источника: от энтропии к реальным битам](https://vladkulikov.com/ru/courses/information-theory-for-ml/module-06/): Lecture 06; source: https://vladkulikov.com/content/information-theory-for-ml/ru/module-06.md
- [Модуль 6. Кодирование источника: от энтропии к реальным битам: quizzes](https://vladkulikov.com/ru/courses/information-theory-for-ml/module-06/tests/): 29 authored questions; structured source: https://vladkulikov.com/quizzes/information-theory-for-ml/ru/module-06.json
- [Модуль 6. Кодирование источника: от энтропии к реальным битам: exercises](https://vladkulikov.com/ru/courses/information-theory-for-ml/module-06/exercises/): 6 authored items; structured source: https://vladkulikov.com/practice/information-theory-for-ml/ru/module-06.exercises.json
- [Модуль 7. Канал и пропускная способность](https://vladkulikov.com/ru/courses/information-theory-for-ml/module-07/): Lecture 07; source: https://vladkulikov.com/content/information-theory-for-ml/ru/module-07.md
- [Модуль 7. Канал и пропускная способность: quizzes](https://vladkulikov.com/ru/courses/information-theory-for-ml/module-07/tests/): 29 authored questions; structured source: https://vladkulikov.com/quizzes/information-theory-for-ml/ru/module-07.json
- [Модуль 7. Канал и пропускная способность: exercises](https://vladkulikov.com/ru/courses/information-theory-for-ml/module-07/exercises/): 7 authored items; structured source: https://vladkulikov.com/practice/information-theory-for-ml/ru/module-07.exercises.json
- [Модуль 8. Максимальная энтропия, экспоненциальные модели и KL-регуляризация](https://vladkulikov.com/ru/courses/information-theory-for-ml/module-08/): Lecture 08; source: https://vladkulikov.com/content/information-theory-for-ml/ru/module-08.md
- [Модуль 8. Максимальная энтропия, экспоненциальные модели и KL-регуляризация: quizzes](https://vladkulikov.com/ru/courses/information-theory-for-ml/module-08/tests/): 29 authored questions; structured source: https://vladkulikov.com/quizzes/information-theory-for-ml/ru/module-08.json
- [Модуль 8. Максимальная энтропия, экспоненциальные модели и KL-регуляризация: exercises](https://vladkulikov.com/ru/courses/information-theory-for-ml/module-08/exercises/): 7 authored items; structured source: https://vladkulikov.com/practice/information-theory-for-ml/ru/module-08.exercises.json
- [Модуль 9. Скорость–искажение и Information Bottleneck: как управлять потерей информации](https://vladkulikov.com/ru/courses/information-theory-for-ml/module-09/): Lecture 09; source: https://vladkulikov.com/content/information-theory-for-ml/ru/module-09.md
- [Модуль 9. Скорость–искажение и Information Bottleneck: как управлять потерей информации: quizzes](https://vladkulikov.com/ru/courses/information-theory-for-ml/module-09/tests/): 29 authored questions; structured source: https://vladkulikov.com/quizzes/information-theory-for-ml/ru/module-09.json
- [Модуль 9. Скорость–искажение и Information Bottleneck: как управлять потерей информации: exercises](https://vladkulikov.com/ru/courses/information-theory-for-ml/module-09/exercises/): 7 authored items; structured source: https://vladkulikov.com/practice/information-theory-for-ml/ru/module-09.exercises.json
- [Модуль 10. Алгоритмическая теория информации: кратчайшие описания, MDL и универсальное предсказание](https://vladkulikov.com/ru/courses/information-theory-for-ml/module-10/): Lecture 10; source: https://vladkulikov.com/content/information-theory-for-ml/ru/module-10.md
- [Модуль 10. Алгоритмическая теория информации: кратчайшие описания, MDL и универсальное предсказание: quizzes](https://vladkulikov.com/ru/courses/information-theory-for-ml/module-10/tests/): 25 authored questions; structured source: https://vladkulikov.com/quizzes/information-theory-for-ml/ru/module-10.json
- [Модуль 10. Алгоритмическая теория информации: кратчайшие описания, MDL и универсальное предсказание: exercises](https://vladkulikov.com/ru/courses/information-theory-for-ml/module-10/exercises/): 7 authored items; structured source: https://vladkulikov.com/practice/information-theory-for-ml/ru/module-10.exercises.json
- [Модуль 11. Сравнение распределений: f-дивергенции, вариационные критики и расстояние Вассерштейна](https://vladkulikov.com/ru/courses/information-theory-for-ml/module-11/): Lecture 11; source: https://vladkulikov.com/content/information-theory-for-ml/ru/module-11.md
- [Модуль 11. Сравнение распределений: f-дивергенции, вариационные критики и расстояние Вассерштейна: quizzes](https://vladkulikov.com/ru/courses/information-theory-for-ml/module-11/tests/): 25 authored questions; structured source: https://vladkulikov.com/quizzes/information-theory-for-ml/ru/module-11.json
- [Модуль 11. Сравнение распределений: f-дивергенции, вариационные критики и расстояние Вассерштейна: exercises](https://vladkulikov.com/ru/courses/information-theory-for-ml/module-11/exercises/): 7 authored items; structured source: https://vladkulikov.com/practice/information-theory-for-ml/ru/module-11.exercises.json
- [Модуль 12. Информационные границы обобщения: PAC-Bayes и взаимная информация](https://vladkulikov.com/ru/courses/information-theory-for-ml/module-12/): Lecture 12; source: https://vladkulikov.com/content/information-theory-for-ml/ru/module-12.md
- [Модуль 12. Информационные границы обобщения: PAC-Bayes и взаимная информация: quizzes](https://vladkulikov.com/ru/courses/information-theory-for-ml/module-12/tests/): 25 authored questions; structured source: https://vladkulikov.com/quizzes/information-theory-for-ml/ru/module-12.json
- [Модуль 12. Информационные границы обобщения: PAC-Bayes и взаимная информация: exercises](https://vladkulikov.com/ru/courses/information-theory-for-ml/module-12/exercises/): 7 authored items; structured source: https://vladkulikov.com/practice/information-theory-for-ml/ru/module-12.exercises.json
- [Модуль 13. Рассуждение в LLM: вычисление, поиск и информация](https://vladkulikov.com/ru/courses/information-theory-for-ml/module-13/): Lecture 13; source: https://vladkulikov.com/content/information-theory-for-ml/ru/module-13.md
- [Модуль 13. Рассуждение в LLM: вычисление, поиск и информация: quizzes](https://vladkulikov.com/ru/courses/information-theory-for-ml/module-13/tests/): 25 authored questions; structured source: https://vladkulikov.com/quizzes/information-theory-for-ml/ru/module-13.json
- [Модуль 13. Рассуждение в LLM: вычисление, поиск и информация: exercises](https://vladkulikov.com/ru/courses/information-theory-for-ml/module-13/exercises/): 7 authored items; structured source: https://vladkulikov.com/practice/information-theory-for-ml/ru/module-13.exercises.json
- [Модуль 14. Компьютерное зрение через теорию информации](https://vladkulikov.com/ru/courses/information-theory-for-ml/module-14/): Lecture 14; source: https://vladkulikov.com/content/information-theory-for-ml/ru/module-14.md
- [Модуль 14. Компьютерное зрение через теорию информации: quizzes](https://vladkulikov.com/ru/courses/information-theory-for-ml/module-14/tests/): 25 authored questions; structured source: https://vladkulikov.com/quizzes/information-theory-for-ml/ru/module-14.json
- [Модуль 14. Компьютерное зрение через теорию информации: exercises](https://vladkulikov.com/ru/courses/information-theory-for-ml/module-14/exercises/): 7 authored items; structured source: https://vladkulikov.com/practice/information-theory-for-ml/ru/module-14.exercises.json
- [Модуль 15. Информационная геометрия: Fisher, естественный градиент и потоки распределений](https://vladkulikov.com/ru/courses/information-theory-for-ml/module-15/): Lecture 15; source: https://vladkulikov.com/content/information-theory-for-ml/ru/module-15.md
- [Модуль 15. Информационная геометрия: Fisher, естественный градиент и потоки распределений: quizzes](https://vladkulikov.com/ru/courses/information-theory-for-ml/module-15/tests/): 25 authored questions; structured source: https://vladkulikov.com/quizzes/information-theory-for-ml/ru/module-15.json
- [Модуль 15. Информационная геометрия: Fisher, естественный градиент и потоки распределений: exercises](https://vladkulikov.com/ru/courses/information-theory-for-ml/module-15/exercises/): 8 authored items; structured source: https://vladkulikov.com/practice/information-theory-for-ml/ru/module-15.exercises.json
- [Модуль 16. Памятка по курсу](https://vladkulikov.com/ru/courses/information-theory-for-ml/module-16/): Lecture 16; source: https://vladkulikov.com/content/information-theory-for-ml/ru/module-16.md

## Information Theory for ML (EN)
- [Course overview](https://vladkulikov.com/courses/information-theory-for-ml/): Information theory from entropy and coding to NLP, LLMs, computer vision, and reinforcement learning.
- [Module 1. Introduction](https://vladkulikov.com/courses/information-theory-for-ml/module-01/): Lecture 01; source: https://vladkulikov.com/content/information-theory-for-ml/en/module-01.md
- [Module 1. Introduction: quizzes](https://vladkulikov.com/courses/information-theory-for-ml/module-01/tests/): 14 authored questions; structured source: https://vladkulikov.com/quizzes/information-theory-for-ml/en/module-01.json
- [Module 2. Entropy](https://vladkulikov.com/courses/information-theory-for-ml/module-02/): Lecture 02; source: https://vladkulikov.com/content/information-theory-for-ml/en/module-02.md
- [Module 2. Entropy: quizzes](https://vladkulikov.com/courses/information-theory-for-ml/module-02/tests/): 20 authored questions; structured source: https://vladkulikov.com/quizzes/information-theory-for-ml/en/module-02.json
- [Module 2. Entropy: exercises](https://vladkulikov.com/courses/information-theory-for-ml/module-02/exercises/): 5 authored items; structured source: https://vladkulikov.com/practice/information-theory-for-ml/en/module-02.exercises.json
- [Module 3. Cross-Entropy and KL Divergence](https://vladkulikov.com/courses/information-theory-for-ml/module-03/): Lecture 03; source: https://vladkulikov.com/content/information-theory-for-ml/en/module-03.md
- [Module 3. Cross-Entropy and KL Divergence: quizzes](https://vladkulikov.com/courses/information-theory-for-ml/module-03/tests/): 29 authored questions; structured source: https://vladkulikov.com/quizzes/information-theory-for-ml/en/module-03.json
- [Module 3. Cross-Entropy and KL Divergence: exercises](https://vladkulikov.com/courses/information-theory-for-ml/module-03/exercises/): 5 authored items; structured source: https://vladkulikov.com/practice/information-theory-for-ml/en/module-03.exercises.json
- [Module 4. Jensen's inequality: when averaging meets nonlinearity](https://vladkulikov.com/courses/information-theory-for-ml/module-04/): Lecture 04; source: https://vladkulikov.com/content/information-theory-for-ml/en/module-04.md
- [Module 4. Jensen's inequality: when averaging meets nonlinearity: quizzes](https://vladkulikov.com/courses/information-theory-for-ml/module-04/tests/): 24 authored questions; structured source: https://vladkulikov.com/quizzes/information-theory-for-ml/en/module-04.json
- [Module 4. Jensen's inequality: when averaging meets nonlinearity: exercises](https://vladkulikov.com/courses/information-theory-for-ml/module-04/exercises/): 5 authored items; structured source: https://vladkulikov.com/practice/information-theory-for-ml/en/module-04.exercises.json
- [Module 5. Mutual information: how much one object tells us about another](https://vladkulikov.com/courses/information-theory-for-ml/module-05/): Lecture 05; source: https://vladkulikov.com/content/information-theory-for-ml/en/module-05.md
- [Module 5. Mutual information: how much one object tells us about another: quizzes](https://vladkulikov.com/courses/information-theory-for-ml/module-05/tests/): 24 authored questions; structured source: https://vladkulikov.com/quizzes/information-theory-for-ml/en/module-05.json
- [Module 5. Mutual information: how much one object tells us about another: exercises](https://vladkulikov.com/courses/information-theory-for-ml/module-05/exercises/): 5 authored items; structured source: https://vladkulikov.com/practice/information-theory-for-ml/en/module-05.exercises.json
- [Module 6. Source coding: from entropy to real bits](https://vladkulikov.com/courses/information-theory-for-ml/module-06/): Lecture 06; source: https://vladkulikov.com/content/information-theory-for-ml/en/module-06.md
- [Module 6. Source coding: from entropy to real bits: quizzes](https://vladkulikov.com/courses/information-theory-for-ml/module-06/tests/): 29 authored questions; structured source: https://vladkulikov.com/quizzes/information-theory-for-ml/en/module-06.json
- [Module 6. Source coding: from entropy to real bits: exercises](https://vladkulikov.com/courses/information-theory-for-ml/module-06/exercises/): 6 authored items; structured source: https://vladkulikov.com/practice/information-theory-for-ml/en/module-06.exercises.json
- [Module 7. Channel and capacity](https://vladkulikov.com/courses/information-theory-for-ml/module-07/): Lecture 07; source: https://vladkulikov.com/content/information-theory-for-ml/en/module-07.md
- [Module 7. Channel and capacity: quizzes](https://vladkulikov.com/courses/information-theory-for-ml/module-07/tests/): 29 authored questions; structured source: https://vladkulikov.com/quizzes/information-theory-for-ml/en/module-07.json
- [Module 7. Channel and capacity: exercises](https://vladkulikov.com/courses/information-theory-for-ml/module-07/exercises/): 7 authored items; structured source: https://vladkulikov.com/practice/information-theory-for-ml/en/module-07.exercises.json
- [Module 8. Maximum entropy, exponential models, and KL regularization](https://vladkulikov.com/courses/information-theory-for-ml/module-08/): Lecture 08; source: https://vladkulikov.com/content/information-theory-for-ml/en/module-08.md
- [Module 8. Maximum entropy, exponential models, and KL regularization: quizzes](https://vladkulikov.com/courses/information-theory-for-ml/module-08/tests/): 29 authored questions; structured source: https://vladkulikov.com/quizzes/information-theory-for-ml/en/module-08.json
- [Module 8. Maximum entropy, exponential models, and KL regularization: exercises](https://vladkulikov.com/courses/information-theory-for-ml/module-08/exercises/): 7 authored items; structured source: https://vladkulikov.com/practice/information-theory-for-ml/en/module-08.exercises.json
- [Module 9. Rate–distortion and the Information Bottleneck: managing information loss](https://vladkulikov.com/courses/information-theory-for-ml/module-09/): Lecture 09; source: https://vladkulikov.com/content/information-theory-for-ml/en/module-09.md
- [Module 9. Rate–distortion and the Information Bottleneck: managing information loss: quizzes](https://vladkulikov.com/courses/information-theory-for-ml/module-09/tests/): 29 authored questions; structured source: https://vladkulikov.com/quizzes/information-theory-for-ml/en/module-09.json
- [Module 9. Rate–distortion and the Information Bottleneck: managing information loss: exercises](https://vladkulikov.com/courses/information-theory-for-ml/module-09/exercises/): 7 authored items; structured source: https://vladkulikov.com/practice/information-theory-for-ml/en/module-09.exercises.json
- [Module 10. Algorithmic Information Theory: Shortest Descriptions, MDL, and Universal Prediction](https://vladkulikov.com/courses/information-theory-for-ml/module-10/): Lecture 10; source: https://vladkulikov.com/content/information-theory-for-ml/en/module-10.md
- [Module 10. Algorithmic Information Theory: Shortest Descriptions, MDL, and Universal Prediction: quizzes](https://vladkulikov.com/courses/information-theory-for-ml/module-10/tests/): 25 authored questions; structured source: https://vladkulikov.com/quizzes/information-theory-for-ml/en/module-10.json
- [Module 10. Algorithmic Information Theory: Shortest Descriptions, MDL, and Universal Prediction: exercises](https://vladkulikov.com/courses/information-theory-for-ml/module-10/exercises/): 7 authored items; structured source: https://vladkulikov.com/practice/information-theory-for-ml/en/module-10.exercises.json
- [Module 11. Comparing distributions: f-divergences, variational critics, and Wasserstein distance](https://vladkulikov.com/courses/information-theory-for-ml/module-11/): Lecture 11; source: https://vladkulikov.com/content/information-theory-for-ml/en/module-11.md
- [Module 11. Comparing distributions: f-divergences, variational critics, and Wasserstein distance: quizzes](https://vladkulikov.com/courses/information-theory-for-ml/module-11/tests/): 25 authored questions; structured source: https://vladkulikov.com/quizzes/information-theory-for-ml/en/module-11.json
- [Module 11. Comparing distributions: f-divergences, variational critics, and Wasserstein distance: exercises](https://vladkulikov.com/courses/information-theory-for-ml/module-11/exercises/): 7 authored items; structured source: https://vladkulikov.com/practice/information-theory-for-ml/en/module-11.exercises.json
- [Module 12. Information-theoretic generalization bounds: PAC-Bayes and mutual information](https://vladkulikov.com/courses/information-theory-for-ml/module-12/): Lecture 12; source: https://vladkulikov.com/content/information-theory-for-ml/en/module-12.md
- [Module 12. Information-theoretic generalization bounds: PAC-Bayes and mutual information: quizzes](https://vladkulikov.com/courses/information-theory-for-ml/module-12/tests/): 25 authored questions; structured source: https://vladkulikov.com/quizzes/information-theory-for-ml/en/module-12.json
- [Module 12. Information-theoretic generalization bounds: PAC-Bayes and mutual information: exercises](https://vladkulikov.com/courses/information-theory-for-ml/module-12/exercises/): 7 authored items; structured source: https://vladkulikov.com/practice/information-theory-for-ml/en/module-12.exercises.json
- [Module 13. Reasoning in LLMs: computation, search, and information](https://vladkulikov.com/courses/information-theory-for-ml/module-13/): Lecture 13; source: https://vladkulikov.com/content/information-theory-for-ml/en/module-13.md
- [Module 13. Reasoning in LLMs: computation, search, and information: quizzes](https://vladkulikov.com/courses/information-theory-for-ml/module-13/tests/): 25 authored questions; structured source: https://vladkulikov.com/quizzes/information-theory-for-ml/en/module-13.json
- [Module 13. Reasoning in LLMs: computation, search, and information: exercises](https://vladkulikov.com/courses/information-theory-for-ml/module-13/exercises/): 7 authored items; structured source: https://vladkulikov.com/practice/information-theory-for-ml/en/module-13.exercises.json
- [Module 14. Computer Vision Through Information Theory](https://vladkulikov.com/courses/information-theory-for-ml/module-14/): Lecture 14; source: https://vladkulikov.com/content/information-theory-for-ml/en/module-14.md
- [Module 14. Computer Vision Through Information Theory: quizzes](https://vladkulikov.com/courses/information-theory-for-ml/module-14/tests/): 25 authored questions; structured source: https://vladkulikov.com/quizzes/information-theory-for-ml/en/module-14.json
- [Module 14. Computer Vision Through Information Theory: exercises](https://vladkulikov.com/courses/information-theory-for-ml/module-14/exercises/): 7 authored items; structured source: https://vladkulikov.com/practice/information-theory-for-ml/en/module-14.exercises.json
- [Module 15. Information Geometry: Fisher, Natural Gradient, and Distribution Flows](https://vladkulikov.com/courses/information-theory-for-ml/module-15/): Lecture 15; source: https://vladkulikov.com/content/information-theory-for-ml/en/module-15.md
- [Module 15. Information Geometry: Fisher, Natural Gradient, and Distribution Flows: quizzes](https://vladkulikov.com/courses/information-theory-for-ml/module-15/tests/): 25 authored questions; structured source: https://vladkulikov.com/quizzes/information-theory-for-ml/en/module-15.json
- [Module 15. Information Geometry: Fisher, Natural Gradient, and Distribution Flows: exercises](https://vladkulikov.com/courses/information-theory-for-ml/module-15/exercises/): 8 authored items; structured source: https://vladkulikov.com/practice/information-theory-for-ml/en/module-15.exercises.json
- [Module 16. Course Reference Sheet](https://vladkulikov.com/courses/information-theory-for-ml/module-16/): Lecture 16; source: https://vladkulikov.com/content/information-theory-for-ml/en/module-16.md

## Attribution and editions
- [Content license](https://github.com/VladGKulikov/VladGKulikov.github.io/blob/main/LICENSE-CONTENT.md): CC BY-NC-SA 4.0; preserve attribution, noncommercial and share-alike terms.
- [License map](https://github.com/VladGKulikov/VladGKulikov.github.io/blob/main/LICENSE.md): Site code is Apache-2.0; third-party components retain their licenses.
- [Archived complete collection, edition 2026.2](https://doi.org/10.5281/zenodo.23420794): Released 2026-10-16; this DOI identifies the archive, not each live revision.
- [All archived editions](https://doi.org/10.5281/zenodo.21877456): Collection DOI.
When citing a live lecture, use its canonical page URL, language and access date. Distinguish it from the archived complete collection.