Sumários

Project Assignment

10 novembro 2026, 11:00 • Fernando Batista


Project Assignment overview

Multimodality and Recent Developments

10 novembro 2026, 09:30 • Fernando Batista


Transformers for different modalities

Recent developments: Multimodality, Long context, Reasoning-first models, Agentic workflows, and Efficiency

Pre-trained models Applied - Practical Examples

3 novembro 2026, 11:00 • Fernando Batista


Encoder-based models Applied: Adaptation of Pre-trained Encoder-based models to specific tasks
Training a GPT model from scratch: minGPT

Transformers applied

3 novembro 2026, 09:30 • Fernando Batista


Pre-trained Models, Training objectives, downstream adaptations

Transformers: Architecture, Key designs and innovations

27 outubro 2026, 11:00 • Fernando Batista


Attention Mechanism, and Key designs (cont.)
Modifications and Improvements to the original transformer