Sumários

Transformers and Large Language Models

30 Abril 2026, 18:00 Ana Catarina dos Santos Martins


1. Position embeddings

2. Layer normalization
3. Attention approximation
4. Transformer-based models

NLP Review

29 Abril 2026, 18:00 Ana Catarina dos Santos Martins


Objectives and Planification;

NLP Overview: 
- tokenization;
- word representation;
- RNNs;
- Self-attention mechanism;
- transformer architecture;
- end-to-end example.