National Level FDP onADVANCED TRANSFORMERS
Type: FDP
Advanced
Transformers
Dates
25th – 29th August 2026
Timing
7:00 PM – 8:00 PM IST
Mode
Online Live Sessions
Prerequisites
Participants should have basic knowledge of Python, Machine Learning and Deep Learning.
FDP Syllabus
A five-day journey from Transformer fundamentals to Generative AI and intelligent applications.
- NLP fundamentals, text preprocessing & embeddings
- Sequence modelling and limitations of RNNs/LSTMs
- Attention Mechanism and Self-Attention
- Multi-Head Attention & Positional Encoding
- Transformer Encoder, Decoder & Architecture
- BERT, GPT and T5 architectures
- Pre-trained Transformer models & transfer learning
- Hugging Face Transformers ecosystem
- Tokenization, embeddings & model inference
- Practical implementation of Transformer-based NLP applications
- Graph fundamentals, nodes, edges & graph representations
- Graph Convolutional Networks (GCN)
- Graph Attention Networks (GAT) & GraphSAGE
- Graph-based representation learning & classification
- Graph Transformers and real-world applications
- Vision Transformer (ViT) architecture and Patch Embeddings
- DeiT and Swin Transformer architectures
- CNN vs Vision Transformer – comparative study
- Fine-tuning Vision Transformers for image classification
- Vision Transformer applications and practical implementation
- Large Language Models and Generative AI applications
- Multimodal Transformers – Vision + Language models
- Prompt Engineering, RAG and Vector Databases
- Introduction to AI Agents, tool calling and intelligent workflows
- Mini Project: Building a practical GenAI / Agentic AI application
Key Learning Outcomes
🧠 Master Transformers
Understand Transformer architecture, attention mechanisms and modern Transformer models.
🤖 Work with LLMs
Explore BERT, GPT, T5, Hugging Face and practical LLM applications.
🕸️ Explore GNNs
Learn GCN, GAT, GraphSAGE and Graph Transformer approaches.
👁️ Build Vision AI
Apply Vision Transformers to real-world computer vision problems.
🌐 Multimodal AI
Understand Vision-Language models and multimodal AI systems.
🚀 Research Applications
Identify opportunities to apply Transformers in academic and research projects.
Tools & Technologies
🏆 E-Certificate
An e-certificate will be provided to participants who actively participate in the FDP.
👩🏫 Who Can Attend?
The FDP is suitable for:
- Faculty Members
- Research Scholars
- Postgraduate Students
- AI / ML / Data Science Professionals
- Participants interested in advanced AI research