EuroCC@Greece in collaboration with Smart Attica EDIH, announces the 9th Course of HPC Training Series with the subject “Running LLMs on HPC: Transformers, Inference & Deployment”, taking place online on January 17th, 2025.
Presentation languages: Greek and English
Audience:
- Data scientists and machine learning engineers.
- NLP researchers and practitioners.
- HPC system administrators and engineers.
- Developers exploring Hugging Face Transformers and RAG.
- Academic researchers working on language modeling projects.
- Professionals interested in training or deploying LLMs on HPC.
- Organizations planning to adopt HPC for AI workloads.
Description: This course focuses on Large Language Models running on High-Performance Computing systems. Gain a foundational understanding of the Hugging Face Transformers library, embeddings’ models, and of Retrieval-Augmented Generation. Discover how to effectively set up an inference server on HPC systems as well as a deployment process and limitations. Training of the Greek LLM Meltemi will also be presented. This seminar includes hands-on sessions where users will be able to run the provided code.
More information and the course’s Agenda can be found here.
Register to attend by filling out the form here.
