Transformer

Published on
October 25, 2024
Introduction to Transformers - Part 02 - Llama 3 - Building a LLM from scratch
transformer nlp code
Learn how to adapt the vanilla Transformer to build a state-of-the-art LLM like Meta's Llama 3, exploring key architectural changes and optimizations.
Published on
October 13, 2024
Introduction to Transformers - Part 01 - Implementation of a translation model
transformer nlp code
A full implementation of the Transformer architecture in PyTorch, built entirely from scratch, designed specifically for use in a translation model.
Published on
August 21, 2024
Introduction to Transformers - Part 00 - Architecture
transformer nlp theory
A short introduction to the architecture behind transformers how they can be utilized in NLP tasks.

Introduction to Transformers - Part 02 - Llama 3 - Building a LLM from scratch