Math

In this post, I aim to provide an introduction to the architectural innovations—particularly the Mixture of Experts (MoE)—pioneered by DeepSeek in their V3-Base model, which laid the foundation for their state-of-the-art reasoning model, R1.

This post provides a brief overview of the ideas behind LoRA and its quantized counterpart QLoRA, which enable efficient fine-tuning of LLMs

A short introduction to gaussian processes and how one can employ them for regression tasks.