Published onJanuary 28, 2025Efficient LLM Finetuning (PEFT) - LoRA and QLoRA explainedmaththeoryThis post provides a brief overview of the ideas behind LoRA and its quantized counterpart QLoRA, which enable efficient fine-tuning of LLMs
Published onAugust 21, 2024Introduction to Transformers - Part 00 - ArchitecturetransformernlptheoryA short introduction to the architecture behind transformers how they can be utilized in NLP tasks.
Published onMarch 8, 2024Introduction to Gaussian Process RegressionmathstatisticstheoryA short introduction to gaussian processes and how one can employ them for regression tasks.