- Published on
This post provides a brief overview of the ideas behind LoRA and its quantized counterpart QLoRA, which enable efficient fine-tuning of LLMs
Posts
This is some of the stuff I recently learned and write about!
- Published on
Learn how to adapt the vanilla Transformer to build a state-of-the-art LLM like Meta's Llama 3, exploring key architectural changes and optimizations.- Published on
A full implementation of the Transformer architecture in PyTorch, built entirely from scratch, designed specifically for use in a translation model.- Published on
A short introduction to the architecture behind transformers how they can be utilized in NLP tasks.
All Posts →
Resume
Education
10.2024 - presentM.Sc. in Computer Science, University of Bonn
- Expected graduation: Autumn 2026
2020-2024
B.Sc. in Computer Science, University of Bonn
"Second Order Methods for Neural Network Optimization" (Grade: 1.3 [1.0-5.0])
2018Abitur (German high school diploma)
- Grade: 1.6 (German grading system, equivalent to approx. 3.4 GPA)
Experience doing stuff
Working Student, BWI GmbHFocused on the development of a secure messenger based on the Matrix protocol
Co-Founder and Developer, CraftOne / FH Applications UG
Developed an innovative website editor with manual and LLM-guided design capabilities
Internship, CebiCon GmbH
- Compiler extension development for a custom scripting language
- Development of driver monitoring tools in C++/CLI
Skills & Experiences
Frontend
React
A JavaScript library for building interactive user interfaces.
NextJs
A React framework for server-side rendering and generating static websites.
Typescript
A statically typed superset of JavaScript.
TailwindCSS
A CSS framework for rapidly designing custom user interfaces.
Shadcn-ui
A collection of customizable React components.
Backend
Supabase
Open-source Firebase alternative offering backend services.
Kubernetes
Container orchestration platform for managing deployments.
Docker
Tool for containerizing applications for consistent environments.
GraphQL
API query language allowing precise data fetching.
EC2
AWS service providing scalable virtual servers.
CI/CD
Git
Version control system for tracking code changes.
GitLab
Git repository manager with built-in CI/CD and DevOps tools.
GitHub
Platform for hosting and collaborating on Git repositories.
DB
MongoDB
NoSQL database for flexible and scalable data storage.
PostgreSQL
Open-source relational database with robust features.
Redis
In-memory data store used for caching and real-time applications.
Languages
TypeScript
Python
Java
Go
C/C++
Cloud
AWS
Amazon Web Services
GCP
Google Cloud Platform
Cloudflare
Cloudflare
Projects
NextJs
React
Typescript
Tailwind
MongoDB
CraftOne
CraftOne was a lightweight and user-friendly website builder optimized for high performance. It featured AI-guided design assistance powered by a LLM.
GitHub
NextJs
React
Typescript
Tailwind
PostgreSQL
ShipFaster(In Progress...)
(In Progress...)
Shipfast is a beautifully designed, feature-packed template built to streamline the process of launching SaaS applications quickly and efficiently.
GitHub
Python
PyTorch
TinyLlama 3
A from-scratch, 50M-parameter implementation of Meta’s LLaMA 3 model. It supports RoPE (rotary positional encodings), grouped query attention (GQA), and a KV cache. Trained on the TinyStories dataset, the model is capable of generating short, coherent stories.
GitHub