Fine-Tuning Mistral-7B for Sarcasm with LoRA and 4-Bit Quantization
August 5, 2025
A seasoned fine-tuner’s take: teaching Mistral-7B sarcasm with LoRA, 4-bit quantization, and ~700 examples—because adding wit to chatbots is fun and useful.
Tag: machine learning
Blog Posts
Beyond the Prompt: Crafting Sophisticated AI Responses Through Contextual Integration
June 14, 2025
A deep dive into Retrieval-Augmented Generation (RAG) and how it's revolutionizing AI responses by combining context-aware retrieval with sophisticated text generation.
How Gmail Actually Knows What You Want to Type (Spoiler: It's Not Mind Reading)
June 8, 2025
A deep dive into the data preparation pipeline behind Gmail's Smart Compose feature
Tiny but Mighty: How Small Language Models Are Beating the Giants
January 15, 2025
Models with just 135M to 7B parameters started outperforming their heavyweight counterparts on real-world tasks. Learn why smaller is smarter and how SLMs deliver 10x cost reduction with 5x faster inference.