My Weird Prompts
Most people associate LoRA with image generation — style adapters and character packs for Stable Diffusion. But LoRA actually originated in the language-model world, and it’s one of the most practical techniques in the entire LLM ecosystem. In this episode, we break down the 2021 Microsoft paper that introduced Low-Rank Adaptation, explain how freezing base weights and injecting tiny trainable matrices can reshape a model’s voice, format, and domain vocabulary with under 1% of the parameters. We cover the mechanics (rank, alpha, target modules), the two inference modes (merge vs. hot-swap), and four concrete use cases where a text LoRA outperforms prompt engineering — plus the trade-offs when a simple prompt is the better choice.
200 episodes
Comments
0Be the first to comment
Sign up now and become a member of the My Weird Prompts community!