My Weird Prompts
Most people associate LoRA with image generation — style adapters and character packs for Stable Diffusion. But LoRA actually originated in the language-model world, and it’s one of the most practical techniques in the entire LLM ecosystem. In this episode, we break down the 2021 Microsoft paper that introduced Low-Rank Adaptation, explain how freezing base weights and injecting tiny trainable matrices can reshape a model’s voice, format, and domain vocabulary with under 1% of the parameters. We cover the mechanics (rank, alpha, target modules), the two inference modes (merge vs. hot-swap), and four concrete use cases where a text LoRA outperforms prompt engineering — plus the trade-offs when a simple prompt is the better choice.
200 episoder
Kommentarer
0Vær den første til at kommentere
Tilmeld dig nu og bliv en del af My Weird Prompts-fællesskabet!