My Weird Prompts
Most people associate LoRA with image generation — style adapters and character packs for Stable Diffusion. But LoRA actually originated in the language-model world, and it’s one of the most practical techniques in the entire LLM ecosystem. In this episode, we break down the 2021 Microsoft paper that introduced Low-Rank Adaptation, explain how freezing base weights and injecting tiny trainable matrices can reshape a model’s voice, format, and domain vocabulary with under 1% of the parameters. We cover the mechanics (rank, alpha, target modules), the two inference modes (merge vs. hot-swap), and four concrete use cases where a text LoRA outperforms prompt engineering — plus the trade-offs when a simple prompt is the better choice.
200 episodios
Comentarios
0Sé la primera persona en comentar
¡Regístrate ahora y únete a la comunidad de My Weird Prompts!