LoRA fine-tuning

Most engineers including myself may have met large language models through an API such as OpenAI’s GPT-4, Anthropic’s Claude, or Google’s Gemini. These are systems that process input tokens and return output tokens without exposing their internal mechanisms. In open-source LLMs, developers interact directly with tensors instead of relying on endpoint APIs. This post walks … Read more →