https://sinimite.work/tags/transformer/Recent content in Transformer on SiBloghttps://sinimite.work/images/og-default.svg?v=20260525-210321https://sinimite.work/images/og-default.svg?v=20260525-210321Hugo -- 0.156.0zh-cnSun, 26 Jul 2026 00:00:00 +0000https://sinimite.work/posts/gradient-descent-for-llm-training/Sun, 26 Jul 2026 00:00:00 +0000https://sinimite.work/posts/gradient-descent-for-llm-training/面向没有机器学习背景的普通程序员，用直观例子解释大语言模型训练中的梯度下降、损失函数、反向传播、学习率与优化器。https://sinimite.work/posts/llm-from-hidden-state-to-token-output/Sat, 02 May 2026 00:00:00 +0000https://sinimite.work/posts/llm-from-hidden-state-to-token-output/为什么 Chain of Thought 有效，为什么 prompt 不是越长越好，为什么模型会幻觉？这些看似无关的工程现象，背后其实是同一个核心机制在不同侧面的体现。本文用一把“万能钥匙”打开 LLM 工程的五扇门。https://sinimite.work/posts/llm-training-for-ai-engineers/Sat, 04 Apr 2026 12:00:00 +0900https://sinimite.work/posts/llm-training-for-ai-engineers/一篇面向 AI 应用工程师的大模型训练全景指南，覆盖预训练、后训练、蒸馏、Reward 设计、Agent 训练与 Harness Engineering，帮助你理解模型能力从何而来，以及这些训练决策如何影响真实应用落地。https://sinimite.work/posts/llm-api-kv-cache/Thu, 05 Mar 2026 11:09:00 +0900https://sinimite.work/posts/llm-api-kv-cache/KV Cache 是连接「Transformer 理论」和「LLM 工程部署」的一个关键概念。理解它，你就打通了从「模型怎么算」到「模型怎么跑」的最后一环。https://sinimite.work/posts/understanding-transformer-intuition/Tue, 24 Feb 2026 12:00:00 +0900https://sinimite.work/posts/understanding-transformer-intuition/我的第一篇正式博客文章。