RAG Evaluation Metrics Cheat Sheet

A concise RAG evaluation reference organized by retrieval, context, answer, citation, refusal, security, and production metrics, with practical formulas and a minimal release-gate set.

August 1, 2026 · 9 min · 1894 words · Andy SI
Read more

How to Rerank RAG Retrieval Results: From Hybrid Retrieval to Cross-Encoders, Listwise Ranking, and Evidence-Set Selection

A RAG reranking design guide for AI Application Engineers. It distinguishes retrieval fusion, semantic reranking, business ranking, and evidence-set selection, then provides a production-ready default pipeline.

July 29, 2026 · 37 min · 7834 words · Andy SI
Read more

2026 AI Application Engineer Job-Market Tech Stack: A Deep JD Study of Tokyo, Mainland China, and the US

Based on 20 public job descriptions each from mainland China, the United States, and Tokyo, this study maps the hiring stack for AI Application, Agent, and RAG engineers and gives a Tokyo-focused learning and portfolio roadmap.

July 28, 2026 · 28 min · 5931 words · Andy SI
Read more

From Single-Agent to Multi-Agent: A Guide to Robust Sub-Agent System Design

A programmer-oriented guide to Multi-Agent and Sub-Agent system design: when multiple Agents are needed, task decomposition and coordination patterns, context, permissions, reliability, evaluation, and production delivery.

July 27, 2026 · 66 min · 13852 words · Andy SI
Read more

Context Compression for Production AI Agents: From Message Trimming and Tool-Result Cleanup to Hermes Agent's Layered Compaction

This article systematically explains context-compression methods for production AI agents, distinguishing message trimming, tool-result cleanup, artifact externalization, structured summaries, and native compaction. Using Hermes Agent, LangChain v1, and LangGraph v1, it presents a layered implementation and evaluation approach.

July 26, 2026 · 17 min · 3452 words · Andy SI
Read more

RAG Retrieval Engineering: From Hybrid Retrieval to Production Governance

A systematic guide to lexical retrieval, dense retrieval, hybrid fusion, reranking, evaluation, observability, and production governance in RAG systems.

July 17, 2026 · 27 min · 5679 words · Andy SI
Read more

What Did Tencent AI Leader Shunyu Yao Discuss in This Podcast?

Drawing on Latent Space’s interview with Shunyu Yao, this article reviews ReAct, Reflexion, Tree of Thoughts, memory, benchmarks, ACI, and Agent UX, and summarizes the importance of tools, environments, evaluation, and interface design when putting AI agents into practice.

May 24, 2026 · 15 min · 2983 words · Andy SI
Read more

What AI Engineers Should Learn in 2026

Starting from the trend of platforms absorbing basic RAG pipelines, this article examines the high-premium skills AI application engineers should prioritize in 2026: evaluation and observability, data governance and access control, and deep engineering capabilities for agentic workflows.

May 3, 2026 · 18 min · 3701 words · Andy SI
Read more

How to Design an Excellent AI Agent: From Architectural Principles to Practical Patterns

This article presents a core design framework for excellent AI agent systems, covering Spec-Driven Development, a three-layer architecture, resolvers, the boundary between latent and deterministic work, diarization, and a self-improving learning loop, helping engineers move from autocomplete-tool thinking to AI-augmented software engineering.

May 2, 2026 · 20 min · 4066 words · Andy SI
Read more

A Core Skill in the Age of AI Coding Agents: Writing Effective Software Specs

Drawing on 2025–2026 practices in AI coding agents and Spec-Driven Development, this article systematically explains the definition, value, essential components, workflow, and common pitfalls of a Software Spec, and provides a practical template for tools such as Claude Code, Codex CLI, and Cursor.

April 9, 2026 · 19 min · 3891 words · Andy SI
Read more