History

Tianyi Cui cc2e14f76e fix: close recovery review gaps		2026-07-20 22:11:26 +08:00
..
llm	fix: close recovery review gaps	2026-07-20 22:11:26 +08:00
llm-deepseek	fix: preserve transport cause diagnostics	2026-07-20 21:03:31 +08:00
llm-pi-ai	fix: close recovery review gaps	2026-07-20 22:11:26 +08:00
llm-retry	fix: clarify provider retry delay contract	2026-07-20 18:38:22 +08:00
token-meter	docs: structure model experience fields	2026-07-19 18:08:42 +08:00
README.md	feat: implement bounded LLM request recovery	2026-07-20 03:34:19 +08:00

README.md

llm/ — LLM capability family

The LLM seam and its provider adapters. The interface package (llm) owns the abstract service, the content-block vocabulary, and the stream-chunk assembler; the adapters are concrete implementations that register on ctx.llm. All product packages.

Package	Role	ctx key
`llm/`	Abstract LLM service + content-block vocabulary + chunk assembler	`ctx.llm`
`token-meter/`	Replay-aware request and surface token measurement	`ctx.tokenMeter`
`llm-retry/`	Bounded transient request retry policy	(listens to `agent/request-error`)
`llm-deepseek/`	DeepSeek API adapter (hand-rolled fetch/SSE)	(registers on `ctx.llm`)
`llm-pi-ai/`	Multi-provider adapter via `@earendil-works/pi-ai`	(registers on `ctx.llm`)

The interface lives at llm/llm/; adapters, retry policy, and reusable token meter are flat siblings under the group. Requests route by provider, while model is passed through to the selected adapter. A new provider adapter joins here and registers one or more provider routes on ctx.llm without touching the interface. See twin LLM adapters for the contract-validation origin of the two shipping implementations and the replay token meter Agent Note for measurement ownership.