deepseek-harness/packages/llm
2026-07-20 20:29:29 +08:00
..
llm Merge latest invariant registration gate 2026-07-20 20:29:29 +08:00
llm-deepseek Merge latest invariant registration gate 2026-07-20 20:29:29 +08:00
llm-pi-ai fix(invariants): assert runtime relationships, not API shapes 2026-07-20 19:34:19 +08:00
token-meter fix(invariants): assert runtime relationships, not API shapes 2026-07-20 19:34:19 +08:00
README.md Rename RFCs to Agent Notes 2026-07-19 22:52:03 +08:00

llm/ — LLM capability family

The LLM seam and its provider adapters. The interface package (llm) owns the abstract service, the content-block vocabulary, and the stream-chunk assembler; the adapters are concrete implementations that register on ctx.llm. All product packages.

Package Role ctx key
llm/ Abstract LLM service + content-block vocabulary + chunk assembler ctx.llm
token-meter/ Replay-aware request and surface token measurement ctx.tokenMeter
llm-deepseek/ DeepSeek API adapter (hand-rolled fetch/SSE) (registers on ctx.llm)
llm-pi-ai/ Multi-provider adapter via @earendil-works/pi-ai (registers on ctx.llm)

The interface lives at llm/llm/; adapters and the reusable token meter are flat siblings under the group. Requests route by provider, while model is passed through to the selected adapter. A new provider adapter joins here and registers one or more provider routes on ctx.llm without touching the interface. See twin LLM adapters for the contract-validation origin of the two shipping implementations and the replay token meter Agent Note for measurement ownership.