generated from coulomb/repo-seed
tegwick
0a83e908ce
T01 — task-type taxonomy. docs/routing-task-types.md names the five generation stages as the default identity-mapped task types (summarize-source, extract-entities, extract-relations, evaluate-entity, synthesize-report) and records the recommended quality floors per stage. The taxonomy explicitly does not decide which adapter ships per task type, where the ledger lives, or what a quality score means — those stay with the caller per the LLM-WP-0004 scope guardrail. T02 — RoutingAssistedGenerationAdapter bridge in src/infospace_bench/routing.py. Wraps any llm-connect RoutingPolicy or AdaptiveRoutingPolicy as an infospace-bench AssistedGenerationAdapter: maps stage_id -> task_type (overridable), resolves an LLMAdapter, delegates execute_prompt with a configurable RunConfig, and surfaces the resolved adapter id, task type, model, usage, and finish_reason back on AssistedGenerationResult.metadata. Provider tag stays back-compatible with the strings already used in run records and the budget rollup (openrouter / claude_code / openai / gemini / mock / routing). T05 — eight tests in tests/test_routing_adapter.py cover: static-policy per-stage resolution, stage_to_task_type overrides, default-mapping completeness, fall-through for unmapped stage ids, the adaptive path selecting the cheaper qualifying adapter when a quality_floor is set, adaptive policy falling back to static when no floor is set, response metadata round-trip with provider tagging, and estimated_cost_per_1k pass-through. Adds llm-connect as a path dependency on pyproject.toml and to the pytest pythonpath. Static OpenRouter and fixture paths are unchanged; this commit only adds the option of routing. 139 tests pass, 1 skipped (the OpenRouter live smoke, gated as before). T03 (shadow-mode integration) and T04 (CLI + per-stage chosen-adapter in the generation report) follow next. Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
22 lines
637 B
TOML
22 lines
637 B
TOML
[project]
|
|
name = "infospace-bench"
|
|
version = "0.1.0"
|
|
description = "Application-layer workspace for concrete structured knowledge spaces."
|
|
requires-python = ">=3.12"
|
|
dependencies = [
|
|
"PyYAML>=6",
|
|
"markitect-tool @ file:///home/worsch/markitect-tool",
|
|
"artifactstore @ file:///home/worsch/artifact-store",
|
|
"llm-connect @ file:///home/worsch/llm-connect",
|
|
]
|
|
|
|
[project.scripts]
|
|
infospace-bench = "infospace_bench.cli:main"
|
|
|
|
[tool.setuptools.package-data]
|
|
infospace_bench = ["profiles/**/*", "model_rates.yaml"]
|
|
|
|
[tool.pytest.ini_options]
|
|
pythonpath = ["src", "../markitect-tool/src", "../llm-connect"]
|
|
testpaths = ["tests"]
|