tegwick 144a88c0c2 feat(prompts): add batch LLM evaluation orchestrator (S1.6) ...

BatchEvaluator runs evaluation prompts across item batches with
incremental evaluation (skip unchanged via content digest), per-item
error isolation, progress callbacks, and aggregate token usage tracking.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

2026-02-19 01:40:13 +01:00

..

__init__.py

feat(prompts): implement Phase 1 - Foundation (FR-1)

2026-02-08 22:30:26 +01:00

test_artifact_models.py

feat(prompts): implement Phase 1 - Foundation (FR-1)

2026-02-08 22:30:26 +01:00

test_artifact_repository.py

fix(prompts): fix three infrastructure bugs in prompt dependency resolution

2026-02-11 20:53:02 +01:00

test_batch_evaluator.py

feat(prompts): add batch LLM evaluation orchestrator (S1.6)

2026-02-19 01:40:13 +01:00

test_change_detector.py

feat(prompts): implement Phase 6 - Incremental Execution (FR-7, FR-8)

2026-02-09 13:18:27 +01:00

test_context_compiler.py

fix(prompts): fix three infrastructure bugs in prompt dependency resolution

2026-02-11 20:53:02 +01:00

test_dependency_models.py

feat(prompts): implement Phase 5 - Dependency Tracking (FR-6)

2026-02-09 13:18:18 +01:00

test_dependency_queries.py

feat(prompts): implement Phase 5 - Dependency Tracking (FR-6)

2026-02-09 13:18:18 +01:00

test_dependency_repository.py

feat(prompts): implement Phase 5 - Dependency Tracking (FR-6)

2026-02-09 13:18:18 +01:00

test_execution_engine.py

feat(prompts): implement Phase 4 - Execution Engine (FR-4, FR-5)

2026-02-08 23:15:33 +01:00

test_execution_models.py

feat(prompts): implement Phase 4 - Execution Engine (FR-4, FR-5)

2026-02-08 23:15:33 +01:00

test_graph_builder.py

feat(prompts): implement Phase 5 - Dependency Tracking (FR-6)

2026-02-09 13:18:18 +01:00

test_halting_policy.py

feat(prompts): implement Phase 7 - Quality & Validation (FR-9, FR-10)

2026-02-09 13:31:37 +01:00

test_impact_analyzer.py

feat(prompts): implement Phase 6 - Incremental Execution (FR-7, FR-8)

2026-02-09 13:18:27 +01:00

test_incremental_engine.py

feat(prompts): implement Phase 6 - Incremental Execution (FR-7, FR-8)

2026-02-09 13:18:27 +01:00

test_macro_parser.py

fix(prompts): fix three infrastructure bugs in prompt dependency resolution

2026-02-11 20:53:02 +01:00

test_prompt_resolver.py

feat(prompts): implement Phase 3 - Resolver Engine (FR-3)

2026-02-08 22:45:46 +01:00

test_quality_gates.py

feat(prompts): implement Phase 7 - Quality & Validation (FR-9, FR-10)

2026-02-09 13:31:37 +01:00

test_quality_validator.py

feat(prompts): implement Phase 7 - Quality & Validation (FR-9, FR-10)

2026-02-09 13:31:37 +01:00

test_query_operations.py

feat(prompts): implement Phase 8 - Observability & Traceability (FR-11)

2026-02-09 20:32:18 +01:00

test_refinement_loop.py

feat(prompts): implement Phase 7 - Quality & Validation (FR-9, FR-10)

2026-02-09 13:31:37 +01:00

test_resolution_strategy.py

feat(prompts): implement Phase 3 - Resolver Engine (FR-3)

2026-02-08 22:45:46 +01:00

test_template_models.py

fix(prompts): fix three infrastructure bugs in prompt dependency resolution

2026-02-11 20:53:02 +01:00

test_traceability_service.py

feat(prompts): implement Phase 8 - Observability & Traceability (FR-11)

2026-02-09 20:32:18 +01:00

test_visualization.py

feat(prompts): implement Phase 8 - Observability & Traceability (FR-11)

2026-02-09 20:32:18 +01:00