tegwick
7f1eecbdb2
- Fix evaluate dimensions to match template file: definition_precision, source_grounding, domain_placement, vsm_relevance, explanatory_value (was domain_relevance, discipline_alignment, conceptual_clarity) - Add VSM background context to evaluation prompt so LLM can score vsm_relevance without macro injection - Fix model_name bug: was sending literal "default" to API (HTTP 400) - Refactor run_entity_evaluation to write files incrementally via callback rather than all at once after the batch — long runs are now resumable if interrupted - Add incremental skip in CLI: entities with existing eval files are skipped automatically on re-run (acts as resume) - Add eval-summary command: reads all eval files, shows per-dimension means, optionally writes per_entity_mean to metrics.yaml - Fix record_check_results to merge rather than overwrite metrics.yaml so per_entity_mean survives subsequent check runs - Add per_entity_mean viability threshold (min: 3.5) to infospace.yaml Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
72 lines
2.3 KiB
YAML
72 lines
2.3 KiB
YAML
# Infospace: The Wealth of Nations through the Viable System Model
|
|
#
|
|
# This configuration declares the infospace built by processing
|
|
# Adam Smith's "The Wealth of Nations" (1776) through the lens of
|
|
# Stafford Beer's Viable System Model (VSM).
|
|
|
|
topic:
|
|
name: "The Wealth of Nations"
|
|
domain: "Classical Economics"
|
|
sources: artifacts/sources/
|
|
|
|
disciplines:
|
|
- name: "Viable System Model"
|
|
path: artifacts/vsm-reference/
|
|
|
|
schemas:
|
|
entity: schemas/economic-entity-schema-v1.0.md
|
|
mapping: schemas/vsm-mapping-schema-v1.0.md
|
|
analysis: schemas/chapter-analysis-schema-v1.0.md
|
|
|
|
competency_questions: |
|
|
1. How does Smith's division of labour map to VSM System 1 operations?
|
|
2. What mechanisms in WoN correspond to VSM coordination (System 2)?
|
|
3. Where does Smith describe self-organising regulation (System 3)?
|
|
4. What role does the "invisible hand" play as a System 4 mechanism?
|
|
5. How do Smith's views on government map to System 5 policy?
|
|
6. Is the WoN entity set viable as an explanatory framework?
|
|
|
|
viability:
|
|
redundancy_ratio:
|
|
max: 0.10
|
|
coverage_ratio:
|
|
min: 0.40 # multi-book corpus: domain sparsity is expected
|
|
coherence_components:
|
|
max: 3
|
|
consistency_cycles:
|
|
max: 0
|
|
granularity_entropy:
|
|
min: 1.0
|
|
per_entity_mean:
|
|
min: 3.5 # LLM quality score across 5 dimensions (1-5 scale)
|
|
|
|
pipeline:
|
|
stages:
|
|
- name: extract-entities
|
|
template: templates/extract-entities.md
|
|
output_dir: output/entities
|
|
output_macro: entities
|
|
split_entities: true
|
|
max_tokens: 8000
|
|
macros:
|
|
extraction_rules: artifacts/guidelines/extraction-rules.md
|
|
vsm_framework: artifacts/vsm-reference/vsm-framework.md
|
|
- name: map-to-vsm
|
|
template: templates/map-to-vsm.md
|
|
output_dir: output/mappings
|
|
output_macro: mappings
|
|
max_tokens: 10000
|
|
macros:
|
|
mapping_rules: artifacts/guidelines/mapping-rules.md
|
|
vsm_framework: artifacts/vsm-reference/vsm-framework.md
|
|
- name: synthesize-analysis
|
|
template: templates/synthesize-analysis.md
|
|
output_dir: output/analyses
|
|
output_macro: analysis
|
|
max_tokens: 4000
|
|
macros:
|
|
vsm_framework: artifacts/vsm-reference/vsm-framework.md
|
|
post_batch:
|
|
- name: assess-metrics
|
|
template: templates/assess-metrics.md
|