Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.5 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

economic_system_experience_accumulation

null

2026-02-23T05:15:46.638042

3.2

name	value	max_value	rationale
definition_precision	3.0	5.0	The definition captures a coherent concept about learning from economic experience, but it's somewhat broad and could apply to many forms of institutional learning. The phrase "gradual building of practical knowledge" is clear but not particularly precise about mechanisms or boundaries.

name	value	max_value	rationale
source_grounding	2.0	5.0	While Smith does discuss different economic systems and their development, the specific concept of "experience accumulation" as a systematic process is more inferred than explicitly stated in the text. The entity appears to extrapolate beyond what Smith directly addresses about learning from economic arrangements.

name	value	max_value	rationale
domain_placement	4.0	5.0	"General Theory" is appropriate since this concept would span across Smith's discussions of different economic systems and their evolution. It's not specific to trade, production, or any particular economic domain but rather addresses meta-level learning about systems.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This entity maps well to S4 (intelligence/environmental adaptation) as it describes how economic systems learn from experience and adapt over time. It could also relate to S3 (internal regulation) in terms of how societies audit and learn from their economic practices.

name	value	max_value	rationale
explanatory_value	3.0	5.0	The concept has moderate explanatory value in understanding how economic systems evolve and improve, but it remains somewhat abstract. It identifies an important process but doesn't deeply illuminate specific mechanisms of how this learning occurs or gets institutionalized.

Evaluation: Economic System Experience Accumulation

definition_precision — 3.0 / 5.0

The definition captures a coherent concept about learning from economic experience, but it's somewhat broad and could apply to many forms of institutional learning. The phrase "gradual building of practical knowledge" is clear but not particularly precise about mechanisms or boundaries.

source_grounding — 2.0 / 5.0

While Smith does discuss different economic systems and their development, the specific concept of "experience accumulation" as a systematic process is more inferred than explicitly stated in the text. The entity appears to extrapolate beyond what Smith directly addresses about learning from economic arrangements.

domain_placement — 4.0 / 5.0

"General Theory" is appropriate since this concept would span across Smith's discussions of different economic systems and their evolution. It's not specific to trade, production, or any particular economic domain but rather addresses meta-level learning about systems.

vsm_relevance — 4.0 / 5.0

This entity maps well to S4 (intelligence/environmental adaptation) as it describes how economic systems learn from experience and adapt over time. It could also relate to S3 (internal regulation) in terms of how societies audit and learn from their economic practices.

explanatory_value — 3.0 / 5.0

The concept has moderate explanatory value in understanding how economic systems evolve and improve, but it remains somewhat abstract. It identifies an important process but doesn't deeply illuminate specific mechanisms of how this learning occurs or gets institutionalized.

3.5 KiB Raw Blame History