Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.8 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

economic_development_sequencing

null

2026-02-23T05:10:14.724986

2.8

name	value	max_value	rationale
definition_precision	3.0	5.0	The definition captures a coherent concept about developmental progression but remains somewhat vague about what constitutes the "natural order" and specific prerequisites. The agricultural-to-commercial sequence is clear, but the broader framework lacks precision about mechanisms and stages.

name	value	max_value	rationale
source_grounding	2.0	5.0	While Smith does discuss different economic systems and their historical development, the specific framing of "economic development sequencing" as a distinct theoretical concept appears to be an interpretive overlay rather than something Smith explicitly articulates. The source reference to "Book IV, Chapter 0" is also problematic as chapters typically don't start at 0.

name	value	max_value	rationale
domain_placement	4.0	5.0	"General Theory" is an appropriate domain placement since this concept spans multiple aspects of Smith's economic thinking rather than belonging to a specific area like trade policy or labor theory. The developmental sequencing idea does represent a broad theoretical framework.

name	value	max_value	rationale
vsm_relevance	2.0	5.0	This entity is too abstract and macro-historical to map meaningfully to specific VSM systems, which are designed for organizational viability rather than national economic development sequences. It operates at a different analytical level than the VSM framework.

name	value	max_value	rationale
explanatory_value	3.0	5.0	The concept has moderate explanatory value in organizing Smith's views on economic development stages, but it risks oversimplifying his more nuanced analysis of how different economic arrangements emerge under various conditions. It provides a useful organizing framework but may obscure important contingencies Smith identified.

Evaluation: Economic Development Sequencing

definition_precision — 3.0 / 5.0

The definition captures a coherent concept about developmental progression but remains somewhat vague about what constitutes the "natural order" and specific prerequisites. The agricultural-to-commercial sequence is clear, but the broader framework lacks precision about mechanisms and stages.

source_grounding — 2.0 / 5.0

While Smith does discuss different economic systems and their historical development, the specific framing of "economic development sequencing" as a distinct theoretical concept appears to be an interpretive overlay rather than something Smith explicitly articulates. The source reference to "Book IV, Chapter 0" is also problematic as chapters typically don't start at 0.

domain_placement — 4.0 / 5.0

"General Theory" is an appropriate domain placement since this concept spans multiple aspects of Smith's economic thinking rather than belonging to a specific area like trade policy or labor theory. The developmental sequencing idea does represent a broad theoretical framework.

vsm_relevance — 2.0 / 5.0

This entity is too abstract and macro-historical to map meaningfully to specific VSM systems, which are designed for organizational viability rather than national economic development sequences. It operates at a different analytical level than the VSM framework.

explanatory_value — 3.0 / 5.0

The concept has moderate explanatory value in organizing Smith's views on economic development stages, but it risks oversimplifying his more nuanced analysis of how different economic arrangements emerge under various conditions. It provides a useful organizing framework but may obscure important contingencies Smith identified.

3.8 KiB Raw Blame History