Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.6 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

land_mines_and_fisheries

null

2026-02-23T05:40:05.617889

4.4

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly identifies three specific natural resource categories and their functional role in replenishing circulating capital. While it could be more precise about the mechanisms of replenishment, it avoids circularity and captures a distinct economic concept.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's text from Book II, Chapter 1, where he explicitly discusses land, mines, and fisheries as fundamental sources that replenish the circulating capital of society. The concept accurately reflects Smith's analysis of how natural resources support economic circulation.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Production" domain assignment is entirely appropriate, as these natural resources represent the primary inputs to all productive economic activity. This placement correctly categorizes the foundational role of natural resources in Smith's production framework.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This entity maps well to S1 (primary operations) as it represents the fundamental resource inputs that enable all operational activities in the economic system. It also has some relevance to S4 (environmental adaptation) as it represents the interface between the economic system and its natural environment.

name	value	max_value	rationale
explanatory_value	4.0	5.0	The entity provides genuine explanatory power by identifying the structural foundation of economic activity and the mechanism by which natural resources sustain capital circulation. It illuminates the dependency relationship between the economy and its natural resource base rather than merely naming surface phenomena.

Evaluation: Land Mines And Fisheries

definition_precision — 4.0 / 5.0

The definition clearly identifies three specific natural resource categories and their functional role in replenishing circulating capital. While it could be more precise about the mechanisms of replenishment, it avoids circularity and captures a distinct economic concept.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's text from Book II, Chapter 1, where he explicitly discusses land, mines, and fisheries as fundamental sources that replenish the circulating capital of society. The concept accurately reflects Smith's analysis of how natural resources support economic circulation.

domain_placement — 5.0 / 5.0

The "Production" domain assignment is entirely appropriate, as these natural resources represent the primary inputs to all productive economic activity. This placement correctly categorizes the foundational role of natural resources in Smith's production framework.

vsm_relevance — 4.0 / 5.0

This entity maps well to S1 (primary operations) as it represents the fundamental resource inputs that enable all operational activities in the economic system. It also has some relevance to S4 (environmental adaptation) as it represents the interface between the economic system and its natural environment.

explanatory_value — 4.0 / 5.0

The entity provides genuine explanatory power by identifying the structural foundation of economic activity and the mechanism by which natural resources sustain capital circulation. It illuminates the dependency relationship between the economy and its natural resource base rather than merely naming surface phenomena.

3.6 KiB Raw Blame History