Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.5 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

mine_fertility

null

2026-02-23T05:53:02.260524

4.2

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly distinguishes mine fertility as productivity per unit of labor/capital, avoiding circularity and providing measurable criteria. It could be slightly more precise about what constitutes "valuable material" but otherwise captures a distinct economic concept.

name	value	max_value	rationale
source_grounding	5.0	5.0	This concept is directly grounded in Smith's analysis in Book I, Chapter 11, where he explicitly discusses how the fertility of mines affects rent and pricing. The entity accurately reflects Smith's comparative analysis between mineral extraction and agricultural production.

name	value	max_value	rationale
domain_placement	5.0	5.0	"Production" is the correct domain placement as mine fertility directly relates to the productive capacity and efficiency of extractive operations. This fits naturally within Smith's broader analysis of productive factors and their economic effects.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	Mine fertility maps most naturally to S1 (primary operations) as it describes the productive capacity of basic economic units, but it also has some relevance to S4 (intelligence) regarding resource assessment. However, it's somewhat abstract as a natural characteristic rather than an active system component.

name	value	max_value	rationale
explanatory_value	4.0	5.0	This entity provides genuine explanatory power by illuminating why mineral rents differ from agricultural rents and how natural endowments affect market structures. It reveals an important mechanism in Smith's theory of how natural factors influence economic outcomes and pricing.

Evaluation: Mine Fertility

definition_precision — 4.0 / 5.0

The definition clearly distinguishes mine fertility as productivity per unit of labor/capital, avoiding circularity and providing measurable criteria. It could be slightly more precise about what constitutes "valuable material" but otherwise captures a distinct economic concept.

source_grounding — 5.0 / 5.0

This concept is directly grounded in Smith's analysis in Book I, Chapter 11, where he explicitly discusses how the fertility of mines affects rent and pricing. The entity accurately reflects Smith's comparative analysis between mineral extraction and agricultural production.

domain_placement — 5.0 / 5.0

"Production" is the correct domain placement as mine fertility directly relates to the productive capacity and efficiency of extractive operations. This fits naturally within Smith's broader analysis of productive factors and their economic effects.

vsm_relevance — 3.0 / 5.0

Mine fertility maps most naturally to S1 (primary operations) as it describes the productive capacity of basic economic units, but it also has some relevance to S4 (intelligence) regarding resource assessment. However, it's somewhat abstract as a natural characteristic rather than an active system component.

explanatory_value — 4.0 / 5.0

This entity provides genuine explanatory power by illuminating why mineral rents differ from agricultural rents and how natural endowments affect market structures. It reveals an important mechanism in Smith's theory of how natural factors influence economic outcomes and pricing.

3.5 KiB Raw Blame History