Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.5 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

coal_price

null

2026-02-23T04:43:37.945288

4.2

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly identifies coal price as a market price influenced by specific factors (abundance, transportation costs, alternative fuels availability). It avoids circularity and captures a distinct economic concept with measurable characteristics.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is well-grounded in Smith's actual analysis from Book I, Chapter 11, where he specifically examines coal prices as an example of how natural resource abundance affects rent components in commodity pricing. The context accurately reflects Smith's comparative analysis of coal versus agricultural land rents.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Production" domain assignment is correct, as coal price directly relates to the costs and economics of productive processes. Coal serves as both an input to production and a commodity whose pricing Smith analyzes within his broader production theory.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	Coal price has moderate VSM relevance, primarily mapping to S1 (operational costs affecting primary production activities) and potentially S4 (environmental intelligence about resource markets). However, it's more of an operational parameter than a core VSM structural element.

name	value	max_value	rationale
explanatory_value	4.0	5.0	This entity provides good explanatory value by illustrating Smith's mechanism of how natural resource abundance affects rent structures and commodity pricing. It demonstrates a concrete application of his theoretical framework about the relationship between scarcity, location, and economic rent.

Evaluation: Coal Price

definition_precision — 4.0 / 5.0

The definition clearly identifies coal price as a market price influenced by specific factors (abundance, transportation costs, alternative fuels availability). It avoids circularity and captures a distinct economic concept with measurable characteristics.

source_grounding — 5.0 / 5.0

This entity is well-grounded in Smith's actual analysis from Book I, Chapter 11, where he specifically examines coal prices as an example of how natural resource abundance affects rent components in commodity pricing. The context accurately reflects Smith's comparative analysis of coal versus agricultural land rents.

domain_placement — 5.0 / 5.0

The "Production" domain assignment is correct, as coal price directly relates to the costs and economics of productive processes. Coal serves as both an input to production and a commodity whose pricing Smith analyzes within his broader production theory.

vsm_relevance — 3.0 / 5.0

Coal price has moderate VSM relevance, primarily mapping to S1 (operational costs affecting primary production activities) and potentially S4 (environmental intelligence about resource markets). However, it's more of an operational parameter than a core VSM structural element.

explanatory_value — 4.0 / 5.0

This entity provides good explanatory value by illustrating Smith's mechanism of how natural resource abundance affects rent structures and commodity pricing. It demonstrates a concrete application of his theoretical framework about the relationship between scarcity, location, and economic rent.

3.5 KiB Raw Blame History