Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.8 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

rice_countries

null

2026-02-23T06:19:17.799640

4.0

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly identifies rice countries as regions where rice is the primary agricultural product, with specific environmental and labor requirements that create distinct economic dynamics. The definition is precise and non-circular, though it could be slightly more specific about what constitutes "primary" agricultural product.

name	value	max_value	rationale
source_grounding	4.0	5.0	Smith does discuss rice cultivation and its economic effects in Book I, Chapter 11, particularly comparing rice and wheat production systems and their impact on rents and productivity. The entity accurately reflects Smith's analysis of how different staple crops create different economic structures.

name	value	max_value	rationale
domain_placement	5.0	5.0	Placement in the "Production" domain is entirely appropriate, as rice countries represent a fundamental category of agricultural production systems that Smith analyzes for their distinct economic characteristics. This is clearly a production-focused concept rather than belonging to exchange, distribution, or consumption domains.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	This entity maps most naturally to S1 (primary operations) as it represents a fundamental production system, but it's somewhat abstract as a geographical/agricultural category. It doesn't clearly embody the cybernetic control functions that make VSM mapping particularly illuminating.

name	value	max_value	rationale
explanatory_value	4.0	5.0	The entity provides genuine explanatory power by illustrating how the nature of the primary agricultural product affects economic returns, rent structures, and labor organization. It helps explain Smith's broader argument about how different production systems generate different economic dynamics and wealth distribution patterns.

Evaluation: Rice Countries

definition_precision — 4.0 / 5.0

The definition clearly identifies rice countries as regions where rice is the primary agricultural product, with specific environmental and labor requirements that create distinct economic dynamics. The definition is precise and non-circular, though it could be slightly more specific about what constitutes "primary" agricultural product.

source_grounding — 4.0 / 5.0

Smith does discuss rice cultivation and its economic effects in Book I, Chapter 11, particularly comparing rice and wheat production systems and their impact on rents and productivity. The entity accurately reflects Smith's analysis of how different staple crops create different economic structures.

domain_placement — 5.0 / 5.0

Placement in the "Production" domain is entirely appropriate, as rice countries represent a fundamental category of agricultural production systems that Smith analyzes for their distinct economic characteristics. This is clearly a production-focused concept rather than belonging to exchange, distribution, or consumption domains.

vsm_relevance — 3.0 / 5.0

This entity maps most naturally to S1 (primary operations) as it represents a fundamental production system, but it's somewhat abstract as a geographical/agricultural category. It doesn't clearly embody the cybernetic control functions that make VSM mapping particularly illuminating.

explanatory_value — 4.0 / 5.0

The entity provides genuine explanatory power by illustrating how the nature of the primary agricultural product affects economic returns, rent structures, and labor organization. It helps explain Smith's broader argument about how different production systems generate different economic dynamics and wealth distribution patterns.

3.8 KiB Raw Blame History