Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

4.0 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

sugar_colonies

null

2026-02-23T06:27:38.266844

4.2

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition is precise and captures a distinct economic concept - specialized agricultural operations in specific geographic regions producing a high-value commodity. It avoids circularity and clearly distinguishes sugar colonies from general agricultural production through their unique combination of geographic constraints and exceptional profitability.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is well-grounded in Smith's actual text, as he specifically uses sugar colonies as a prime example when discussing how certain lands can command extraordinary rents due to their specialized production capabilities. The concept directly reflects Smith's analysis of differential rent based on product value and geographic limitations.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Production" domain assignment is correct, as sugar colonies represent a specific form of agricultural production system. While they also involve trade and rent theory, their primary conceptual role in Smith's analysis is as an example of specialized productive operations that generate exceptional returns.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	Sugar colonies map most naturally to S1 (primary operations) as productive units, but they also have S4 characteristics in terms of environmental adaptation to specific geographic and market conditions. However, they function more as an economic example than as a complete viable system requiring all VSM components.

name	value	max_value	rationale
explanatory_value	4.0	5.0	This entity provides significant explanatory value by illuminating the mechanism through which geographic constraints and product specialization can generate exceptional economic rents. It demonstrates a key structural relationship between scarcity, specialization, and profitability that extends beyond the sugar industry itself.

Evaluation: Sugar Colonies

definition_precision — 4.0 / 5.0

The definition is precise and captures a distinct economic concept - specialized agricultural operations in specific geographic regions producing a high-value commodity. It avoids circularity and clearly distinguishes sugar colonies from general agricultural production through their unique combination of geographic constraints and exceptional profitability.

source_grounding — 5.0 / 5.0

This entity is well-grounded in Smith's actual text, as he specifically uses sugar colonies as a prime example when discussing how certain lands can command extraordinary rents due to their specialized production capabilities. The concept directly reflects Smith's analysis of differential rent based on product value and geographic limitations.

domain_placement — 5.0 / 5.0

The "Production" domain assignment is correct, as sugar colonies represent a specific form of agricultural production system. While they also involve trade and rent theory, their primary conceptual role in Smith's analysis is as an example of specialized productive operations that generate exceptional returns.

vsm_relevance — 3.0 / 5.0

Sugar colonies map most naturally to S1 (primary operations) as productive units, but they also have S4 characteristics in terms of environmental adaptation to specific geographic and market conditions. However, they function more as an economic example than as a complete viable system requiring all VSM components.

explanatory_value — 4.0 / 5.0

This entity provides significant explanatory value by illuminating the mechanism through which geographic constraints and product specialization can generate exceptional economic rents. It demonstrates a key structural relationship between scarcity, specialization, and profitability that extends beyond the sugar industry itself.

4.0 KiB Raw Blame History