Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.7 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

tobacco_colonies

null

2026-02-23T06:31:49.487081

4.2

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition is clear and specific, identifying tobacco colonies as North American plantations (Virginia/Maryland) that produce tobacco for European export. It avoids circularity and distinguishes this concept from general agriculture by emphasizing the specialized nature and rent-commanding ability of tobacco cultivation.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is well-grounded in Smith's actual text from Book I, Chapter 11, where he discusses tobacco colonies as examples of specialized agricultural production. The comparison to sugar colonies and the discussion of rents relative to ordinary agricultural land directly reflects Smith's analysis.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Production" domain assignment is correct, as tobacco colonies represent a specific form of agricultural production with distinct economic characteristics. This fits naturally within Smith's broader analysis of different types of productive activities and their varying returns.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	Tobacco colonies map primarily to S1 (primary operations) as they represent actual productive activities, but the concept is somewhat VSM-neutral. While they involve coordination and environmental adaptation, the entity itself doesn't strongly illuminate VSM dynamics beyond being a basic operational unit.

name	value	max_value	rationale
explanatory_value	4.0	5.0	This entity provides good explanatory value by illustrating Smith's theory of differential rents and specialized agriculture. It demonstrates how particular crops and geographic conditions create economic advantages, contributing to understanding of rent theory and colonial economic structures.

Evaluation: Tobacco Colonies

definition_precision — 4.0 / 5.0

The definition is clear and specific, identifying tobacco colonies as North American plantations (Virginia/Maryland) that produce tobacco for European export. It avoids circularity and distinguishes this concept from general agriculture by emphasizing the specialized nature and rent-commanding ability of tobacco cultivation.

source_grounding — 5.0 / 5.0

This entity is well-grounded in Smith's actual text from Book I, Chapter 11, where he discusses tobacco colonies as examples of specialized agricultural production. The comparison to sugar colonies and the discussion of rents relative to ordinary agricultural land directly reflects Smith's analysis.

domain_placement — 5.0 / 5.0

The "Production" domain assignment is correct, as tobacco colonies represent a specific form of agricultural production with distinct economic characteristics. This fits naturally within Smith's broader analysis of different types of productive activities and their varying returns.

vsm_relevance — 3.0 / 5.0

Tobacco colonies map primarily to S1 (primary operations) as they represent actual productive activities, but the concept is somewhat VSM-neutral. While they involve coordination and environmental adaptation, the entity itself doesn't strongly illuminate VSM dynamics beyond being a basic operational unit.

explanatory_value — 4.0 / 5.0

This entity provides good explanatory value by illustrating Smith's theory of differential rents and specialized agriculture. It demonstrates how particular crops and geographic conditions create economic advantages, contributing to understanding of rent theory and colonial economic structures.

3.7 KiB Raw Blame History