Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.7 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

system_of_agriculture

null

2026-02-23T06:28:13.306493

3.4

name	value	max_value	rationale
definition_precision	3.0	5.0	The definition identifies a distinct concept as one of two systems of political economy focused on agricultural development, but it lacks specificity about what constitutes this system's mechanisms or principles. The contrast with the commercial system provides some clarity, but the definition remains somewhat general.

name	value	max_value	rationale
source_grounding	4.0	5.0	The entity is well-grounded in Smith's actual text from Book IV, Chapter 0, where he explicitly discusses two distinct systems of political economy and mentions the agricultural system as an alternative to commerce. The context accurately reflects Smith's stated intention to explain both systems.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Production" domain assignment is highly appropriate since the agricultural system fundamentally concerns land cultivation and agricultural development as the primary means of wealth creation. This clearly falls within production-focused economic activity.

name	value	max_value	rationale
vsm_relevance	2.0	5.0	This entity represents a high-level economic philosophy or approach rather than a specific operational or regulatory mechanism, making it difficult to map to any particular VSM system. It's too abstract and strategic to fit naturally into the VSM framework's operational categories.

name	value	max_value	rationale
explanatory_value	3.0	5.0	The entity provides moderate explanatory value by establishing one of two fundamental approaches to political economy that Smith analyzes, helping to structure understanding of different wealth-creation philosophies. However, without more detail about the system's specific mechanisms, its explanatory power remains limited to broad categorization.

Evaluation: System Of Agriculture

definition_precision — 3.0 / 5.0

The definition identifies a distinct concept as one of two systems of political economy focused on agricultural development, but it lacks specificity about what constitutes this system's mechanisms or principles. The contrast with the commercial system provides some clarity, but the definition remains somewhat general.

source_grounding — 4.0 / 5.0

The entity is well-grounded in Smith's actual text from Book IV, Chapter 0, where he explicitly discusses two distinct systems of political economy and mentions the agricultural system as an alternative to commerce. The context accurately reflects Smith's stated intention to explain both systems.

domain_placement — 5.0 / 5.0

The "Production" domain assignment is highly appropriate since the agricultural system fundamentally concerns land cultivation and agricultural development as the primary means of wealth creation. This clearly falls within production-focused economic activity.

vsm_relevance — 2.0 / 5.0

This entity represents a high-level economic philosophy or approach rather than a specific operational or regulatory mechanism, making it difficult to map to any particular VSM system. It's too abstract and strategic to fit naturally into the VSM framework's operational categories.

explanatory_value — 3.0 / 5.0

The entity provides moderate explanatory value by establishing one of two fundamental approaches to political economy that Smith analyzes, helping to structure understanding of different wealth-creation philosophies. However, without more detail about the system's specific mechanisms, its explanatory power remains limited to broad categorization.

3.7 KiB Raw Blame History