feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,66 @@
---
entity_slug: system_of_agriculture
evaluator: null
evaluated_at: '2026-02-23T06:28:13.306493'
overall_score: 3.4
scores:
- name: definition_precision
value: 3.0
max_value: 5.0
rationale: The definition identifies a distinct concept as one of two systems of
political economy focused on agricultural development, but it lacks specificity
about what constitutes this system's mechanisms or principles. The contrast with
the commercial system provides some clarity, but the definition remains somewhat
general.
- name: source_grounding
value: 4.0
max_value: 5.0
rationale: The entity is well-grounded in Smith's actual text from Book IV, Chapter
0, where he explicitly discusses two distinct systems of political economy and
mentions the agricultural system as an alternative to commerce. The context accurately
reflects Smith's stated intention to explain both systems.
- name: domain_placement
value: 5.0
max_value: 5.0
rationale: The "Production" domain assignment is highly appropriate since the agricultural
system fundamentally concerns land cultivation and agricultural development as
the primary means of wealth creation. This clearly falls within production-focused
economic activity.
- name: vsm_relevance
value: 2.0
max_value: 5.0
rationale: This entity represents a high-level economic philosophy or approach rather
than a specific operational or regulatory mechanism, making it difficult to map
to any particular VSM system. It's too abstract and strategic to fit naturally
into the VSM framework's operational categories.
- name: explanatory_value
value: 3.0
max_value: 5.0
rationale: The entity provides moderate explanatory value by establishing one of
two fundamental approaches to political economy that Smith analyzes, helping to
structure understanding of different wealth-creation philosophies. However, without
more detail about the system's specific mechanisms, its explanatory power remains
limited to broad categorization.
---
# Evaluation: System Of Agriculture
## definition_precision — 3.0 / 5.0
The definition identifies a distinct concept as one of two systems of political economy focused on agricultural development, but it lacks specificity about what constitutes this system's mechanisms or principles. The contrast with the commercial system provides some clarity, but the definition remains somewhat general.
## source_grounding — 4.0 / 5.0
The entity is well-grounded in Smith's actual text from Book IV, Chapter 0, where he explicitly discusses two distinct systems of political economy and mentions the agricultural system as an alternative to commerce. The context accurately reflects Smith's stated intention to explain both systems.
## domain_placement — 5.0 / 5.0
The "Production" domain assignment is highly appropriate since the agricultural system fundamentally concerns land cultivation and agricultural development as the primary means of wealth creation. This clearly falls within production-focused economic activity.
## vsm_relevance — 2.0 / 5.0
This entity represents a high-level economic philosophy or approach rather than a specific operational or regulatory mechanism, making it difficult to map to any particular VSM system. It's too abstract and strategic to fit naturally into the VSM framework's operational categories.
## explanatory_value — 3.0 / 5.0
The entity provides moderate explanatory value by establishing one of two fundamental approaches to political economy that Smith analyzes, helping to structure understanding of different wealth-creation philosophies. However, without more detail about the system's specific mechanisms, its explanatory power remains limited to broad categorization.