feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,64 @@
---
entity_slug: agricultural_technology_adoption
evaluator: null
evaluated_at: '2026-02-23T00:32:19.997838'
overall_score: 2.4
scores:
- name: definition_precision
value: 1.0
max_value: 5.0
rationale: There is no definition provided at all, making it impossible to assess
precision or conceptual distinctness. Without a definition, this entity is essentially
an empty placeholder.
- name: source_grounding
value: 2.0
max_value: 5.0
rationale: While Smith does discuss agricultural improvements and technological
progress in "The Wealth of Nations," the specific framing of "technology adoption"
as a distinct analytical category may impose modern conceptual frameworks onto
18th-century economic thought. The absence of source chapter specification makes
verification impossible.
- name: domain_placement
value: 3.0
max_value: 5.0
rationale: Agricultural technology would reasonably fall within economic analysis
of productivity and development, which aligns with Smith's concerns. However,
without domain specification or definitional content, proper categorization cannot
be confirmed.
- name: vsm_relevance
value: 4.0
max_value: 5.0
rationale: Agricultural technology adoption could map well to S4 (intelligence/environmental
adaptation) as it represents how agricultural systems adapt to new knowledge and
environmental challenges. It might also relate to S1 (primary operations) in terms
of actual implementation of new techniques.
- name: explanatory_value
value: 2.0
max_value: 5.0
rationale: While technological adoption is potentially an important mechanism for
economic development, this entity currently provides no explanatory content due
to its lack of definition and context. It names a phenomenon but illuminates no
underlying mechanisms or structural relations.
---
# Evaluation: Agricultural Technology Adoption
## definition_precision — 1.0 / 5.0
There is no definition provided at all, making it impossible to assess precision or conceptual distinctness. Without a definition, this entity is essentially an empty placeholder.
## source_grounding — 2.0 / 5.0
While Smith does discuss agricultural improvements and technological progress in "The Wealth of Nations," the specific framing of "technology adoption" as a distinct analytical category may impose modern conceptual frameworks onto 18th-century economic thought. The absence of source chapter specification makes verification impossible.
## domain_placement — 3.0 / 5.0
Agricultural technology would reasonably fall within economic analysis of productivity and development, which aligns with Smith's concerns. However, without domain specification or definitional content, proper categorization cannot be confirmed.
## vsm_relevance — 4.0 / 5.0
Agricultural technology adoption could map well to S4 (intelligence/environmental adaptation) as it represents how agricultural systems adapt to new knowledge and environmental challenges. It might also relate to S1 (primary operations) in terms of actual implementation of new techniques.
## explanatory_value — 2.0 / 5.0
While technological adoption is potentially an important mechanism for economic development, this entity currently provides no explanatory content due to its lack of definition and context. It names a phenomenon but illuminates no underlying mechanisms or structural relations.