feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,66 @@
---
entity_slug: town_country_dependency
evaluator: null
evaluated_at: '2026-02-23T06:32:24.768385'
overall_score: 1.8
scores:
- name: definition_precision
value: 1.0
max_value: 5.0
rationale: There is no definition provided at all, making it impossible to assess
the precision or distinctness of the concept. Without any definitional content,
this entity fails to establish what specific aspect of town-country relationships
it addresses.
- name: source_grounding
value: 2.0
max_value: 5.0
rationale: While Smith does discuss the relationship between towns and countryside
in "The Wealth of Nations," the entity provides no context or chapter reference
to demonstrate how this concept is actually grounded in the source text. The lack
of supporting material makes it unclear whether this represents Smith's actual
analysis or an imposed interpretation.
- name: domain_placement
value: 3.0
max_value: 5.0
rationale: The concept of town-country dependency is economically relevant to Smith's
work, as he examines urban-rural economic relationships, trade patterns, and mutual
dependence. However, without a clear definition or domain specification, it's
difficult to assess whether the thematic categorization is appropriate.
- name: vsm_relevance
value: 2.0
max_value: 5.0
rationale: Town-country dependency could potentially map to multiple VSM systems
(S1 for operational exchanges, S4 for environmental adaptation), but without a
clear definition of what type of dependency is meant, it remains too vague to
place meaningfully within the VSM framework. The concept needs more specificity
to determine its systemic role.
- name: explanatory_value
value: 1.0
max_value: 5.0
rationale: As currently presented, this entity provides no explanatory power since
it lacks both definition and context. It merely names a broad phenomenon without
illuminating any specific mechanisms, causal relationships, or structural dynamics
that would enhance understanding of Smith's economic theory.
---
# Evaluation: Town Country Dependency
## definition_precision — 1.0 / 5.0
There is no definition provided at all, making it impossible to assess the precision or distinctness of the concept. Without any definitional content, this entity fails to establish what specific aspect of town-country relationships it addresses.
## source_grounding — 2.0 / 5.0
While Smith does discuss the relationship between towns and countryside in "The Wealth of Nations," the entity provides no context or chapter reference to demonstrate how this concept is actually grounded in the source text. The lack of supporting material makes it unclear whether this represents Smith's actual analysis or an imposed interpretation.
## domain_placement — 3.0 / 5.0
The concept of town-country dependency is economically relevant to Smith's work, as he examines urban-rural economic relationships, trade patterns, and mutual dependence. However, without a clear definition or domain specification, it's difficult to assess whether the thematic categorization is appropriate.
## vsm_relevance — 2.0 / 5.0
Town-country dependency could potentially map to multiple VSM systems (S1 for operational exchanges, S4 for environmental adaptation), but without a clear definition of what type of dependency is meant, it remains too vague to place meaningfully within the VSM framework. The concept needs more specificity to determine its systemic role.
## explanatory_value — 1.0 / 5.0
As currently presented, this entity provides no explanatory power since it lacks both definition and context. It merely names a broad phenomenon without illuminating any specific mechanisms, causal relationships, or structural dynamics that would enhance understanding of Smith's economic theory.