feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,64 @@
---
entity_slug: economic_system_relationship
evaluator: null
evaluated_at: '2026-02-23T05:20:18.861411'
overall_score: 2.2
scores:
- name: definition_precision
value: 2.0
max_value: 5.0
rationale: The definition is overly broad and vague, essentially describing "how
economic systems relate to each other and everything else." It lacks specificity
about what constitutes these "connections and interactions" and reads more like
a general category than a distinct analytical concept.
- name: source_grounding
value: 2.0
max_value: 5.0
rationale: While Smith does compare different economic systems (mercantilism vs.
natural liberty), the entity extrapolates this into a meta-concept about "economic
system relationships" that Smith doesn't explicitly theorize. The context statement
acknowledges this is based on implications rather than direct textual support.
- name: domain_placement
value: 3.0
max_value: 5.0
rationale: '"General Theory" is appropriate given the broad, meta-analytical nature
of this concept, though the vagueness of the entity makes any domain placement
somewhat arbitrary. It doesn''t fit neatly into more specific economic domains
like trade or production.'
- name: vsm_relevance
value: 2.0
max_value: 5.0
rationale: This entity is too abstract and meta-theoretical to map meaningfully
to specific VSM systems. It operates at a level above the VSM framework, describing
relationships between entire systems rather than functional components within
a viable system.
- name: explanatory_value
value: 2.0
max_value: 5.0
rationale: The entity provides minimal explanatory power, functioning more as a
descriptive label than an analytical tool. It doesn't illuminate specific mechanisms
or structural relations but rather names the general phenomenon that economic
systems can be compared and contrasted.
---
# Evaluation: Economic System Relationship
## definition_precision — 2.0 / 5.0
The definition is overly broad and vague, essentially describing "how economic systems relate to each other and everything else." It lacks specificity about what constitutes these "connections and interactions" and reads more like a general category than a distinct analytical concept.
## source_grounding — 2.0 / 5.0
While Smith does compare different economic systems (mercantilism vs. natural liberty), the entity extrapolates this into a meta-concept about "economic system relationships" that Smith doesn't explicitly theorize. The context statement acknowledges this is based on implications rather than direct textual support.
## domain_placement — 3.0 / 5.0
"General Theory" is appropriate given the broad, meta-analytical nature of this concept, though the vagueness of the entity makes any domain placement somewhat arbitrary. It doesn't fit neatly into more specific economic domains like trade or production.
## vsm_relevance — 2.0 / 5.0
This entity is too abstract and meta-theoretical to map meaningfully to specific VSM systems. It operates at a level above the VSM framework, describing relationships between entire systems rather than functional components within a viable system.
## explanatory_value — 2.0 / 5.0
The entity provides minimal explanatory power, functioning more as a descriptive label than an analytical tool. It doesn't illuminate specific mechanisms or structural relations but rather names the general phenomenon that economic systems can be compared and contrasted.