feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,65 @@
---
entity_slug: poll_tax_compensation
evaluator: null
evaluated_at: '2026-02-23T06:07:18.001123'
overall_score: 4.2
scores:
- name: definition_precision
value: 4.0
max_value: 5.0
rationale: The definition clearly distinguishes poll tax compensation as a specific
economic arrangement with fixed payments in exchange for exemptions, creating
a distinct concept from general taxation or feudal obligations. The definition
is precise about the mechanism and outcomes, though it could be slightly more
specific about the nature of the "exemptions."
- name: source_grounding
value: 4.0
max_value: 5.0
rationale: This concept appears well-grounded in Smith's discussion of medieval
town development in Book III, Chapter 3, where he analyzes the economic relationships
between towns and their protectors. The specific mechanism of fixed payments for
autonomy aligns with Smith's historical analysis of urban commercial development.
- name: domain_placement
value: 5.0
max_value: 5.0
rationale: '"Regulation" is the correct domain placement as this entity describes
a systematic arrangement governing economic relationships between towns and protectors.
It represents a regulatory framework that structured medieval economic interactions
rather than a pure market mechanism or production process.'
- name: vsm_relevance
value: 3.0
max_value: 5.0
rationale: This entity has moderate VSM relevance, potentially mapping to S3 (internal
regulation) as it describes a control mechanism that managed the relationship
between different economic actors. However, it's somewhat abstract as a historical
institutional arrangement rather than an active system component.
- name: explanatory_value
value: 5.0
max_value: 5.0
rationale: This entity provides excellent explanatory value by illuminating a specific
mechanism that enabled the transition from feudal to commercial economic systems.
It explains how predictable revenue streams and economic autonomy were simultaneously
achieved, revealing an important structural relationship in economic development.
---
# Evaluation: Poll Tax Compensation
## definition_precision — 4.0 / 5.0
The definition clearly distinguishes poll tax compensation as a specific economic arrangement with fixed payments in exchange for exemptions, creating a distinct concept from general taxation or feudal obligations. The definition is precise about the mechanism and outcomes, though it could be slightly more specific about the nature of the "exemptions."
## source_grounding — 4.0 / 5.0
This concept appears well-grounded in Smith's discussion of medieval town development in Book III, Chapter 3, where he analyzes the economic relationships between towns and their protectors. The specific mechanism of fixed payments for autonomy aligns with Smith's historical analysis of urban commercial development.
## domain_placement — 5.0 / 5.0
"Regulation" is the correct domain placement as this entity describes a systematic arrangement governing economic relationships between towns and protectors. It represents a regulatory framework that structured medieval economic interactions rather than a pure market mechanism or production process.
## vsm_relevance — 3.0 / 5.0
This entity has moderate VSM relevance, potentially mapping to S3 (internal regulation) as it describes a control mechanism that managed the relationship between different economic actors. However, it's somewhat abstract as a historical institutional arrangement rather than an active system component.
## explanatory_value — 5.0 / 5.0
This entity provides excellent explanatory value by illuminating a specific mechanism that enabled the transition from feudal to commercial economic systems. It explains how predictable revenue streams and economic autonomy were simultaneously achieved, revealing an important structural relationship in economic development.