feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,64 @@
---
entity_slug: public_law_on_coinage
evaluator: null
evaluated_at: '2026-02-23T06:13:20.206577'
overall_score: 4.4
scores:
- name: definition_precision
value: 4.0
max_value: 5.0
rationale: The definition clearly identifies public law on coinage as official regulations
governing money production, valuation, and use, with specific focus on monetary
stability and preventing debasement. This captures a distinct regulatory concept
without circularity, though it could be slightly more precise about the scope
of "official regulations."
- name: source_grounding
value: 5.0
max_value: 5.0
rationale: This entity is well-grounded in Book I, Chapter 5 where Smith extensively
discusses how government regulations on coinage affect monetary systems and the
problems of debasement. Smith explicitly examines the role of public authority
in maintaining coin standards and preventing fraud.
- name: domain_placement
value: 5.0
max_value: 5.0
rationale: The "Regulation" domain is perfectly appropriate for this entity, as
it deals with government rules and oversight of monetary systems. This is fundamentally
about regulatory mechanisms rather than market operations or other economic categories.
- name: vsm_relevance
value: 4.0
max_value: 5.0
rationale: This entity maps well to S3 (internal regulation/audit) as it represents
the regulatory oversight function that maintains system standards and prevents
degradation. It also has some S2 coordination aspects in preventing monetary oscillations
and instability.
- name: explanatory_value
value: 4.0
max_value: 5.0
rationale: "The entity illuminates an important structural mechanism in Smith's\
\ monetary theory\u2014how regulatory frameworks maintain monetary integrity and\
\ prevent system breakdown through debasement. It explains a key institutional\
\ foundation for stable money rather than just naming a surface phenomenon."
---
# Evaluation: Public Law On Coinage
## definition_precision — 4.0 / 5.0
The definition clearly identifies public law on coinage as official regulations governing money production, valuation, and use, with specific focus on monetary stability and preventing debasement. This captures a distinct regulatory concept without circularity, though it could be slightly more precise about the scope of "official regulations."
## source_grounding — 5.0 / 5.0
This entity is well-grounded in Book I, Chapter 5 where Smith extensively discusses how government regulations on coinage affect monetary systems and the problems of debasement. Smith explicitly examines the role of public authority in maintaining coin standards and preventing fraud.
## domain_placement — 5.0 / 5.0
The "Regulation" domain is perfectly appropriate for this entity, as it deals with government rules and oversight of monetary systems. This is fundamentally about regulatory mechanisms rather than market operations or other economic categories.
## vsm_relevance — 4.0 / 5.0
This entity maps well to S3 (internal regulation/audit) as it represents the regulatory oversight function that maintains system standards and prevents degradation. It also has some S2 coordination aspects in preventing monetary oscillations and instability.
## explanatory_value — 4.0 / 5.0
The entity illuminates an important structural mechanism in Smith's monetary theory—how regulatory frameworks maintain monetary integrity and prevent system breakdown through debasement. It explains a key institutional foundation for stable money rather than just naming a surface phenomenon.