Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.5 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

unstamped_bars

null

2026-02-23T06:35:51.040693

4.0

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition is precise and captures a distinct concept - metal bars lacking official certification that require individual verification. It clearly distinguishes this from coined money and identifies the specific problems (weighing and assaying) that made such bars inconvenient for commerce.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's text from Book I, Chapter 4, where he explicitly discusses the inconveniences of using unstamped metal bars before coinage was invented. The definition accurately reflects Smith's description of the weighing and assaying problems.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Exchange" domain is perfectly appropriate, as unstamped bars represent a primitive form of exchange medium that preceded coined money. This fits squarely within Smith's discussion of the evolution of exchange mechanisms.

name	value	max_value	rationale
vsm_relevance	2.0	5.0	This entity is largely VSM-neutral as it describes a historical exchange medium rather than an organizational system or function. While it might tangentially relate to S1 (operational transactions), it doesn't naturally map to VSM systems since it's about the medium of exchange rather than systemic organization.

name	value	max_value	rationale
explanatory_value	4.0	5.0	This entity provides significant explanatory value by illustrating why coinage was invented and how it solved specific transactional problems. It helps explain the evolutionary progression from barter to coined money by highlighting the structural inefficiencies that drove monetary innovation.

Evaluation: Unstamped Bars

definition_precision — 4.0 / 5.0

The definition is precise and captures a distinct concept - metal bars lacking official certification that require individual verification. It clearly distinguishes this from coined money and identifies the specific problems (weighing and assaying) that made such bars inconvenient for commerce.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's text from Book I, Chapter 4, where he explicitly discusses the inconveniences of using unstamped metal bars before coinage was invented. The definition accurately reflects Smith's description of the weighing and assaying problems.

domain_placement — 5.0 / 5.0

The "Exchange" domain is perfectly appropriate, as unstamped bars represent a primitive form of exchange medium that preceded coined money. This fits squarely within Smith's discussion of the evolution of exchange mechanisms.

vsm_relevance — 2.0 / 5.0

This entity is largely VSM-neutral as it describes a historical exchange medium rather than an organizational system or function. While it might tangentially relate to S1 (operational transactions), it doesn't naturally map to VSM systems since it's about the medium of exchange rather than systemic organization.

explanatory_value — 4.0 / 5.0

This entity provides significant explanatory value by illustrating why coinage was invented and how it solved specific transactional problems. It helps explain the evolutionary progression from barter to coined money by highlighting the structural inefficiencies that drove monetary innovation.

3.5 KiB Raw Blame History