Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.6 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

bills_of_exchange

null

2026-02-23T04:38:15.896509

4.8

name	value	max_value	rationale
definition_precision	5.0	5.0	The definition is highly precise and non-circular, clearly specifying bills of exchange as written orders directing future payment between merchants. It captures a distinct financial instrument with specific characteristics rather than a vague concept.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's text, as he explicitly discusses bills of exchange in Book II, Chapter 2 as instruments of commercial credit that banks discount. The definition accurately reflects Smith's analysis of their role in facilitating trade without immediate cash payment.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Exchange" domain assignment is perfectly appropriate, as bills of exchange are fundamentally instruments that facilitate the exchange of value across time and space. This placement correctly categorizes the entity within commercial and financial exchange mechanisms.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	Bills of exchange map well to S1 (primary operations) as they are operational tools that enable basic commercial transactions, and to S2 (coordination) as they coordinate payment flows between different merchants and locations. They serve as concrete mechanisms within the viable system of commerce.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This entity provides excellent explanatory value by illuminating the specific mechanism through which merchants could conduct trade without immediate cash, showing how credit instruments enable capital circulation. It reveals a structural relation between banking, credit, and commercial operations that is central to Smith's analysis.

Evaluation: Bills Of Exchange

definition_precision — 5.0 / 5.0

The definition is highly precise and non-circular, clearly specifying bills of exchange as written orders directing future payment between merchants. It captures a distinct financial instrument with specific characteristics rather than a vague concept.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's text, as he explicitly discusses bills of exchange in Book II, Chapter 2 as instruments of commercial credit that banks discount. The definition accurately reflects Smith's analysis of their role in facilitating trade without immediate cash payment.

domain_placement — 5.0 / 5.0

The "Exchange" domain assignment is perfectly appropriate, as bills of exchange are fundamentally instruments that facilitate the exchange of value across time and space. This placement correctly categorizes the entity within commercial and financial exchange mechanisms.

vsm_relevance — 4.0 / 5.0

Bills of exchange map well to S1 (primary operations) as they are operational tools that enable basic commercial transactions, and to S2 (coordination) as they coordinate payment flows between different merchants and locations. They serve as concrete mechanisms within the viable system of commerce.

explanatory_value — 5.0 / 5.0

This entity provides excellent explanatory value by illuminating the specific mechanism through which merchants could conduct trade without immediate cash, showing how credit instruments enable capital circulation. It reveals a structural relation between banking, credit, and commercial operations that is central to Smith's analysis.

3.6 KiB Raw Blame History