Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.4 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

discount_of_bills

null

2026-02-23T05:06:21.860476

4.8

name	value	max_value	rationale
definition_precision	5.0	5.0	The definition is highly precise and non-circular, clearly explaining the specific banking practice of advancing money on bills of exchange before maturity while deducting interest. It captures a distinct financial mechanism rather than a vague concept.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is well-grounded in Smith's actual text, as he explicitly discusses how banks profit from discounting bills of exchange in Book II, Chapter 2. The concept directly reflects Smith's analysis of banking operations and trade facilitation.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Exchange" domain assignment is perfectly appropriate, as this practice is fundamentally about the exchange of present money for future payment obligations. It sits naturally within the broader category of financial exchange mechanisms.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This entity maps well to S1 (primary operations) as a core banking service that generates revenue, and also connects to S2 (coordination) by facilitating trade flows and reducing temporal mismatches between merchants' cash needs and receipts. It has clear operational significance within the economic system.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This entity provides excellent explanatory power by illuminating a key mechanism through which banks facilitate commerce and generate profits. It reveals the structural relationship between banking services, merchant liquidity needs, and trade facilitation rather than merely naming a surface phenomenon.

Evaluation: Discount Of Bills

definition_precision — 5.0 / 5.0

The definition is highly precise and non-circular, clearly explaining the specific banking practice of advancing money on bills of exchange before maturity while deducting interest. It captures a distinct financial mechanism rather than a vague concept.

source_grounding — 5.0 / 5.0

This entity is well-grounded in Smith's actual text, as he explicitly discusses how banks profit from discounting bills of exchange in Book II, Chapter 2. The concept directly reflects Smith's analysis of banking operations and trade facilitation.

domain_placement — 5.0 / 5.0

The "Exchange" domain assignment is perfectly appropriate, as this practice is fundamentally about the exchange of present money for future payment obligations. It sits naturally within the broader category of financial exchange mechanisms.

vsm_relevance — 4.0 / 5.0

This entity maps well to S1 (primary operations) as a core banking service that generates revenue, and also connects to S2 (coordination) by facilitating trade flows and reducing temporal mismatches between merchants' cash needs and receipts. It has clear operational significance within the economic system.

explanatory_value — 5.0 / 5.0

This entity provides excellent explanatory power by illuminating a key mechanism through which banks facilitate commerce and generate profits. It reveals the structural relationship between banking services, merchant liquidity needs, and trade facilitation rather than merely naming a surface phenomenon.

3.4 KiB Raw Blame History