Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.3 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

bank_money

null

2026-02-23T00:43:25.412986

4.2

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly distinguishes bank money from physical currency by its key characteristics (credit-based, backed by deposits, stable value, immune to physical degradation). It avoids circularity and captures a distinct monetary instrument concept.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity directly reflects Smith's detailed discussion of the Bank of Amsterdam in Book IV, Chapter 3, where he explicitly contrasts bank money with current money and explains its advantages. The definition closely follows Smith's actual analysis.

name	value	max_value	rationale
domain_placement	5.0	5.0	"Exchange" is the correct domain placement since bank money functions as a medium of exchange and unit of account in commercial transactions. Smith specifically discusses it in the context of facilitating trade and commerce.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	Bank money maps moderately well to S1 (primary operations) as a fundamental tool for conducting economic transactions, but it could also relate to S2 (coordination) by standardizing exchange mechanisms. The mapping is not as clear-cut as more structural economic concepts.

name	value	max_value	rationale
explanatory_value	4.0	5.0	This entity illuminates an important mechanism in Smith's monetary theory—how banking institutions create superior exchange media that solve problems of currency degradation and facilitate international commerce. It reveals structural relationships between banking, currency stability, and trade efficiency.

Evaluation: Bank Money

definition_precision — 4.0 / 5.0

The definition clearly distinguishes bank money from physical currency by its key characteristics (credit-based, backed by deposits, stable value, immune to physical degradation). It avoids circularity and captures a distinct monetary instrument concept.

source_grounding — 5.0 / 5.0

This entity directly reflects Smith's detailed discussion of the Bank of Amsterdam in Book IV, Chapter 3, where he explicitly contrasts bank money with current money and explains its advantages. The definition closely follows Smith's actual analysis.

domain_placement — 5.0 / 5.0

"Exchange" is the correct domain placement since bank money functions as a medium of exchange and unit of account in commercial transactions. Smith specifically discusses it in the context of facilitating trade and commerce.

vsm_relevance — 3.0 / 5.0

Bank money maps moderately well to S1 (primary operations) as a fundamental tool for conducting economic transactions, but it could also relate to S2 (coordination) by standardizing exchange mechanisms. The mapping is not as clear-cut as more structural economic concepts.

explanatory_value — 4.0 / 5.0

This entity illuminates an important mechanism in Smith's monetary theory—how banking institutions create superior exchange media that solve problems of currency degradation and facilitate international commerce. It reveals structural relationships between banking, currency stability, and trade efficiency.

3.3 KiB Raw Blame History