feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)
Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on first pass; 3 failed (network errors). eval-summary --update-metrics written with per_entity_mean=3.9556. Viability dashboard: 6/6 PASS redundancy_ratio 0.0061 (max 0.10) coverage_ratio 0.6190 (min 0.40) coherence_comps 0.0000 (max 3) consistency_cycles 0.0000 (max 0) granularity_entropy 2.6748 (min 1.0) per_entity_mean 3.9556 (min 3.5) Dimension breakdown (mean across 985 entities): definition_precision 3.62 source_grounding 4.36 domain_placement 4.56 vsm_relevance 3.31 explanatory_value 3.94 Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
@@ -0,0 +1,63 @@
|
||||
---
|
||||
entity_slug: discount_of_bills
|
||||
evaluator: null
|
||||
evaluated_at: '2026-02-23T05:06:21.860476'
|
||||
overall_score: 4.8
|
||||
scores:
|
||||
- name: definition_precision
|
||||
value: 5.0
|
||||
max_value: 5.0
|
||||
rationale: The definition is highly precise and non-circular, clearly explaining
|
||||
the specific banking practice of advancing money on bills of exchange before maturity
|
||||
while deducting interest. It captures a distinct financial mechanism rather than
|
||||
a vague concept.
|
||||
- name: source_grounding
|
||||
value: 5.0
|
||||
max_value: 5.0
|
||||
rationale: This entity is well-grounded in Smith's actual text, as he explicitly
|
||||
discusses how banks profit from discounting bills of exchange in Book II, Chapter
|
||||
2. The concept directly reflects Smith's analysis of banking operations and trade
|
||||
facilitation.
|
||||
- name: domain_placement
|
||||
value: 5.0
|
||||
max_value: 5.0
|
||||
rationale: The "Exchange" domain assignment is perfectly appropriate, as this practice
|
||||
is fundamentally about the exchange of present money for future payment obligations.
|
||||
It sits naturally within the broader category of financial exchange mechanisms.
|
||||
- name: vsm_relevance
|
||||
value: 4.0
|
||||
max_value: 5.0
|
||||
rationale: This entity maps well to S1 (primary operations) as a core banking service
|
||||
that generates revenue, and also connects to S2 (coordination) by facilitating
|
||||
trade flows and reducing temporal mismatches between merchants' cash needs and
|
||||
receipts. It has clear operational significance within the economic system.
|
||||
- name: explanatory_value
|
||||
value: 5.0
|
||||
max_value: 5.0
|
||||
rationale: This entity provides excellent explanatory power by illuminating a key
|
||||
mechanism through which banks facilitate commerce and generate profits. It reveals
|
||||
the structural relationship between banking services, merchant liquidity needs,
|
||||
and trade facilitation rather than merely naming a surface phenomenon.
|
||||
---
|
||||
|
||||
# Evaluation: Discount Of Bills
|
||||
|
||||
## definition_precision — 5.0 / 5.0
|
||||
|
||||
The definition is highly precise and non-circular, clearly explaining the specific banking practice of advancing money on bills of exchange before maturity while deducting interest. It captures a distinct financial mechanism rather than a vague concept.
|
||||
|
||||
## source_grounding — 5.0 / 5.0
|
||||
|
||||
This entity is well-grounded in Smith's actual text, as he explicitly discusses how banks profit from discounting bills of exchange in Book II, Chapter 2. The concept directly reflects Smith's analysis of banking operations and trade facilitation.
|
||||
|
||||
## domain_placement — 5.0 / 5.0
|
||||
|
||||
The "Exchange" domain assignment is perfectly appropriate, as this practice is fundamentally about the exchange of present money for future payment obligations. It sits naturally within the broader category of financial exchange mechanisms.
|
||||
|
||||
## vsm_relevance — 4.0 / 5.0
|
||||
|
||||
This entity maps well to S1 (primary operations) as a core banking service that generates revenue, and also connects to S2 (coordination) by facilitating trade flows and reducing temporal mismatches between merchants' cash needs and receipts. It has clear operational significance within the economic system.
|
||||
|
||||
## explanatory_value — 5.0 / 5.0
|
||||
|
||||
This entity provides excellent explanatory power by illuminating a key mechanism through which banks facilitate commerce and generate profits. It reveals the structural relationship between banking services, merchant liquidity needs, and trade facilitation rather than merely naming a surface phenomenon.
|
||||
Reference in New Issue
Block a user