Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.5 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

drawing_and_redrawing

null

2026-02-23T05:08:06.012525

4.2

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly describes a specific financial practice involving circular bill drawing with accumulated costs. It precisely captures the mechanism of creating artificial credit through repeated discounting, though it could be slightly more explicit about the circular nature.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's text from Book II, Chapter 2, where he explicitly discusses and criticizes this practice. The description accurately reflects Smith's analysis of drawing and redrawing as an expensive credit mechanism that emerged when banks restricted lending.

name	value	max_value	rationale
domain_placement	5.0	5.0	The placement in the "Exchange" domain is highly appropriate, as drawing and redrawing is fundamentally about financial exchange mechanisms and credit instruments. This practice directly relates to how value and credit are exchanged in commercial transactions.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	This entity has moderate VSM relevance, potentially mapping to S1 (as an operational financial practice) or S2 (as a coordination mechanism between merchants). However, it's primarily a tactical financial instrument rather than a clear systemic function, making VSM placement somewhat forced.

name	value	max_value	rationale
explanatory_value	4.0	5.0	The entity provides strong explanatory value by illuminating a specific mechanism of credit creation and its economic consequences. It helps explain how merchants circumvented banking restrictions and the risks of artificial credit expansion, contributing to understanding of financial system dynamics.

Evaluation: Drawing And Redrawing

definition_precision — 4.0 / 5.0

The definition clearly describes a specific financial practice involving circular bill drawing with accumulated costs. It precisely captures the mechanism of creating artificial credit through repeated discounting, though it could be slightly more explicit about the circular nature.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's text from Book II, Chapter 2, where he explicitly discusses and criticizes this practice. The description accurately reflects Smith's analysis of drawing and redrawing as an expensive credit mechanism that emerged when banks restricted lending.

domain_placement — 5.0 / 5.0

The placement in the "Exchange" domain is highly appropriate, as drawing and redrawing is fundamentally about financial exchange mechanisms and credit instruments. This practice directly relates to how value and credit are exchanged in commercial transactions.

vsm_relevance — 3.0 / 5.0

This entity has moderate VSM relevance, potentially mapping to S1 (as an operational financial practice) or S2 (as a coordination mechanism between merchants). However, it's primarily a tactical financial instrument rather than a clear systemic function, making VSM placement somewhat forced.

explanatory_value — 4.0 / 5.0

The entity provides strong explanatory value by illuminating a specific mechanism of credit creation and its economic consequences. It helps explain how merchants circumvented banking restrictions and the risks of artificial credit expansion, contributing to understanding of financial system dynamics.

3.5 KiB Raw Blame History