Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.4 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

legal_rate_of_interest

null

2026-02-23T05:41:00.445616

4.4

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly distinguishes legal interest rates as statutory maximums that regulate lending, with specific historical examples showing the evolution from 10% to 5%. The concept is well-bounded and avoids circularity, though it could be slightly more precise about enforcement mechanisms.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's detailed historical analysis in Book I, Chapter 9, where he explicitly discusses the progression of legal interest rate statutes from Edward VI through Queen Anne. The examples and timeline provided match Smith's actual text closely.

name	value	max_value	rationale
domain_placement	5.0	5.0	"Regulation" is the correct domain assignment, as legal interest rates represent government intervention in market mechanisms through statutory controls. This clearly falls under regulatory policy rather than pure market operations or monetary theory.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This entity maps well to S3 (internal regulation/audit) as it represents the regulatory system's attempt to control and monitor lending practices within the economic system. It also has some S2 coordination aspects in dampening market oscillations.

name	value	max_value	rationale
explanatory_value	4.0	5.0	The entity illuminates an important regulatory mechanism and Smith's insight that effective regulation follows rather than leads market conditions. It demonstrates the relationship between statutory controls and market dynamics, providing genuine analytical value beyond mere description.

Evaluation: Legal Rate Of Interest

definition_precision — 4.0 / 5.0

The definition clearly distinguishes legal interest rates as statutory maximums that regulate lending, with specific historical examples showing the evolution from 10% to 5%. The concept is well-bounded and avoids circularity, though it could be slightly more precise about enforcement mechanisms.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's detailed historical analysis in Book I, Chapter 9, where he explicitly discusses the progression of legal interest rate statutes from Edward VI through Queen Anne. The examples and timeline provided match Smith's actual text closely.

domain_placement — 5.0 / 5.0

"Regulation" is the correct domain assignment, as legal interest rates represent government intervention in market mechanisms through statutory controls. This clearly falls under regulatory policy rather than pure market operations or monetary theory.

vsm_relevance — 4.0 / 5.0

This entity maps well to S3 (internal regulation/audit) as it represents the regulatory system's attempt to control and monitor lending practices within the economic system. It also has some S2 coordination aspects in dampening market oscillations.

explanatory_value — 4.0 / 5.0

The entity illuminates an important regulatory mechanism and Smith's insight that effective regulation follows rather than leads market conditions. It demonstrates the relationship between statutory controls and market dynamics, providing genuine analytical value beyond mere description.

3.4 KiB Raw Blame History