Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.2 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

bullion

null

2026-02-23T04:39:13.928404

4.2

name	value	max_value	rationale
definition_precision	5.0	5.0	The definition is highly precise, clearly distinguishing bullion as uncoined precious metal valued by weight rather than face value. It captures a distinct physical and economic concept without circularity or vagueness.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's text from Book IV, Chapter 1, where he explicitly discusses the mercantile system's differential treatment of bullion versus coined money. The definition accurately reflects Smith's analysis of this regulatory distinction.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Exchange" domain placement is correct, as bullion functions as a medium of exchange and store of value in international trade. Smith's discussion focuses on its role in monetary exchange systems and trade regulations.

name	value	max_value	rationale
vsm_relevance	2.0	5.0	Bullion is primarily a physical commodity/resource rather than a systemic function, making it largely VSM-neutral. While it might relate to S1 operations in monetary systems, it doesn't naturally map to specific VSM regulatory or intelligence functions.

name	value	max_value	rationale
explanatory_value	4.0	5.0	This entity provides significant explanatory value by illuminating the arbitrary nature of mercantile policies and the distinction between substance and form in monetary theory. It helps explain how the same economic value was treated differently based on physical form rather than function.

Evaluation: Bullion

definition_precision — 5.0 / 5.0

The definition is highly precise, clearly distinguishing bullion as uncoined precious metal valued by weight rather than face value. It captures a distinct physical and economic concept without circularity or vagueness.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's text from Book IV, Chapter 1, where he explicitly discusses the mercantile system's differential treatment of bullion versus coined money. The definition accurately reflects Smith's analysis of this regulatory distinction.

domain_placement — 5.0 / 5.0

The "Exchange" domain placement is correct, as bullion functions as a medium of exchange and store of value in international trade. Smith's discussion focuses on its role in monetary exchange systems and trade regulations.

vsm_relevance — 2.0 / 5.0

Bullion is primarily a physical commodity/resource rather than a systemic function, making it largely VSM-neutral. While it might relate to S1 operations in monetary systems, it doesn't naturally map to specific VSM regulatory or intelligence functions.

explanatory_value — 4.0 / 5.0

This entity provides significant explanatory value by illuminating the arbitrary nature of mercantile policies and the distinction between substance and form in monetary theory. It helps explain how the same economic value was treated differently based on physical form rather than function.

3.2 KiB Raw Blame History