Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.4 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

victuals

null

2026-02-23T06:37:18.388872

4.0

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition is clear and precise, specifically identifying victuals as food and provisions used in payment systems, with a concrete historical example. It avoids circularity and captures a distinct concept within the broader context of non-monetary exchange systems.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's text, where he explicitly discusses how ancient Saxon kings received revenues in the form of victuals and provisions rather than money. The concept accurately reflects Smith's historical analysis of the evolution from payment in kind to monetary systems.

name	value	max_value	rationale
domain_placement	5.0	5.0	The placement in the "Exchange" domain is entirely appropriate, as victuals represent a form of payment and exchange mechanism that predates monetary systems. This fits perfectly within the broader economic theme of how exchange systems evolved.

name	value	max_value	rationale
vsm_relevance	2.0	5.0	This entity is largely VSM-neutral as it describes a historical form of payment rather than an organizational system or function. While it might tangentially relate to S1 (as a basic operational resource), it doesn't naturally map to any specific VSM system.

name	value	max_value	rationale
explanatory_value	4.0	5.0	The entity provides valuable explanatory power by illustrating the historical transition from barter/payment-in-kind to monetary systems, helping to explain how modern exchange mechanisms evolved. It demonstrates a concrete mechanism in the development of economic systems rather than just naming a surface phenomenon.

Evaluation: Victuals

definition_precision — 4.0 / 5.0

The definition is clear and precise, specifically identifying victuals as food and provisions used in payment systems, with a concrete historical example. It avoids circularity and captures a distinct concept within the broader context of non-monetary exchange systems.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's text, where he explicitly discusses how ancient Saxon kings received revenues in the form of victuals and provisions rather than money. The concept accurately reflects Smith's historical analysis of the evolution from payment in kind to monetary systems.

domain_placement — 5.0 / 5.0

The placement in the "Exchange" domain is entirely appropriate, as victuals represent a form of payment and exchange mechanism that predates monetary systems. This fits perfectly within the broader economic theme of how exchange systems evolved.

vsm_relevance — 2.0 / 5.0

This entity is largely VSM-neutral as it describes a historical form of payment rather than an organizational system or function. While it might tangentially relate to S1 (as a basic operational resource), it doesn't naturally map to any specific VSM system.

explanatory_value — 4.0 / 5.0

The entity provides valuable explanatory power by illustrating the historical transition from barter/payment-in-kind to monetary systems, helping to explain how modern exchange mechanisms evolved. It demonstrates a concrete mechanism in the development of economic systems rather than just naming a surface phenomenon.

3.4 KiB Raw Blame History