Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.6 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

commercial_transactions

null

2026-02-23T05:00:25.790666

4.4

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly distinguishes commercial transactions from barter by emphasizing money as the medium of exchange and positions them as the primary mode of economic interaction in civilized societies. While precise, it could be slightly more specific about what constitutes the transactional mechanism itself.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's text from Book I, Chapter 4, where he explicitly discusses how money enables commercial transactions and becomes "the universal instrument of commerce" in civilized nations. The historical progression from barter to monetary exchange is a central theme in this chapter.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Exchange" domain is the perfect conceptual home for commercial transactions, as they represent the fundamental mechanism by which exchange occurs in monetary economies. This is precisely what the Exchange domain should encompass.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	Commercial transactions map naturally to S1 (primary operations) as they represent the basic operational activities of an economic system, and potentially to S2 (coordination) as they coordinate resource flows between actors. The entity has clear VSM relevance rather than being too abstract.

name	value	max_value	rationale
explanatory_value	4.0	5.0	This entity illuminates the fundamental mechanism that enables complex economic coordination in civilized societies and explains how money transforms the nature of exchange from barter. It provides genuine insight into how economic systems operate rather than merely labeling a surface phenomenon.

Evaluation: Commercial Transactions

definition_precision — 4.0 / 5.0

The definition clearly distinguishes commercial transactions from barter by emphasizing money as the medium of exchange and positions them as the primary mode of economic interaction in civilized societies. While precise, it could be slightly more specific about what constitutes the transactional mechanism itself.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's text from Book I, Chapter 4, where he explicitly discusses how money enables commercial transactions and becomes "the universal instrument of commerce" in civilized nations. The historical progression from barter to monetary exchange is a central theme in this chapter.

domain_placement — 5.0 / 5.0

The "Exchange" domain is the perfect conceptual home for commercial transactions, as they represent the fundamental mechanism by which exchange occurs in monetary economies. This is precisely what the Exchange domain should encompass.

vsm_relevance — 4.0 / 5.0

Commercial transactions map naturally to S1 (primary operations) as they represent the basic operational activities of an economic system, and potentially to S2 (coordination) as they coordinate resource flows between actors. The entity has clear VSM relevance rather than being too abstract.

explanatory_value — 4.0 / 5.0

This entity illuminates the fundamental mechanism that enables complex economic coordination in civilized societies and explains how money transforms the nature of exchange from barter. It provides genuine insight into how economic systems operate rather than merely labeling a surface phenomenon.

3.6 KiB Raw Blame History