Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.8 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

system_of_commerce

null

2026-02-23T06:28:22.161268

4.0

name	value	max_value	rationale
definition_precision	3.0	5.0	The definition captures a distinct concept contrasting with agricultural systems, but relies on somewhat vague terms like "modern commercial development" and "contemporary contexts." While it identifies key mechanisms (trade, manufacturing, division of labour), it could be more precise about what specifically characterizes this system.

name	value	max_value	rationale
source_grounding	4.0	5.0	This entity appears well-grounded in Smith's actual framework from Book IV, where he explicitly discusses different systems of political economy and contrasts commercial with agricultural approaches. The reference to Smith's intention to "explain fully" the system most familiar to his audience aligns with the source text's structure.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Exchange" domain is perfectly appropriate for a system centered on trade, manufacturing, and commercial development. This captures the essence of how goods and value flow through commercial mechanisms rather than purely agricultural production.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This entity maps well to S4 (intelligence/environmental adaptation) as it represents a systematic approach to understanding and adapting economic policy to modern commercial realities. It also has S5 elements as it embodies a particular identity/philosophy of political economy.

name	value	max_value	rationale
explanatory_value	4.0	5.0	This entity provides significant explanatory power by establishing a fundamental structural distinction in Smith's analysis of political economy systems. It illuminates how different economic mechanisms (commercial vs. agricultural) create different approaches to wealth creation, which is central to understanding Smith's broader argument.

Evaluation: System Of Commerce

definition_precision — 3.0 / 5.0

The definition captures a distinct concept contrasting with agricultural systems, but relies on somewhat vague terms like "modern commercial development" and "contemporary contexts." While it identifies key mechanisms (trade, manufacturing, division of labour), it could be more precise about what specifically characterizes this system.

source_grounding — 4.0 / 5.0

This entity appears well-grounded in Smith's actual framework from Book IV, where he explicitly discusses different systems of political economy and contrasts commercial with agricultural approaches. The reference to Smith's intention to "explain fully" the system most familiar to his audience aligns with the source text's structure.

domain_placement — 5.0 / 5.0

The "Exchange" domain is perfectly appropriate for a system centered on trade, manufacturing, and commercial development. This captures the essence of how goods and value flow through commercial mechanisms rather than purely agricultural production.

vsm_relevance — 4.0 / 5.0

This entity maps well to S4 (intelligence/environmental adaptation) as it represents a systematic approach to understanding and adapting economic policy to modern commercial realities. It also has S5 elements as it embodies a particular identity/philosophy of political economy.

explanatory_value — 4.0 / 5.0

This entity provides significant explanatory power by establishing a fundamental structural distinction in Smith's analysis of political economy systems. It illuminates how different economic mechanisms (commercial vs. agricultural) create different approaches to wealth creation, which is central to understanding Smith's broader argument.

3.8 KiB Raw Blame History