Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.4 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

contract

null

2026-02-23T05:02:26.314141

4.2

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition is clear and precise, identifying contracts as formal agreements establishing mutual obligations and rights. It avoids circularity and captures a distinct concept, though it could be slightly more specific about what constitutes "formal" in Smith's context.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is well-grounded in Smith's actual text from Book I, Chapter 2, where he explicitly discusses how humans engage in contractual arrangements while animals do not. The definition accurately reflects Smith's use of this distinction to illustrate uniquely human economic behavior.

name	value	max_value	rationale
domain_placement	5.0	5.0	The placement in the "Exchange" domain is entirely appropriate, as contracts are fundamental mechanisms that enable and structure exchange relationships. This aligns perfectly with Smith's discussion of human propensity to truck, barter, and exchange.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	Contracts have some VSM relevance as they relate to S1 (operational agreements) and S2 (coordination mechanisms), but they are primarily foundational legal/social structures rather than cybernetic system components. The mapping is possible but not particularly natural or illuminating.

name	value	max_value	rationale
explanatory_value	4.0	5.0	This entity provides genuine explanatory value by identifying a key mechanism that distinguishes human economic organization from animal behavior. It illuminates how formal agreements enable complex economic relationships, though it represents more of a foundational concept than a dynamic process.

Evaluation: Contract

definition_precision — 4.0 / 5.0

The definition is clear and precise, identifying contracts as formal agreements establishing mutual obligations and rights. It avoids circularity and captures a distinct concept, though it could be slightly more specific about what constitutes "formal" in Smith's context.

source_grounding — 5.0 / 5.0

This entity is well-grounded in Smith's actual text from Book I, Chapter 2, where he explicitly discusses how humans engage in contractual arrangements while animals do not. The definition accurately reflects Smith's use of this distinction to illustrate uniquely human economic behavior.

domain_placement — 5.0 / 5.0

The placement in the "Exchange" domain is entirely appropriate, as contracts are fundamental mechanisms that enable and structure exchange relationships. This aligns perfectly with Smith's discussion of human propensity to truck, barter, and exchange.

vsm_relevance — 3.0 / 5.0

Contracts have some VSM relevance as they relate to S1 (operational agreements) and S2 (coordination mechanisms), but they are primarily foundational legal/social structures rather than cybernetic system components. The mapping is possible but not particularly natural or illuminating.

explanatory_value — 4.0 / 5.0

This entity provides genuine explanatory value by identifying a key mechanism that distinguishes human economic organization from animal behavior. It illuminates how formal agreements enable complex economic relationships, though it represents more of a foundational concept than a dynamic process.

3.4 KiB Raw Blame History