Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.6 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

engrossing

null

2026-02-23T05:23:19.018043

4.2

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly identifies engrossing as the practice of buying large quantities of commodities (especially corn) for resale at profit, with the specific context of potential market manipulation. It's precise and non-circular, though could benefit from slightly more detail about the temporal aspect (buying when cheap, selling when dear).

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's text from Book IV, Chapter 5, where he explicitly discusses and defends engrossing against common criticisms. The definition accurately reflects Smith's treatment of the practice as legitimate market activity that aids distribution.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Exchange" domain is perfectly appropriate for engrossing, as it fundamentally involves market transactions, price mechanisms, and the movement of goods between different market locations. This is a core exchange activity rather than production, consumption, or regulation.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	Engrossing has some VSM relevance as it relates to S1 operations (actual market transactions) and potentially S4 intelligence (responding to price signals across different markets). However, it's more of a specific market practice than a clear structural component of an economic system.

name	value	max_value	rationale
explanatory_value	4.0	5.0	This entity provides good explanatory value by illuminating how market mechanisms distribute goods from surplus to scarce areas, and how practices often viewed as harmful speculation can actually serve beneficial economic functions. It reveals important dynamics about price arbitrage and market efficiency.

Evaluation: Engrossing

definition_precision — 4.0 / 5.0

The definition clearly identifies engrossing as the practice of buying large quantities of commodities (especially corn) for resale at profit, with the specific context of potential market manipulation. It's precise and non-circular, though could benefit from slightly more detail about the temporal aspect (buying when cheap, selling when dear).

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's text from Book IV, Chapter 5, where he explicitly discusses and defends engrossing against common criticisms. The definition accurately reflects Smith's treatment of the practice as legitimate market activity that aids distribution.

domain_placement — 5.0 / 5.0

The "Exchange" domain is perfectly appropriate for engrossing, as it fundamentally involves market transactions, price mechanisms, and the movement of goods between different market locations. This is a core exchange activity rather than production, consumption, or regulation.

vsm_relevance — 3.0 / 5.0

Engrossing has some VSM relevance as it relates to S1 operations (actual market transactions) and potentially S4 intelligence (responding to price signals across different markets). However, it's more of a specific market practice than a clear structural component of an economic system.

explanatory_value — 4.0 / 5.0

This entity provides good explanatory value by illuminating how market mechanisms distribute goods from surplus to scarce areas, and how practices often viewed as harmful speculation can actually serve beneficial economic functions. It reveals important dynamics about price arbitrage and market efficiency.

3.6 KiB Raw Blame History