Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.8 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

mercantile_stock

null

2026-02-23T05:50:40.607606

4.0

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly distinguishes mercantile stock as capital employed in trade/commerce that only maintains its own value without creating new value. It's precise in explaining the agricultural systems' view that this stock is "barren and unproductive" because it lacks the surplus-generating capacity of agricultural labor.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's discussion of agricultural systems in Book IV, Chapter 9, where he explicitly explains how these systems classify mercantile stock alongside manufacturing stock as unproductive. The characterization as "barren" and the comparison to manufacturing stock reflects Smith's actual analysis.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Distribution" domain is appropriate since mercantile stock relates to the circulation and exchange of goods rather than their production. This aligns with Smith's treatment of trade and commerce as distinct from productive agricultural and manufacturing activities.

name	value	max_value	rationale
vsm_relevance	2.0	5.0	Mercantile stock is primarily a classificatory concept from agricultural economic theory rather than an operational system component. While it relates to economic circulation, it doesn't naturally map to specific VSM functions like coordination (S2) or intelligence (S4) but rather represents a theoretical categorization.

name	value	max_value	rationale
explanatory_value	4.0	5.0	This entity illuminates an important theoretical distinction in Smith's analysis of different economic systems' views on productivity. It helps explain the agricultural systems' bias against commerce and reveals underlying assumptions about what constitutes "productive" versus "unproductive" economic activity.

Evaluation: Mercantile Stock

definition_precision — 4.0 / 5.0

The definition clearly distinguishes mercantile stock as capital employed in trade/commerce that only maintains its own value without creating new value. It's precise in explaining the agricultural systems' view that this stock is "barren and unproductive" because it lacks the surplus-generating capacity of agricultural labor.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's discussion of agricultural systems in Book IV, Chapter 9, where he explicitly explains how these systems classify mercantile stock alongside manufacturing stock as unproductive. The characterization as "barren" and the comparison to manufacturing stock reflects Smith's actual analysis.

domain_placement — 5.0 / 5.0

The "Distribution" domain is appropriate since mercantile stock relates to the circulation and exchange of goods rather than their production. This aligns with Smith's treatment of trade and commerce as distinct from productive agricultural and manufacturing activities.

vsm_relevance — 2.0 / 5.0

Mercantile stock is primarily a classificatory concept from agricultural economic theory rather than an operational system component. While it relates to economic circulation, it doesn't naturally map to specific VSM functions like coordination (S2) or intelligence (S4) but rather represents a theoretical categorization.

explanatory_value — 4.0 / 5.0

This entity illuminates an important theoretical distinction in Smith's analysis of different economic systems' views on productivity. It helps explain the agricultural systems' bias against commerce and reveals underlying assumptions about what constitutes "productive" versus "unproductive" economic activity.

3.8 KiB Raw Blame History