Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.6 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

colony_prosperity

null

2026-02-23T04:56:34.728959

4.0

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition is quite precise, clearly identifying the specific phenomenon of rapid economic growth in British North American colonies with high wages despite lower absolute wealth. It avoids circularity and captures a distinct empirical observation that Smith uses as evidence for his theoretical point.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's text from Book I, Chapter 8, where he explicitly discusses the prosperity of North American colonies as a key example. Smith uses this case to illustrate his argument about how the rate of wealth increase affects wages more than absolute wealth levels.

name	value	max_value	rationale
domain_placement	5.0	5.0	The placement in "General Theory" is appropriate since this represents a specific empirical case that supports Smith's broader theoretical framework about wages and economic growth. It serves as evidence for general principles rather than being a standalone theoretical concept.

name	value	max_value	rationale
vsm_relevance	2.0	5.0	This entity describes an empirical outcome or state rather than a systemic function or mechanism, making it largely VSM-neutral. While it might relate to S4 (environmental intelligence) as an observed economic condition, it doesn't naturally map to any specific VSM system function.

name	value	max_value	rationale
explanatory_value	4.0	5.0	This entity provides significant explanatory value by illustrating the counterintuitive principle that wage levels depend more on the rate of capital growth than absolute wealth accumulation. It serves as crucial empirical evidence that helps explain Smith's theoretical mechanism about labor demand and economic dynamics.

Evaluation: Colony Prosperity

definition_precision — 4.0 / 5.0

The definition is quite precise, clearly identifying the specific phenomenon of rapid economic growth in British North American colonies with high wages despite lower absolute wealth. It avoids circularity and captures a distinct empirical observation that Smith uses as evidence for his theoretical point.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's text from Book I, Chapter 8, where he explicitly discusses the prosperity of North American colonies as a key example. Smith uses this case to illustrate his argument about how the rate of wealth increase affects wages more than absolute wealth levels.

domain_placement — 5.0 / 5.0

The placement in "General Theory" is appropriate since this represents a specific empirical case that supports Smith's broader theoretical framework about wages and economic growth. It serves as evidence for general principles rather than being a standalone theoretical concept.

vsm_relevance — 2.0 / 5.0

This entity describes an empirical outcome or state rather than a systemic function or mechanism, making it largely VSM-neutral. While it might relate to S4 (environmental intelligence) as an observed economic condition, it doesn't naturally map to any specific VSM system function.

explanatory_value — 4.0 / 5.0

This entity provides significant explanatory value by illustrating the counterintuitive principle that wage levels depend more on the rate of capital growth than absolute wealth accumulation. It serves as crucial empirical evidence that helps explain Smith's theoretical mechanism about labor demand and economic dynamics.

3.6 KiB Raw Blame History