Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.5 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

society_s_general_stock

null

2026-02-23T06:22:40.380997

4.0

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition is clear and precise, establishing that society's general stock is the aggregate of all individual stocks and divides into the same three categories (consumption, fixed capital, circulating capital). It avoids circularity by building on the previously established concept of individual stock.

name	value	max_value	rationale
source_grounding	5.0	5.0	This concept is directly grounded in Book II, Chapter 1 of The Wealth of Nations, where Smith explicitly extends his analysis from individual stock to the aggregate stock of society. The three-part division is a central organizing principle in Smith's capital theory.

name	value	max_value	rationale
domain_placement	5.0	5.0	"General Theory" is the appropriate domain placement as this concept represents a fundamental theoretical framework that underlies Smith's entire analysis of national wealth and capital formation. It's a foundational macroeconomic concept rather than a specific mechanism.

name	value	max_value	rationale
vsm_relevance	2.0	5.0	This entity is too abstract and foundational to map naturally to specific VSM systems. It represents the total resource base of the economic system rather than any particular operational, regulatory, or intelligence function within the viable system framework.

name	value	max_value	rationale
explanatory_value	4.0	5.0	This entity provides significant explanatory value by establishing the conceptual bridge between individual economic behavior and national economic analysis. It illuminates how aggregate wealth formation follows the same structural principles as individual wealth, enabling systematic analysis of national economic development.

Evaluation: Society S General Stock

definition_precision — 4.0 / 5.0

The definition is clear and precise, establishing that society's general stock is the aggregate of all individual stocks and divides into the same three categories (consumption, fixed capital, circulating capital). It avoids circularity by building on the previously established concept of individual stock.

source_grounding — 5.0 / 5.0

This concept is directly grounded in Book II, Chapter 1 of The Wealth of Nations, where Smith explicitly extends his analysis from individual stock to the aggregate stock of society. The three-part division is a central organizing principle in Smith's capital theory.

domain_placement — 5.0 / 5.0

"General Theory" is the appropriate domain placement as this concept represents a fundamental theoretical framework that underlies Smith's entire analysis of national wealth and capital formation. It's a foundational macroeconomic concept rather than a specific mechanism.

vsm_relevance — 2.0 / 5.0

This entity is too abstract and foundational to map naturally to specific VSM systems. It represents the total resource base of the economic system rather than any particular operational, regulatory, or intelligence function within the viable system framework.

explanatory_value — 4.0 / 5.0

This entity provides significant explanatory value by establishing the conceptual bridge between individual economic behavior and national economic analysis. It illuminates how aggregate wealth formation follows the same structural principles as individual wealth, enabling systematic analysis of national economic development.

3.5 KiB Raw Blame History