Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.8 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

commercial_interactions

null

2026-02-23T04:58:26.506484

4.4

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly distinguishes commercial interactions from self-sufficient production and identifies the key characteristic of exchange-based relationships. It avoids circularity by defining the concept in terms of its functional role in transforming social organization.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's analysis in Book I, Chapter 4, where he explicitly describes how division of labor creates a society where "every man thus lives by exchanging" and becomes "in some measure a merchant." The concept captures Smith's core insight about the transformation from self-sufficiency to commercial society.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Exchange" domain is the perfect conceptual home for this entity, as commercial interactions are fundamentally about the mechanisms and patterns of exchange that replace direct production for consumption. This placement accurately reflects the entity's role in Smith's economic framework.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	Commercial interactions span multiple VSM systems rather than mapping to a single one—they involve S1 operations (actual exchanges), S2 coordination (market mechanisms), and S4 intelligence (price signals and market information). This broad relevance makes VSM placement useful but not precise.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This entity illuminates a fundamental structural transformation in Smith's theory—how division of labor necessitates and creates a web of interdependent exchange relationships that become the organizing principle of commercial society. It explains the mechanism by which specialization leads to social coordination through markets.

Evaluation: Commercial Interactions

definition_precision — 4.0 / 5.0

The definition clearly distinguishes commercial interactions from self-sufficient production and identifies the key characteristic of exchange-based relationships. It avoids circularity by defining the concept in terms of its functional role in transforming social organization.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's analysis in Book I, Chapter 4, where he explicitly describes how division of labor creates a society where "every man thus lives by exchanging" and becomes "in some measure a merchant." The concept captures Smith's core insight about the transformation from self-sufficiency to commercial society.

domain_placement — 5.0 / 5.0

The "Exchange" domain is the perfect conceptual home for this entity, as commercial interactions are fundamentally about the mechanisms and patterns of exchange that replace direct production for consumption. This placement accurately reflects the entity's role in Smith's economic framework.

vsm_relevance — 3.0 / 5.0

Commercial interactions span multiple VSM systems rather than mapping to a single one—they involve S1 operations (actual exchanges), S2 coordination (market mechanisms), and S4 intelligence (price signals and market information). This broad relevance makes VSM placement useful but not precise.

explanatory_value — 5.0 / 5.0

This entity illuminates a fundamental structural transformation in Smith's theory—how division of labor necessitates and creates a web of interdependent exchange relationships that become the organizing principle of commercial society. It explains the mechanism by which specialization leads to social coordination through markets.

3.8 KiB Raw Blame History