Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.4 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

economic_system_relationship

null

2026-02-23T05:20:18.861411

2.2

name	value	max_value	rationale
definition_precision	2.0	5.0	The definition is overly broad and vague, essentially describing "how economic systems relate to each other and everything else." It lacks specificity about what constitutes these "connections and interactions" and reads more like a general category than a distinct analytical concept.

name	value	max_value	rationale
source_grounding	2.0	5.0	While Smith does compare different economic systems (mercantilism vs. natural liberty), the entity extrapolates this into a meta-concept about "economic system relationships" that Smith doesn't explicitly theorize. The context statement acknowledges this is based on implications rather than direct textual support.

name	value	max_value	rationale
domain_placement	3.0	5.0	"General Theory" is appropriate given the broad, meta-analytical nature of this concept, though the vagueness of the entity makes any domain placement somewhat arbitrary. It doesn't fit neatly into more specific economic domains like trade or production.

name	value	max_value	rationale
vsm_relevance	2.0	5.0	This entity is too abstract and meta-theoretical to map meaningfully to specific VSM systems. It operates at a level above the VSM framework, describing relationships between entire systems rather than functional components within a viable system.

name	value	max_value	rationale
explanatory_value	2.0	5.0	The entity provides minimal explanatory power, functioning more as a descriptive label than an analytical tool. It doesn't illuminate specific mechanisms or structural relations but rather names the general phenomenon that economic systems can be compared and contrasted.

Evaluation: Economic System Relationship

definition_precision — 2.0 / 5.0

The definition is overly broad and vague, essentially describing "how economic systems relate to each other and everything else." It lacks specificity about what constitutes these "connections and interactions" and reads more like a general category than a distinct analytical concept.

source_grounding — 2.0 / 5.0

While Smith does compare different economic systems (mercantilism vs. natural liberty), the entity extrapolates this into a meta-concept about "economic system relationships" that Smith doesn't explicitly theorize. The context statement acknowledges this is based on implications rather than direct textual support.

domain_placement — 3.0 / 5.0

"General Theory" is appropriate given the broad, meta-analytical nature of this concept, though the vagueness of the entity makes any domain placement somewhat arbitrary. It doesn't fit neatly into more specific economic domains like trade or production.

vsm_relevance — 2.0 / 5.0

This entity is too abstract and meta-theoretical to map meaningfully to specific VSM systems. It operates at a level above the VSM framework, describing relationships between entire systems rather than functional components within a viable system.

explanatory_value — 2.0 / 5.0

The entity provides minimal explanatory power, functioning more as a descriptive label than an analytical tool. It doesn't illuminate specific mechanisms or structural relations but rather names the general phenomenon that economic systems can be compared and contrasted.

3.4 KiB Raw Blame History