Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.4 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

economic_system_change_agent

null

2026-02-23T05:13:33.696760

2.0

name	value	max_value	rationale
definition_precision	2.0	5.0	The definition is overly broad and umbrella-like, encompassing "individuals, groups, or forces" without clear boundaries. It lacks precision in distinguishing between different types of change agents or specifying what constitutes meaningful economic system change versus routine adjustments.

name	value	max_value	rationale
source_grounding	2.0	5.0	While Smith does discuss different economic systems and their evolution, he does not explicitly theorize about "change agents" as a distinct category of actors. This appears to impose modern social science terminology onto Smith's work rather than emerging from his actual analysis.

name	value	max_value	rationale
domain_placement	3.0	5.0	"General Theory" is appropriate given the broad conceptual nature, though the entity is so abstract it could arguably fit in multiple domains. The placement is reasonable but reflects the entity's lack of specificity rather than clear thematic grounding.

name	value	max_value	rationale
vsm_relevance	1.0	5.0	This entity is too abstract and diffuse to map meaningfully to any specific VSM system, as it could theoretically operate across all systems depending on the type of change being initiated. It lacks the structural specificity needed for VSM analysis.

name	value	max_value	rationale
explanatory_value	2.0	5.0	The entity names a general phenomenon but provides little explanatory power about how economic change actually occurs or what mechanisms drive system transformation. It remains at the surface level without illuminating underlying structural relations or processes.

Evaluation: Economic System Change Agent

definition_precision — 2.0 / 5.0

The definition is overly broad and umbrella-like, encompassing "individuals, groups, or forces" without clear boundaries. It lacks precision in distinguishing between different types of change agents or specifying what constitutes meaningful economic system change versus routine adjustments.

source_grounding — 2.0 / 5.0

While Smith does discuss different economic systems and their evolution, he does not explicitly theorize about "change agents" as a distinct category of actors. This appears to impose modern social science terminology onto Smith's work rather than emerging from his actual analysis.

domain_placement — 3.0 / 5.0

"General Theory" is appropriate given the broad conceptual nature, though the entity is so abstract it could arguably fit in multiple domains. The placement is reasonable but reflects the entity's lack of specificity rather than clear thematic grounding.

vsm_relevance — 1.0 / 5.0

This entity is too abstract and diffuse to map meaningfully to any specific VSM system, as it could theoretically operate across all systems depending on the type of change being initiated. It lacks the structural specificity needed for VSM analysis.

explanatory_value — 2.0 / 5.0

The entity names a general phenomenon but provides little explanatory power about how economic change actually occurs or what mechanisms drive system transformation. It remains at the surface level without illuminating underlying structural relations or processes.

3.4 KiB Raw Blame History