Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.2 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

public_executioner

null

2026-02-23T06:12:42.329448

1.2

name	value	max_value	rationale
definition_precision	1.0	5.0	There is no definition provided at all, making it impossible to assess precision or conceptual distinctness. Without any definitional content, this entity fails to establish what concept it represents.

name	value	max_value	rationale
source_grounding	1.0	5.0	With no source chapter specified and no context provided, there is no evidence this entity is grounded in Smith's actual text. The term "public executioner" seems unlikely to be a significant concept in "The Wealth of Nations," which focuses on economic theory rather than criminal justice administration.

name	value	max_value	rationale
domain_placement	1.0	5.0	The domain is unspecified, and "public executioner" appears to be a role in criminal justice rather than economics. This entity seems fundamentally misplaced in an economic infospace about "The Wealth of Nations."

name	value	max_value	rationale
vsm_relevance	2.0	5.0	While a public executioner could theoretically be mapped to S1 (operational role in a justice system), this mapping would be forced and artificial given the economic focus of the source material. The entity lacks clear relevance to organizational cybernetics in Smith's economic context.

name	value	max_value	rationale
explanatory_value	1.0	5.0	Without definition, context, or clear connection to economic mechanisms, this entity provides no explanatory power regarding Smith's economic theories. It appears to be an orphaned concept that illuminates nothing about wealth creation, market dynamics, or economic structure.

Evaluation: Public Executioner

definition_precision — 1.0 / 5.0

There is no definition provided at all, making it impossible to assess precision or conceptual distinctness. Without any definitional content, this entity fails to establish what concept it represents.

source_grounding — 1.0 / 5.0

With no source chapter specified and no context provided, there is no evidence this entity is grounded in Smith's actual text. The term "public executioner" seems unlikely to be a significant concept in "The Wealth of Nations," which focuses on economic theory rather than criminal justice administration.

domain_placement — 1.0 / 5.0

The domain is unspecified, and "public executioner" appears to be a role in criminal justice rather than economics. This entity seems fundamentally misplaced in an economic infospace about "The Wealth of Nations."

vsm_relevance — 2.0 / 5.0

While a public executioner could theoretically be mapped to S1 (operational role in a justice system), this mapping would be forced and artificial given the economic focus of the source material. The entity lacks clear relevance to organizational cybernetics in Smith's economic context.

explanatory_value — 1.0 / 5.0

Without definition, context, or clear connection to economic mechanisms, this entity provides no explanatory power regarding Smith's economic theories. It appears to be an orphaned concept that illuminates nothing about wealth creation, market dynamics, or economic structure.

3.2 KiB Raw Blame History