Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.1 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

political_arithmetic

null

2026-02-23T06:06:52.089338

1.4

name	value	max_value	rationale
definition_precision	1.0	5.0	There is no definition provided at all, making it impossible to assess precision or distinctness. Without any definitional content, this entity fails to capture any concept in a meaningful way.

name	value	max_value	rationale
source_grounding	2.0	5.0	While "political arithmetic" was a recognized term in Smith's era referring to early statistical analysis of economic and demographic data, the complete absence of definition and context makes it unclear how this relates to Smith's actual text. The term itself has historical legitimacy but lacks grounding in this specific implementation.

name	value	max_value	rationale
domain_placement	1.0	5.0	With no specified domain and no definition, it's impossible to assess whether the domain assignment is correct. The entity provides no information to evaluate its proper conceptual categorization.

name	value	max_value	rationale
vsm_relevance	2.0	5.0	Political arithmetic, as a method of economic measurement and analysis, could potentially map to S4 (intelligence/environmental adaptation) since it involves gathering and analyzing data about economic conditions. However, without proper definition and context, this mapping remains speculative.

name	value	max_value	rationale
explanatory_value	1.0	5.0	An undefined entity with no context provides zero explanatory power. It neither illuminates mechanisms nor structural relations, functioning merely as an empty label without substance.

Evaluation: Political Arithmetic

definition_precision — 1.0 / 5.0

There is no definition provided at all, making it impossible to assess precision or distinctness. Without any definitional content, this entity fails to capture any concept in a meaningful way.

source_grounding — 2.0 / 5.0

While "political arithmetic" was a recognized term in Smith's era referring to early statistical analysis of economic and demographic data, the complete absence of definition and context makes it unclear how this relates to Smith's actual text. The term itself has historical legitimacy but lacks grounding in this specific implementation.

domain_placement — 1.0 / 5.0

With no specified domain and no definition, it's impossible to assess whether the domain assignment is correct. The entity provides no information to evaluate its proper conceptual categorization.

vsm_relevance — 2.0 / 5.0

Political arithmetic, as a method of economic measurement and analysis, could potentially map to S4 (intelligence/environmental adaptation) since it involves gathering and analyzing data about economic conditions. However, without proper definition and context, this mapping remains speculative.

explanatory_value — 1.0 / 5.0

An undefined entity with no context provides zero explanatory power. It neither illuminates mechanisms nor structural relations, functioning merely as an empty label without substance.

3.1 KiB Raw Blame History