Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.8 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

town_country_dependency

null

2026-02-23T06:32:24.768385

1.8

name	value	max_value	rationale
definition_precision	1.0	5.0	There is no definition provided at all, making it impossible to assess the precision or distinctness of the concept. Without any definitional content, this entity fails to establish what specific aspect of town-country relationships it addresses.

name	value	max_value	rationale
source_grounding	2.0	5.0	While Smith does discuss the relationship between towns and countryside in "The Wealth of Nations," the entity provides no context or chapter reference to demonstrate how this concept is actually grounded in the source text. The lack of supporting material makes it unclear whether this represents Smith's actual analysis or an imposed interpretation.

name	value	max_value	rationale
domain_placement	3.0	5.0	The concept of town-country dependency is economically relevant to Smith's work, as he examines urban-rural economic relationships, trade patterns, and mutual dependence. However, without a clear definition or domain specification, it's difficult to assess whether the thematic categorization is appropriate.

name	value	max_value	rationale
vsm_relevance	2.0	5.0	Town-country dependency could potentially map to multiple VSM systems (S1 for operational exchanges, S4 for environmental adaptation), but without a clear definition of what type of dependency is meant, it remains too vague to place meaningfully within the VSM framework. The concept needs more specificity to determine its systemic role.

name	value	max_value	rationale
explanatory_value	1.0	5.0	As currently presented, this entity provides no explanatory power since it lacks both definition and context. It merely names a broad phenomenon without illuminating any specific mechanisms, causal relationships, or structural dynamics that would enhance understanding of Smith's economic theory.

Evaluation: Town Country Dependency

definition_precision — 1.0 / 5.0

There is no definition provided at all, making it impossible to assess the precision or distinctness of the concept. Without any definitional content, this entity fails to establish what specific aspect of town-country relationships it addresses.

source_grounding — 2.0 / 5.0

While Smith does discuss the relationship between towns and countryside in "The Wealth of Nations," the entity provides no context or chapter reference to demonstrate how this concept is actually grounded in the source text. The lack of supporting material makes it unclear whether this represents Smith's actual analysis or an imposed interpretation.

domain_placement — 3.0 / 5.0

The concept of town-country dependency is economically relevant to Smith's work, as he examines urban-rural economic relationships, trade patterns, and mutual dependence. However, without a clear definition or domain specification, it's difficult to assess whether the thematic categorization is appropriate.

vsm_relevance — 2.0 / 5.0

Town-country dependency could potentially map to multiple VSM systems (S1 for operational exchanges, S4 for environmental adaptation), but without a clear definition of what type of dependency is meant, it remains too vague to place meaningfully within the VSM framework. The concept needs more specificity to determine its systemic role.

explanatory_value — 1.0 / 5.0

As currently presented, this entity provides no explanatory power since it lacks both definition and context. It merely names a broad phenomenon without illuminating any specific mechanisms, causal relationships, or structural dynamics that would enhance understanding of Smith's economic theory.

3.8 KiB Raw Blame History