Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.5 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

economic_geography

null

2026-02-23T05:10:47.268535

1.8

name	value	max_value	rationale
definition_precision	1.0	5.0	There is no definition provided at all, making this entity completely imprecise. Without any definitional content, it's impossible to assess whether this captures a distinct concept or represents a vague umbrella term.

name	value	max_value	rationale
source_grounding	2.0	5.0	While Smith does discuss geographical factors affecting trade, wealth distribution, and economic development throughout "The Wealth of Nations," the term "Economic Geography" as a formal discipline didn't exist in Smith's time. This appears to be a modern analytical overlay rather than a concept Smith himself articulated.

name	value	max_value	rationale
domain_placement	3.0	5.0	Economic geography could reasonably fit within economic analysis, but without a definition or specified domain, it's unclear whether this refers to spatial aspects of production, trade routes, resource distribution, or something else entirely. The unspecified domain makes proper placement impossible to evaluate.

name	value	max_value	rationale
vsm_relevance	2.0	5.0	Geographic considerations could potentially relate to S1 (operational locations), S4 (environmental intelligence about markets and resources), or even S2 (coordination across distances), but without definition or context, any VSM mapping would be purely speculative. The entity is too undefined to establish clear VSM relevance.

name	value	max_value	rationale
explanatory_value	1.0	5.0	With no definition, context, or source chapter specified, this entity provides zero explanatory value in its current form. It cannot illuminate any mechanisms or structural relations when it lacks any substantive content whatsoever.

Evaluation: Economic Geography

definition_precision — 1.0 / 5.0

There is no definition provided at all, making this entity completely imprecise. Without any definitional content, it's impossible to assess whether this captures a distinct concept or represents a vague umbrella term.

source_grounding — 2.0 / 5.0

While Smith does discuss geographical factors affecting trade, wealth distribution, and economic development throughout "The Wealth of Nations," the term "Economic Geography" as a formal discipline didn't exist in Smith's time. This appears to be a modern analytical overlay rather than a concept Smith himself articulated.

domain_placement — 3.0 / 5.0

Economic geography could reasonably fit within economic analysis, but without a definition or specified domain, it's unclear whether this refers to spatial aspects of production, trade routes, resource distribution, or something else entirely. The unspecified domain makes proper placement impossible to evaluate.

vsm_relevance — 2.0 / 5.0

Geographic considerations could potentially relate to S1 (operational locations), S4 (environmental intelligence about markets and resources), or even S2 (coordination across distances), but without definition or context, any VSM mapping would be purely speculative. The entity is too undefined to establish clear VSM relevance.

explanatory_value — 1.0 / 5.0

With no definition, context, or source chapter specified, this entity provides zero explanatory value in its current form. It cannot illuminate any mechanisms or structural relations when it lacks any substantive content whatsoever.

3.5 KiB Raw Blame History