Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.1 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

strategic_planning

null

2026-02-23T06:26:37.240407

1.2

name	value	max_value	rationale
definition_precision	1.0	5.0	There is no definition provided at all, making this entity completely imprecise. Without any definitional content, it's impossible to assess whether the concept is distinct or merely a vague umbrella term.

name	value	max_value	rationale
source_grounding	1.0	5.0	With no definition, context, or source chapter specified, there's no evidence this entity is grounded in Smith's actual text. "Strategic planning" as a modern business concept likely anachronistically imports 20th-century management terminology into 18th-century economic thought.

name	value	max_value	rationale
domain_placement	1.0	5.0	The domain is unspecified, making it impossible to assess correct placement. Without knowing what aspect of strategic planning this refers to or how it relates to Smith's economic framework, proper categorization is impossible.

name	value	max_value	rationale
vsm_relevance	2.0	5.0	Strategic planning could theoretically map to S4 (intelligence/environmental adaptation) or S5 (identity/policy) in the VSM, but without definition or context, any mapping would be purely speculative. The concept remains too abstract and undefined to establish clear VSM relevance.

name	value	max_value	rationale
explanatory_value	1.0	5.0	An undefined entity with no context provides zero explanatory power about Smith's economic mechanisms or structural relations. It appears to be merely a label without substance that could illuminate any aspect of "The Wealth of Nations."

Evaluation: Strategic Planning

definition_precision — 1.0 / 5.0

There is no definition provided at all, making this entity completely imprecise. Without any definitional content, it's impossible to assess whether the concept is distinct or merely a vague umbrella term.

source_grounding — 1.0 / 5.0

With no definition, context, or source chapter specified, there's no evidence this entity is grounded in Smith's actual text. "Strategic planning" as a modern business concept likely anachronistically imports 20th-century management terminology into 18th-century economic thought.

domain_placement — 1.0 / 5.0

The domain is unspecified, making it impossible to assess correct placement. Without knowing what aspect of strategic planning this refers to or how it relates to Smith's economic framework, proper categorization is impossible.

vsm_relevance — 2.0 / 5.0

Strategic planning could theoretically map to S4 (intelligence/environmental adaptation) or S5 (identity/policy) in the VSM, but without definition or context, any mapping would be purely speculative. The concept remains too abstract and undefined to establish clear VSM relevance.

explanatory_value — 1.0 / 5.0

An undefined entity with no context provides zero explanatory power about Smith's economic mechanisms or structural relations. It appears to be merely a label without substance that could illuminate any aspect of "The Wealth of Nations."

3.1 KiB Raw Blame History