Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.1 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

economic_identity

null

2026-02-23T05:10:55.402845

1.6

name	value	max_value	rationale
definition_precision	1.0	5.0	There is no definition provided at all, making this entity completely imprecise. Without any definition, it's impossible to determine what "Economic Identity" specifically refers to or how it differs from related concepts.

name	value	max_value	rationale
source_grounding	1.0	5.0	With no source chapter specified and no definition or context provided, there's no evidence this entity is grounded in Smith's actual text. "Economic Identity" appears to be a modern analytical construct rather than a concept Smith explicitly discussed.

name	value	max_value	rationale
domain_placement	2.0	5.0	While "Economic Identity" sounds like it should belong in an economic domain, without a definition it's unclear whether this is correctly categorized. The concept could potentially span multiple domains depending on what it actually refers to.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	The term "identity" suggests a natural connection to VSM System 5 (identity/policy), which deals with organizational identity and purpose. However, without a clear definition, it's impossible to confirm this mapping or rule out connections to other systems.

name	value	max_value	rationale
explanatory_value	1.0	5.0	An undefined entity provides zero explanatory value and cannot illuminate any mechanisms or structural relations. This appears to be an empty placeholder that adds no analytical insight to understanding Smith's work.

Evaluation: Economic Identity

definition_precision — 1.0 / 5.0

There is no definition provided at all, making this entity completely imprecise. Without any definition, it's impossible to determine what "Economic Identity" specifically refers to or how it differs from related concepts.

source_grounding — 1.0 / 5.0

With no source chapter specified and no definition or context provided, there's no evidence this entity is grounded in Smith's actual text. "Economic Identity" appears to be a modern analytical construct rather than a concept Smith explicitly discussed.

domain_placement — 2.0 / 5.0

While "Economic Identity" sounds like it should belong in an economic domain, without a definition it's unclear whether this is correctly categorized. The concept could potentially span multiple domains depending on what it actually refers to.

vsm_relevance — 3.0 / 5.0

The term "identity" suggests a natural connection to VSM System 5 (identity/policy), which deals with organizational identity and purpose. However, without a clear definition, it's impossible to confirm this mapping or rule out connections to other systems.

explanatory_value — 1.0 / 5.0

An undefined entity provides zero explanatory value and cannot illuminate any mechanisms or structural relations. This appears to be an empty placeholder that adds no analytical insight to understanding Smith's work.

3.1 KiB Raw Blame History