Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.2 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

weighing

null

2026-02-23T06:38:53.370280

1.0

name	value	max_value	rationale
definition_precision	1.0	5.0	There is no definition provided whatsoever, making it impossible to assess what specific concept "weighing" refers to in this context. Without any definitional content, this entity lacks the precision needed for meaningful analysis.

name	value	max_value	rationale
source_grounding	1.0	5.0	With no definition, context, or source chapter specified, there is no evidence that this entity is grounded in Smith's actual text. The term "weighing" is too generic to assume it represents a distinct concept from The Wealth of Nations without proper documentation.

name	value	max_value	rationale
domain_placement	1.0	5.0	The domain is listed as "unspecified," indicating no clear economic or thematic categorization has been established. Without knowing what type of "weighing" this refers to (physical measurement, deliberation, comparison, etc.), proper domain placement is impossible.

name	value	max_value	rationale
vsm_relevance	1.0	5.0	The complete absence of definitional content makes it impossible to determine whether this entity relates to any VSM system or organizational function. "Weighing" could theoretically relate to various systems depending on its specific meaning, but no such meaning is provided.

name	value	max_value	rationale
explanatory_value	1.0	5.0	An undefined entity with no context cannot illuminate any mechanisms or structural relations from Smith's work. This entry currently adds no explanatory power to understanding The Wealth of Nations or its mapping to the VSM.

Evaluation: Weighing

definition_precision — 1.0 / 5.0

There is no definition provided whatsoever, making it impossible to assess what specific concept "weighing" refers to in this context. Without any definitional content, this entity lacks the precision needed for meaningful analysis.

source_grounding — 1.0 / 5.0

With no definition, context, or source chapter specified, there is no evidence that this entity is grounded in Smith's actual text. The term "weighing" is too generic to assume it represents a distinct concept from The Wealth of Nations without proper documentation.

domain_placement — 1.0 / 5.0

The domain is listed as "unspecified," indicating no clear economic or thematic categorization has been established. Without knowing what type of "weighing" this refers to (physical measurement, deliberation, comparison, etc.), proper domain placement is impossible.

vsm_relevance — 1.0 / 5.0

The complete absence of definitional content makes it impossible to determine whether this entity relates to any VSM system or organizational function. "Weighing" could theoretically relate to various systems depending on its specific meaning, but no such meaning is provided.

explanatory_value — 1.0 / 5.0

An undefined entity with no context cannot illuminate any mechanisms or structural relations from Smith's work. This entry currently adds no explanatory power to understanding The Wealth of Nations or its mapping to the VSM.

3.2 KiB Raw Blame History