Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.0 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

capital_security_visibility

null

2026-02-23T04:41:28.176869

1.2

name	value	max_value	rationale
definition_precision	1.0	5.0	There is no definition provided at all, making it impossible to assess precision or conceptual distinctness. The term "Capital Security Visibility" appears to be a compound phrase without clear boundaries or meaning.

name	value	max_value	rationale
source_grounding	1.0	5.0	With no definition, context, or source chapter specified, there is no evidence this entity is grounded in Smith's actual text. The terminology feels modern and potentially anachronistic for 18th-century economic discourse.

name	value	max_value	rationale
domain_placement	1.0	5.0	Without a specified domain or definition, it's impossible to assess whether the entity is correctly categorized. The entity appears to be a placeholder or incomplete entry rather than a properly classified concept.

name	value	max_value	rationale
vsm_relevance	2.0	5.0	While "visibility" could theoretically relate to VSM information flows (particularly S3 audit or S4 intelligence functions), the lack of definition makes any VSM mapping purely speculative. The term suggests monitoring or transparency mechanisms but provides no concrete basis for system assignment.

name	value	max_value	rationale
explanatory_value	1.0	5.0	An undefined entity cannot provide explanatory power or illuminate any mechanisms. This appears to be an empty conceptual container that adds no analytical value to understanding Smith's work or economic systems.

Evaluation: Capital Security Visibility

definition_precision — 1.0 / 5.0

There is no definition provided at all, making it impossible to assess precision or conceptual distinctness. The term "Capital Security Visibility" appears to be a compound phrase without clear boundaries or meaning.

source_grounding — 1.0 / 5.0

With no definition, context, or source chapter specified, there is no evidence this entity is grounded in Smith's actual text. The terminology feels modern and potentially anachronistic for 18th-century economic discourse.

domain_placement — 1.0 / 5.0

Without a specified domain or definition, it's impossible to assess whether the entity is correctly categorized. The entity appears to be a placeholder or incomplete entry rather than a properly classified concept.

vsm_relevance — 2.0 / 5.0

While "visibility" could theoretically relate to VSM information flows (particularly S3 audit or S4 intelligence functions), the lack of definition makes any VSM mapping purely speculative. The term suggests monitoring or transparency mechanisms but provides no concrete basis for system assignment.

explanatory_value — 1.0 / 5.0

An undefined entity cannot provide explanatory power or illuminate any mechanisms. This appears to be an empty conceptual container that adds no analytical value to understanding Smith's work or economic systems.

3.0 KiB Raw Blame History