Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.1 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

public_tranquillity

null

2026-02-23T06:14:21.921458

1.6

name	value	max_value	rationale
definition_precision	1.0	5.0	There is no definition provided at all, making it impossible to assess precision or distinctness. Without any definitional content, this entity fails to establish what concept it represents.

name	value	max_value	rationale
source_grounding	2.0	5.0	While "public tranquillity" appears as a phrase in Smith's work, particularly in discussions of justice and government functions, the complete absence of context and definition makes it unclear whether this entity accurately represents Smith's usage. The term exists in the source but lacks proper grounding in this representation.

name	value	max_value	rationale
domain_placement	1.0	5.0	With no specified domain and no definition or context, it's impossible to assess whether the entity is correctly categorized. The domain placement is entirely absent rather than correct or incorrect.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	Public tranquillity as a concept could potentially map to S3 (internal regulation) or S5 (policy/identity) systems in VSM terms, as it relates to social order and governance functions. However, without proper definition and context, this mapping remains speculative.

name	value	max_value	rationale
explanatory_value	1.0	5.0	In its current form with no definition, context, or domain specification, this entity provides zero explanatory value. It merely presents a label without illuminating any mechanisms, relationships, or structural elements from Smith's work.

Evaluation: Public Tranquillity

definition_precision — 1.0 / 5.0

There is no definition provided at all, making it impossible to assess precision or distinctness. Without any definitional content, this entity fails to establish what concept it represents.

source_grounding — 2.0 / 5.0

While "public tranquillity" appears as a phrase in Smith's work, particularly in discussions of justice and government functions, the complete absence of context and definition makes it unclear whether this entity accurately represents Smith's usage. The term exists in the source but lacks proper grounding in this representation.

domain_placement — 1.0 / 5.0

With no specified domain and no definition or context, it's impossible to assess whether the entity is correctly categorized. The domain placement is entirely absent rather than correct or incorrect.

vsm_relevance — 3.0 / 5.0

Public tranquillity as a concept could potentially map to S3 (internal regulation) or S5 (policy/identity) systems in VSM terms, as it relates to social order and governance functions. However, without proper definition and context, this mapping remains speculative.

explanatory_value — 1.0 / 5.0

In its current form with no definition, context, or domain specification, this entity provides zero explanatory value. It merely presents a label without illuminating any mechanisms, relationships, or structural elements from Smith's work.

3.1 KiB Raw Blame History