Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.0 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

declining_manufacture

null

2026-02-23T05:05:08.920266

1.6

name	value	max_value	rationale
definition_precision	1.0	5.0	There is no definition provided at all, making it impossible to assess precision or distinctness. The entity appears to be merely a descriptive phrase without conceptual boundaries.

name	value	max_value	rationale
source_grounding	2.0	5.0	While Smith does discuss declining manufactures in various contexts (particularly regarding trade restrictions and economic policies), without a definition or source chapter, it's unclear whether this captures a specific concept from the text or is just a general descriptive term.

name	value	max_value	rationale
domain_placement	2.0	5.0	The domain is unspecified, which is problematic for an economic concept. "Declining manufacture" could belong to industrial economics, trade policy, or economic development domains, but without clarification, proper placement is impossible.

name	value	max_value	rationale
vsm_relevance	2.0	5.0	This could potentially relate to S1 (operational decline) or S4 (environmental adaptation failures), but without a clear definition of what constitutes "declining manufacture" or its systemic role, VSM mapping remains speculative.

name	value	max_value	rationale
explanatory_value	1.0	5.0	As currently formulated, this entity provides no explanatory power since it lacks definition, context, or mechanism. It appears to merely label a surface phenomenon without illuminating underlying economic structures or relationships.

Evaluation: Declining Manufacture

definition_precision — 1.0 / 5.0

There is no definition provided at all, making it impossible to assess precision or distinctness. The entity appears to be merely a descriptive phrase without conceptual boundaries.

source_grounding — 2.0 / 5.0

While Smith does discuss declining manufactures in various contexts (particularly regarding trade restrictions and economic policies), without a definition or source chapter, it's unclear whether this captures a specific concept from the text or is just a general descriptive term.

domain_placement — 2.0 / 5.0

The domain is unspecified, which is problematic for an economic concept. "Declining manufacture" could belong to industrial economics, trade policy, or economic development domains, but without clarification, proper placement is impossible.

vsm_relevance — 2.0 / 5.0

This could potentially relate to S1 (operational decline) or S4 (environmental adaptation failures), but without a clear definition of what constitutes "declining manufacture" or its systemic role, VSM mapping remains speculative.

explanatory_value — 1.0 / 5.0

As currently formulated, this entity provides no explanatory power since it lacks definition, context, or mechanism. It appears to merely label a surface phenomenon without illuminating underlying economic structures or relationships.

3.0 KiB Raw Blame History