Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.1 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

principal_employments

null

2026-02-23T06:08:56.143097

1.2

name	value	max_value	rationale
definition_precision	1.0	5.0	There is no definition provided whatsoever, making this entity completely imprecise. Without any definitional content, it's impossible to assess whether this captures a distinct concept or represents a vague umbrella term.

name	value	max_value	rationale
source_grounding	1.0	5.0	With no source chapter specified and no definition or context provided, there's no evidence this entity is grounded in Smith's actual text. The term "principal employments" could refer to various concepts in The Wealth of Nations, but without specificity, it appears to be a floating abstraction.

name	value	max_value	rationale
domain_placement	1.0	5.0	The domain is listed as "unspecified," indicating no clear economic or thematic categorization has been established. Without knowing what specific employments or economic activities this refers to, proper domain placement is impossible.

name	value	max_value	rationale
vsm_relevance	2.0	5.0	While "principal employments" could potentially map to S1 (primary operations) if it refers to core economic activities, the complete lack of definition makes any VSM placement speculative. The term is too undefined to establish clear VSM relevance.

name	value	max_value	rationale
explanatory_value	1.0	5.0	This entity provides zero explanatory value in its current form, as it offers no definition, context, or mechanism to illuminate any aspect of Smith's economic theory. It's merely an empty label without analytical content.

Evaluation: Principal Employments

definition_precision — 1.0 / 5.0

There is no definition provided whatsoever, making this entity completely imprecise. Without any definitional content, it's impossible to assess whether this captures a distinct concept or represents a vague umbrella term.

source_grounding — 1.0 / 5.0

With no source chapter specified and no definition or context provided, there's no evidence this entity is grounded in Smith's actual text. The term "principal employments" could refer to various concepts in The Wealth of Nations, but without specificity, it appears to be a floating abstraction.

domain_placement — 1.0 / 5.0

The domain is listed as "unspecified," indicating no clear economic or thematic categorization has been established. Without knowing what specific employments or economic activities this refers to, proper domain placement is impossible.

vsm_relevance — 2.0 / 5.0

While "principal employments" could potentially map to S1 (primary operations) if it refers to core economic activities, the complete lack of definition makes any VSM placement speculative. The term is too undefined to establish clear VSM relevance.

explanatory_value — 1.0 / 5.0

This entity provides zero explanatory value in its current form, as it offers no definition, context, or mechanism to illuminate any aspect of Smith's economic theory. It's merely an empty label without analytical content.

3.1 KiB Raw Blame History