Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.4 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

poacher

null

2026-02-23T06:06:26.552350

3.8

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition is clear and specific, identifying poachers as individuals who illegally hunt/fish on private property and connecting this to Smith's economic principle about agreeable work being poorly compensated. It captures a distinct concept rather than being vague or circular.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's text from Book I, Chapter 10, where he specifically uses poachers as an example to illustrate how natural enjoyment of certain activities creates labor oversupply and drives down wages. The connection to Smith's actual argument is explicit and accurate.

name	value	max_value	rationale
domain_placement	4.0	5.0	Placement in "Distribution" domain is appropriate since this relates to how wages are distributed based on the nature of employment and labor supply dynamics. The concept fits well within Smith's analysis of wage determination across different occupations.

name	value	max_value	rationale
vsm_relevance	2.0	5.0	This entity represents a specific example or case study rather than a systemic function, making it difficult to map naturally to any particular VSM system. It's more of an illustrative phenomenon than a structural component of an economic system.

name	value	max_value	rationale
explanatory_value	4.0	5.0	The entity illuminates an important economic mechanism - how intrinsic job satisfaction affects labor supply and wage levels - which is a key insight in Smith's theory of wage determination. It provides concrete illustration of abstract economic principles about employment compensation.

Evaluation: Poacher

definition_precision — 4.0 / 5.0

The definition is clear and specific, identifying poachers as individuals who illegally hunt/fish on private property and connecting this to Smith's economic principle about agreeable work being poorly compensated. It captures a distinct concept rather than being vague or circular.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's text from Book I, Chapter 10, where he specifically uses poachers as an example to illustrate how natural enjoyment of certain activities creates labor oversupply and drives down wages. The connection to Smith's actual argument is explicit and accurate.

domain_placement — 4.0 / 5.0

Placement in "Distribution" domain is appropriate since this relates to how wages are distributed based on the nature of employment and labor supply dynamics. The concept fits well within Smith's analysis of wage determination across different occupations.

vsm_relevance — 2.0 / 5.0

This entity represents a specific example or case study rather than a systemic function, making it difficult to map naturally to any particular VSM system. It's more of an illustrative phenomenon than a structural component of an economic system.

explanatory_value — 4.0 / 5.0

The entity illuminates an important economic mechanism - how intrinsic job satisfaction affects labor supply and wage levels - which is a key insight in Smith's theory of wage determination. It provides concrete illustration of abstract economic principles about employment compensation.

3.4 KiB Raw Blame History