Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.7 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

artificers_and_retailers

null

2026-02-23T00:35:15.020268

4.2

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition is quite precise, clearly identifying specific types of skilled workers (smiths, carpenters, etc.) and their function in serving agricultural communities. It avoids circularity and captures a distinct economic phenomenon of specialized service providers clustering around agricultural areas.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is well-grounded in Smith's actual text from Book III, Chapter 1, where he explicitly discusses how artificers and retailers naturally settle near agricultural areas to serve farmers' needs. The concept directly reflects Smith's analysis of how market towns emerge from agricultural development.

name	value	max_value	rationale
domain_placement	4.0	5.0	The "Production" domain assignment is appropriate since these workers are engaged in manufacturing and processing activities that transform raw materials into finished goods. While they also involve exchange/trade elements, their primary economic function is productive transformation.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	This entity maps reasonably well to S1 (primary operations) as these are the fundamental productive units that create value in the economy. However, the entity also has coordination aspects (S2) as it describes how different specialists coordinate to serve agricultural needs, making the VSM mapping somewhat ambiguous.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This entity provides excellent explanatory power by illuminating the mechanism through which agricultural surplus enables urban development and division of labor. It reveals the structural relationship between agricultural productivity and the emergence of specialized manufacturing and service sectors.

Evaluation: Artificers And Retailers

definition_precision — 4.0 / 5.0

The definition is quite precise, clearly identifying specific types of skilled workers (smiths, carpenters, etc.) and their function in serving agricultural communities. It avoids circularity and captures a distinct economic phenomenon of specialized service providers clustering around agricultural areas.

source_grounding — 5.0 / 5.0

This entity is well-grounded in Smith's actual text from Book III, Chapter 1, where he explicitly discusses how artificers and retailers naturally settle near agricultural areas to serve farmers' needs. The concept directly reflects Smith's analysis of how market towns emerge from agricultural development.

domain_placement — 4.0 / 5.0

The "Production" domain assignment is appropriate since these workers are engaged in manufacturing and processing activities that transform raw materials into finished goods. While they also involve exchange/trade elements, their primary economic function is productive transformation.

vsm_relevance — 3.0 / 5.0

This entity maps reasonably well to S1 (primary operations) as these are the fundamental productive units that create value in the economy. However, the entity also has coordination aspects (S2) as it describes how different specialists coordinate to serve agricultural needs, making the VSM mapping somewhat ambiguous.

explanatory_value — 5.0 / 5.0

This entity provides excellent explanatory power by illuminating the mechanism through which agricultural surplus enables urban development and division of labor. It reveals the structural relationship between agricultural productivity and the emergence of specialized manufacturing and service sectors.

3.7 KiB Raw Blame History