feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,64 @@
---
entity_slug: artificers_and_retailers
evaluator: null
evaluated_at: '2026-02-23T00:35:15.020268'
overall_score: 4.2
scores:
- name: definition_precision
value: 4.0
max_value: 5.0
rationale: The definition is quite precise, clearly identifying specific types of
skilled workers (smiths, carpenters, etc.) and their function in serving agricultural
communities. It avoids circularity and captures a distinct economic phenomenon
of specialized service providers clustering around agricultural areas.
- name: source_grounding
value: 5.0
max_value: 5.0
rationale: This entity is well-grounded in Smith's actual text from Book III, Chapter
1, where he explicitly discusses how artificers and retailers naturally settle
near agricultural areas to serve farmers' needs. The concept directly reflects
Smith's analysis of how market towns emerge from agricultural development.
- name: domain_placement
value: 4.0
max_value: 5.0
rationale: The "Production" domain assignment is appropriate since these workers
are engaged in manufacturing and processing activities that transform raw materials
into finished goods. While they also involve exchange/trade elements, their primary
economic function is productive transformation.
- name: vsm_relevance
value: 3.0
max_value: 5.0
rationale: This entity maps reasonably well to S1 (primary operations) as these
are the fundamental productive units that create value in the economy. However,
the entity also has coordination aspects (S2) as it describes how different specialists
coordinate to serve agricultural needs, making the VSM mapping somewhat ambiguous.
- name: explanatory_value
value: 5.0
max_value: 5.0
rationale: This entity provides excellent explanatory power by illuminating the
mechanism through which agricultural surplus enables urban development and division
of labor. It reveals the structural relationship between agricultural productivity
and the emergence of specialized manufacturing and service sectors.
---
# Evaluation: Artificers And Retailers
## definition_precision — 4.0 / 5.0
The definition is quite precise, clearly identifying specific types of skilled workers (smiths, carpenters, etc.) and their function in serving agricultural communities. It avoids circularity and captures a distinct economic phenomenon of specialized service providers clustering around agricultural areas.
## source_grounding — 5.0 / 5.0
This entity is well-grounded in Smith's actual text from Book III, Chapter 1, where he explicitly discusses how artificers and retailers naturally settle near agricultural areas to serve farmers' needs. The concept directly reflects Smith's analysis of how market towns emerge from agricultural development.
## domain_placement — 4.0 / 5.0
The "Production" domain assignment is appropriate since these workers are engaged in manufacturing and processing activities that transform raw materials into finished goods. While they also involve exchange/trade elements, their primary economic function is productive transformation.
## vsm_relevance — 3.0 / 5.0
This entity maps reasonably well to S1 (primary operations) as these are the fundamental productive units that create value in the economy. However, the entity also has coordination aspects (S2) as it describes how different specialists coordinate to serve agricultural needs, making the VSM mapping somewhat ambiguous.
## explanatory_value — 5.0 / 5.0
This entity provides excellent explanatory power by illuminating the mechanism through which agricultural surplus enables urban development and division of labor. It reveals the structural relationship between agricultural productivity and the emergence of specialized manufacturing and service sectors.