feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,64 @@
---
entity_slug: artificer_servant_status
evaluator: null
evaluated_at: '2026-02-23T00:35:06.243951'
overall_score: 4.4
scores:
- name: definition_precision
value: 4.0
max_value: 5.0
rationale: The definition clearly distinguishes artificers as skilled craftsmen
dependent on customers for subsistence, contrasting them with independent agricultural
producers. The concept is well-bounded and non-circular, though it could be slightly
more precise about what constitutes "skilled craftsmen."
- name: source_grounding
value: 5.0
max_value: 5.0
rationale: This entity is directly grounded in Smith's discussion in Book III, Chapter
1, where he explicitly contrasts the dependent status of artificers with the independence
of agricultural producers and explains why artificers in colonies prefer to become
planters. The concept emerges clearly from the source text.
- name: domain_placement
value: 5.0
max_value: 5.0
rationale: '"General Theory" is the appropriate domain placement as this concept
addresses fundamental economic relationships between different types of producers
and their modes of subsistence. It represents a core theoretical distinction in
Smith''s analysis of economic development patterns.'
- name: vsm_relevance
value: 3.0
max_value: 5.0
rationale: This entity has moderate VSM relevance, potentially mapping to S1 (as
it describes primary economic operations and producer relationships) and S4 (as
it relates to adaptation patterns in colonial environments). However, it's more
of a structural economic relationship than a clear system function.
- name: explanatory_value
value: 5.0
max_value: 5.0
rationale: This entity provides significant explanatory power by illuminating the
mechanism behind occupational choices and economic development patterns in colonies.
It reveals how dependency relationships drive economic behavior and shape territorial
development, making it a valuable analytical concept.
---
# Evaluation: Artificer Servant Status
## definition_precision — 4.0 / 5.0
The definition clearly distinguishes artificers as skilled craftsmen dependent on customers for subsistence, contrasting them with independent agricultural producers. The concept is well-bounded and non-circular, though it could be slightly more precise about what constitutes "skilled craftsmen."
## source_grounding — 5.0 / 5.0
This entity is directly grounded in Smith's discussion in Book III, Chapter 1, where he explicitly contrasts the dependent status of artificers with the independence of agricultural producers and explains why artificers in colonies prefer to become planters. The concept emerges clearly from the source text.
## domain_placement — 5.0 / 5.0
"General Theory" is the appropriate domain placement as this concept addresses fundamental economic relationships between different types of producers and their modes of subsistence. It represents a core theoretical distinction in Smith's analysis of economic development patterns.
## vsm_relevance — 3.0 / 5.0
This entity has moderate VSM relevance, potentially mapping to S1 (as it describes primary economic operations and producer relationships) and S4 (as it relates to adaptation patterns in colonial environments). However, it's more of a structural economic relationship than a clear system function.
## explanatory_value — 5.0 / 5.0
This entity provides significant explanatory power by illuminating the mechanism behind occupational choices and economic development patterns in colonies. It reveals how dependency relationships drive economic behavior and shape territorial development, making it a valuable analytical concept.