feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,67 @@
---
entity_slug: coarser_and_finer_materials
evaluator: null
evaluated_at: '2026-02-23T04:43:46.873829'
overall_score: 4.2
scores:
- name: definition_precision
value: 4.0
max_value: 5.0
rationale: The definition clearly distinguishes between coarser (less processed,
less valuable) and finer (more refined, more valuable) materials, establishing
a precise qualitative and economic distinction. The connection to capital requirements
adds specificity, though the definition could be slightly more concrete about
what constitutes "processing" or "refinement."
- name: source_grounding
value: 5.0
max_value: 5.0
rationale: This entity is directly grounded in Smith's text from Book I, Chapter
6, where he explicitly uses this comparison to illustrate how profits relate to
capital employed rather than labor supervision. The context provided accurately
reflects Smith's actual argument about manufacturing operations using different
quality materials.
- name: domain_placement
value: 5.0
max_value: 5.0
rationale: The "Production" domain assignment is entirely appropriate, as this concept
deals directly with manufacturing processes, raw material inputs, and the relationship
between material quality and capital requirements. This is fundamentally about
the production side of economic activity.
- name: vsm_relevance
value: 3.0
max_value: 5.0
rationale: This entity has moderate VSM relevance, primarily mapping to S1 (primary
operations) as it concerns the actual production processes and resource inputs.
However, it's somewhat VSM-neutral as it describes material characteristics rather
than organizational functions or information flows central to viable systems.
- name: explanatory_value
value: 4.0
max_value: 5.0
rationale: This entity provides genuine explanatory power by illuminating Smith's
mechanism for understanding profit distribution and capital allocation across
different types of manufacturing. It reveals a structural relationship between
material quality, capital requirements, and profit patterns that goes beyond surface-level
description.
---
# Evaluation: Coarser And Finer Materials
## definition_precision — 4.0 / 5.0
The definition clearly distinguishes between coarser (less processed, less valuable) and finer (more refined, more valuable) materials, establishing a precise qualitative and economic distinction. The connection to capital requirements adds specificity, though the definition could be slightly more concrete about what constitutes "processing" or "refinement."
## source_grounding — 5.0 / 5.0
This entity is directly grounded in Smith's text from Book I, Chapter 6, where he explicitly uses this comparison to illustrate how profits relate to capital employed rather than labor supervision. The context provided accurately reflects Smith's actual argument about manufacturing operations using different quality materials.
## domain_placement — 5.0 / 5.0
The "Production" domain assignment is entirely appropriate, as this concept deals directly with manufacturing processes, raw material inputs, and the relationship between material quality and capital requirements. This is fundamentally about the production side of economic activity.
## vsm_relevance — 3.0 / 5.0
This entity has moderate VSM relevance, primarily mapping to S1 (primary operations) as it concerns the actual production processes and resource inputs. However, it's somewhat VSM-neutral as it describes material characteristics rather than organizational functions or information flows central to viable systems.
## explanatory_value — 4.0 / 5.0
This entity provides genuine explanatory power by illuminating Smith's mechanism for understanding profit distribution and capital allocation across different types of manufacturing. It reveals a structural relationship between material quality, capital requirements, and profit patterns that goes beyond surface-level description.