Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.4 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

smuggling

null

2026-02-23T06:22:23.004386

4.2

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly captures smuggling as illegal trade to avoid duties/prohibitions, which is precise and non-circular. It could be slightly more specific about the economic mechanisms involved, but adequately distinguishes this concept from general trade.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's discussion of Spanish and Portuguese prohibitions on precious metal exports and the resulting smuggling activities. The context accurately reflects Smith's analysis of how trade restrictions create black market opportunities.

name	value	max_value	rationale
domain_placement	5.0	5.0	"Exchange" is the correct domain placement since smuggling represents an alternative form of trade exchange that emerges when official exchange channels are restricted. This fits naturally within Smith's broader analysis of trade mechanisms.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	Smuggling maps moderately well to S1 (as an alternative operational channel) and S4 (as environmental adaptation to regulatory constraints), but it's not a core VSM concept. It represents more of a pathological response to system constraints than a fundamental organizational function.

name	value	max_value	rationale
explanatory_value	4.0	5.0	This entity illuminates an important economic mechanism - how excessive restrictions create alternative channels that can undermine the original policy goals. It demonstrates Smith's insight about unintended consequences of trade prohibitions, adding genuine analytical value beyond mere description.

Evaluation: Smuggling

definition_precision — 4.0 / 5.0

The definition clearly captures smuggling as illegal trade to avoid duties/prohibitions, which is precise and non-circular. It could be slightly more specific about the economic mechanisms involved, but adequately distinguishes this concept from general trade.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's discussion of Spanish and Portuguese prohibitions on precious metal exports and the resulting smuggling activities. The context accurately reflects Smith's analysis of how trade restrictions create black market opportunities.

domain_placement — 5.0 / 5.0

"Exchange" is the correct domain placement since smuggling represents an alternative form of trade exchange that emerges when official exchange channels are restricted. This fits naturally within Smith's broader analysis of trade mechanisms.

vsm_relevance — 3.0 / 5.0

Smuggling maps moderately well to S1 (as an alternative operational channel) and S4 (as environmental adaptation to regulatory constraints), but it's not a core VSM concept. It represents more of a pathological response to system constraints than a fundamental organizational function.

explanatory_value — 4.0 / 5.0

This entity illuminates an important economic mechanism - how excessive restrictions create alternative channels that can undermine the original policy goals. It demonstrates Smith's insight about unintended consequences of trade prohibitions, adding genuine analytical value beyond mere description.

3.4 KiB Raw Blame History