Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.4 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

smuggling_trade

null

2026-02-23T06:22:14.006607

4.2

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly distinguishes smuggling as illegal cross-border transportation to avoid duties, with specific characteristics (high risk, high potential profit). It avoids circularity and captures a distinct economic phenomenon rather than a vague concept.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's text from Book I, Chapter 10, where he explicitly discusses smuggling as an example of how risk affects profit levels. The description accurately reflects Smith's analysis of competition among smugglers and risk-return relationships.

name	value	max_value	rationale
domain_placement	5.0	5.0	"Exchange" is the correct domain placement since smuggling represents a form of trade/exchange activity, albeit illegal. It fundamentally involves the movement and exchange of goods across markets, fitting naturally within exchange mechanisms.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	Smuggling has some VSM relevance as it represents an S1 operational activity (actual trade execution) that responds to S4 intelligence (market opportunities and regulatory gaps). However, it's more of a specific trade practice than a core organizational system component.

name	value	max_value	rationale
explanatory_value	4.0	5.0	This entity provides genuine explanatory value by illustrating Smith's broader principle about risk-return relationships in markets and how competition operates even in illegal trades. It demonstrates how market mechanisms function across different regulatory contexts, offering insight into fundamental economic dynamics.

Evaluation: Smuggling Trade

definition_precision — 4.0 / 5.0

The definition clearly distinguishes smuggling as illegal cross-border transportation to avoid duties, with specific characteristics (high risk, high potential profit). It avoids circularity and captures a distinct economic phenomenon rather than a vague concept.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's text from Book I, Chapter 10, where he explicitly discusses smuggling as an example of how risk affects profit levels. The description accurately reflects Smith's analysis of competition among smugglers and risk-return relationships.

domain_placement — 5.0 / 5.0

"Exchange" is the correct domain placement since smuggling represents a form of trade/exchange activity, albeit illegal. It fundamentally involves the movement and exchange of goods across markets, fitting naturally within exchange mechanisms.

vsm_relevance — 3.0 / 5.0

Smuggling has some VSM relevance as it represents an S1 operational activity (actual trade execution) that responds to S4 intelligence (market opportunities and regulatory gaps). However, it's more of a specific trade practice than a core organizational system component.

explanatory_value — 4.0 / 5.0

This entity provides genuine explanatory value by illustrating Smith's broader principle about risk-return relationships in markets and how competition operates even in illegal trades. It demonstrates how market mechanisms function across different regulatory contexts, offering insight into fundamental economic dynamics.

3.4 KiB Raw Blame History