Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.9 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

human_folly_injustice_exposure

null

2026-02-23T05:35:29.156080

4.0

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly identifies a specific type of risk exposure in foreign trade, distinguishing it from other forms of business risk by focusing on the uncontrollable nature of human error and injustice in international contexts. It avoids circularity and captures a distinct vulnerability that merchants face.

name	value	max_value	rationale
source_grounding	4.0	5.0	This concept is well-grounded in Smith's discussion of why foreign trade is less secure than domestic investments, where he explicitly discusses the risks of human folly and injustice that merchants cannot control. The entity accurately reflects Smith's analysis of the security gradient across different forms of capital employment.

name	value	max_value	rationale
domain_placement	5.0	5.0	The placement in the "Accumulation" domain is correct, as this concept directly relates to capital allocation decisions and the factors that influence where investors choose to deploy their resources. It fits naturally within Smith's broader analysis of capital accumulation patterns.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	This entity has moderate VSM relevance, primarily relating to S4 (intelligence/environmental adaptation) as it concerns external threats and environmental uncertainties that organizations must monitor. However, it's somewhat abstract and doesn't map as clearly to specific VSM functions as more operational concepts would.

name	value	max_value	rationale
explanatory_value	4.0	5.0	The entity provides genuine explanatory power by illuminating why rational investors prefer domestic over foreign investments, helping explain the structural mechanism behind Smith's "natural order" of economic development. It reveals an important causal factor in capital allocation behavior rather than merely describing surface phenomena.

Evaluation: Human Folly Injustice Exposure

definition_precision — 4.0 / 5.0

The definition clearly identifies a specific type of risk exposure in foreign trade, distinguishing it from other forms of business risk by focusing on the uncontrollable nature of human error and injustice in international contexts. It avoids circularity and captures a distinct vulnerability that merchants face.

source_grounding — 4.0 / 5.0

This concept is well-grounded in Smith's discussion of why foreign trade is less secure than domestic investments, where he explicitly discusses the risks of human folly and injustice that merchants cannot control. The entity accurately reflects Smith's analysis of the security gradient across different forms of capital employment.

domain_placement — 5.0 / 5.0

The placement in the "Accumulation" domain is correct, as this concept directly relates to capital allocation decisions and the factors that influence where investors choose to deploy their resources. It fits naturally within Smith's broader analysis of capital accumulation patterns.

vsm_relevance — 3.0 / 5.0

This entity has moderate VSM relevance, primarily relating to S4 (intelligence/environmental adaptation) as it concerns external threats and environmental uncertainties that organizations must monitor. However, it's somewhat abstract and doesn't map as clearly to specific VSM functions as more operational concepts would.

explanatory_value — 4.0 / 5.0

The entity provides genuine explanatory power by illuminating why rational investors prefer domestic over foreign investments, helping explain the structural mechanism behind Smith's "natural order" of economic development. It reveals an important causal factor in capital allocation behavior rather than merely describing surface phenomena.

3.9 KiB Raw Blame History