Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

4.1 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

hanseatic_league

null

2026-02-23T05:34:20.444648

4.6

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly identifies the Hanseatic League as a specific historical confederation with distinct characteristics (commercial/defensive, merchant guilds, Northwestern/Central Europe, medieval period). It avoids circularity and captures the essential nature of this economic organization, though it could be slightly more precise about the League's operational mechanisms.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's text from Book III, Chapter 3, where he explicitly discusses the Hanseatic League as an example of free towns gaining economic power during weak central authority. The context accurately reflects Smith's use of the League to illustrate his broader argument about urban commercial development.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Exchange" domain is perfectly appropriate for the Hanseatic League, as it was fundamentally a trading confederation that facilitated commercial exchange across Northern Europe. The League's primary function was organizing and protecting trade networks, making it a quintessential exchange mechanism.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	The Hanseatic League maps well to multiple VSM systems: S1 (primary trading operations), S2 (coordination among member cities), S3 (internal regulation of trade standards), and S4 (adaptation to changing political/economic environments). It represents a viable system that maintained coherent identity and operations across diverse territories.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This entity provides excellent explanatory power by illustrating Smith's key mechanism of how commercial freedom and weak central authority can enable urban economic networks to flourish. It demonstrates the structural relationship between political decentralization and commercial innovation that Smith argues was crucial for economic development.

Evaluation: Hanseatic League

definition_precision — 4.0 / 5.0

The definition clearly identifies the Hanseatic League as a specific historical confederation with distinct characteristics (commercial/defensive, merchant guilds, Northwestern/Central Europe, medieval period). It avoids circularity and captures the essential nature of this economic organization, though it could be slightly more precise about the League's operational mechanisms.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's text from Book III, Chapter 3, where he explicitly discusses the Hanseatic League as an example of free towns gaining economic power during weak central authority. The context accurately reflects Smith's use of the League to illustrate his broader argument about urban commercial development.

domain_placement — 5.0 / 5.0

The "Exchange" domain is perfectly appropriate for the Hanseatic League, as it was fundamentally a trading confederation that facilitated commercial exchange across Northern Europe. The League's primary function was organizing and protecting trade networks, making it a quintessential exchange mechanism.

vsm_relevance — 4.0 / 5.0

The Hanseatic League maps well to multiple VSM systems: S1 (primary trading operations), S2 (coordination among member cities), S3 (internal regulation of trade standards), and S4 (adaptation to changing political/economic environments). It represents a viable system that maintained coherent identity and operations across diverse territories.

explanatory_value — 5.0 / 5.0

This entity provides excellent explanatory power by illustrating Smith's key mechanism of how commercial freedom and weak central authority can enable urban economic networks to flourish. It demonstrates the structural relationship between political decentralization and commercial innovation that Smith argues was crucial for economic development.

4.1 KiB Raw Blame History