Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

4.0 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

country_gentlemen_versus_merchants

null

2026-02-23T05:03:51.518593

4.4

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly distinguishes between two specific social groups (agricultural landowners vs. commercial merchants) and their contrasting approaches to trade policy. It captures a distinct conceptual contrast rather than being vague, though it could be slightly more precise about what constitutes "monopolistic thinking."

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is well-grounded in Smith's actual analysis in Book IV, Chapter 2, where he explicitly contrasts the political economy perspectives of country gentlemen and merchants. Smith does indeed argue that country gentlemen are generally less prone to supporting harmful monopolistic policies than merchants.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Regulation" domain assignment is highly appropriate since this entity directly concerns how different social groups influence trade policy and regulatory frameworks. The contrast between these groups is fundamentally about their different approaches to economic regulation and protection.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This entity maps well to S4 (intelligence/environmental adaptation) as it concerns how different groups process environmental information and adapt policy accordingly, and to S5 (identity/policy) regarding fundamental policy orientation. The contrast illuminates different systemic approaches to external adaptation.

name	value	max_value	rationale
explanatory_value	4.0	5.0	This entity provides genuine explanatory power by illuminating the structural mechanism behind different policy preferences—showing how economic position (land vs. commerce) shapes political orientation toward monopoly and free trade. It explains why certain groups support particular regulatory approaches rather than merely describing surface political differences.

Evaluation: Country Gentlemen Versus Merchants

definition_precision — 4.0 / 5.0

The definition clearly distinguishes between two specific social groups (agricultural landowners vs. commercial merchants) and their contrasting approaches to trade policy. It captures a distinct conceptual contrast rather than being vague, though it could be slightly more precise about what constitutes "monopolistic thinking."

source_grounding — 5.0 / 5.0

This entity is well-grounded in Smith's actual analysis in Book IV, Chapter 2, where he explicitly contrasts the political economy perspectives of country gentlemen and merchants. Smith does indeed argue that country gentlemen are generally less prone to supporting harmful monopolistic policies than merchants.

domain_placement — 5.0 / 5.0

The "Regulation" domain assignment is highly appropriate since this entity directly concerns how different social groups influence trade policy and regulatory frameworks. The contrast between these groups is fundamentally about their different approaches to economic regulation and protection.

vsm_relevance — 4.0 / 5.0

This entity maps well to S4 (intelligence/environmental adaptation) as it concerns how different groups process environmental information and adapt policy accordingly, and to S5 (identity/policy) regarding fundamental policy orientation. The contrast illuminates different systemic approaches to external adaptation.

explanatory_value — 4.0 / 5.0

This entity provides genuine explanatory power by illuminating the structural mechanism behind different policy preferences—showing how economic position (land vs. commerce) shapes political orientation toward monopoly and free trade. It explains why certain groups support particular regulatory approaches rather than merely describing surface political differences.

4.0 KiB Raw Blame History