Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.6 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

improvement_of_the_country

null

2026-02-23T05:36:32.453434

3.4

name	value	max_value	rationale
definition_precision	3.0	5.0	The definition captures a distinct process of rural transformation but is somewhat sprawling, combining multiple mechanisms (cultivation, infrastructure, commercial wealth flows) without clearly delineating the core concept. It avoids circularity but could be more focused on what specifically constitutes "improvement."

name	value	max_value	rationale
source_grounding	4.0	5.0	This entity appears well-grounded in Smith's actual argument from Book III, Chapter 4 about how urban commerce transforms rural areas. The specific mechanisms mentioned (wealthy merchants becoming country gentlemen, urban wealth funding rural improvements) align with Smith's historical analysis.

name	value	max_value	rationale
domain_placement	4.0	5.0	Placement in "Production" domain is appropriate since this concerns the enhancement of agricultural productivity and land value. The entity fundamentally deals with improving the productive capacity of rural lands through better cultivation and management.

name	value	max_value	rationale
vsm_relevance	2.0	5.0	This entity represents a high-level outcome or emergent property rather than a specific systemic function, making it difficult to map to particular VSM systems. It's more of a meta-result that spans multiple systems rather than belonging naturally to S1-S5.

name	value	max_value	rationale
explanatory_value	4.0	5.0	The entity provides significant explanatory value by identifying the end result of Smith's three-mechanism theory of how commerce transforms rural society. It illuminates the structural relationship between urban wealth and rural development, showing how commercial activity ultimately reshapes the countryside.

Evaluation: Improvement Of The Country

definition_precision — 3.0 / 5.0

The definition captures a distinct process of rural transformation but is somewhat sprawling, combining multiple mechanisms (cultivation, infrastructure, commercial wealth flows) without clearly delineating the core concept. It avoids circularity but could be more focused on what specifically constitutes "improvement."

source_grounding — 4.0 / 5.0

This entity appears well-grounded in Smith's actual argument from Book III, Chapter 4 about how urban commerce transforms rural areas. The specific mechanisms mentioned (wealthy merchants becoming country gentlemen, urban wealth funding rural improvements) align with Smith's historical analysis.

domain_placement — 4.0 / 5.0

Placement in "Production" domain is appropriate since this concerns the enhancement of agricultural productivity and land value. The entity fundamentally deals with improving the productive capacity of rural lands through better cultivation and management.

vsm_relevance — 2.0 / 5.0

This entity represents a high-level outcome or emergent property rather than a specific systemic function, making it difficult to map to particular VSM systems. It's more of a meta-result that spans multiple systems rather than belonging naturally to S1-S5.

explanatory_value — 4.0 / 5.0

The entity provides significant explanatory value by identifying the end result of Smith's three-mechanism theory of how commerce transforms rural society. It illuminates the structural relationship between urban wealth and rural development, showing how commercial activity ultimately reshapes the countryside.

3.6 KiB Raw Blame History