Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.4 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

colonial_economic_system_learning

null

2026-02-23T04:49:21.533761

4.0

name	value	max_value	rationale
definition_precision	3.0	5.0	The definition captures a reasonably distinct concept about knowledge acquisition in colonial economies, but uses somewhat vague terms like "effective economic practices" and "better learning processes" without clear criteria for what constitutes effectiveness or improvement.

name	value	max_value	rationale
source_grounding	4.0	5.0	Smith does discuss learning and experimentation in colonial contexts, particularly emphasizing how market mechanisms provide better learning opportunities than monopolistic control systems. The entity appears well-grounded in his actual arguments about colonial economic development.

name	value	max_value	rationale
domain_placement	4.0	5.0	"General Theory" is appropriate as this concept spans multiple economic domains and represents a meta-level process about how economic knowledge develops. It's not specific to trade, production, or any particular economic sector.

name	value	max_value	rationale
vsm_relevance	5.0	5.0	This entity maps very naturally to S4 (intelligence/environmental adaptation) as it describes how colonial economic systems gather information about their environment and adapt their practices accordingly. It could also relate to S3 (internal regulation) in terms of policy adjustment.

name	value	max_value	rationale
explanatory_value	4.0	5.0	The entity illuminates an important mechanism by which colonial economies improve over time through feedback and adaptation, distinguishing between different institutional arrangements' capacity to facilitate learning. This provides genuine insight into Smith's theory of economic development.

Evaluation: Colonial Economic System Learning

definition_precision — 3.0 / 5.0

The definition captures a reasonably distinct concept about knowledge acquisition in colonial economies, but uses somewhat vague terms like "effective economic practices" and "better learning processes" without clear criteria for what constitutes effectiveness or improvement.

source_grounding — 4.0 / 5.0

Smith does discuss learning and experimentation in colonial contexts, particularly emphasizing how market mechanisms provide better learning opportunities than monopolistic control systems. The entity appears well-grounded in his actual arguments about colonial economic development.

domain_placement — 4.0 / 5.0

"General Theory" is appropriate as this concept spans multiple economic domains and represents a meta-level process about how economic knowledge develops. It's not specific to trade, production, or any particular economic sector.

vsm_relevance — 5.0 / 5.0

This entity maps very naturally to S4 (intelligence/environmental adaptation) as it describes how colonial economic systems gather information about their environment and adapt their practices accordingly. It could also relate to S3 (internal regulation) in terms of policy adjustment.

explanatory_value — 4.0 / 5.0

The entity illuminates an important mechanism by which colonial economies improve over time through feedback and adaptation, distinguishing between different institutional arrangements' capacity to facilitate learning. This provides genuine insight into Smith's theory of economic development.

3.4 KiB Raw Blame History