Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.4 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

agricultural_technology_adoption

null

2026-02-23T00:32:19.997838

2.4

name	value	max_value	rationale
definition_precision	1.0	5.0	There is no definition provided at all, making it impossible to assess precision or conceptual distinctness. Without a definition, this entity is essentially an empty placeholder.

name	value	max_value	rationale
source_grounding	2.0	5.0	While Smith does discuss agricultural improvements and technological progress in "The Wealth of Nations," the specific framing of "technology adoption" as a distinct analytical category may impose modern conceptual frameworks onto 18th-century economic thought. The absence of source chapter specification makes verification impossible.

name	value	max_value	rationale
domain_placement	3.0	5.0	Agricultural technology would reasonably fall within economic analysis of productivity and development, which aligns with Smith's concerns. However, without domain specification or definitional content, proper categorization cannot be confirmed.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	Agricultural technology adoption could map well to S4 (intelligence/environmental adaptation) as it represents how agricultural systems adapt to new knowledge and environmental challenges. It might also relate to S1 (primary operations) in terms of actual implementation of new techniques.

name	value	max_value	rationale
explanatory_value	2.0	5.0	While technological adoption is potentially an important mechanism for economic development, this entity currently provides no explanatory content due to its lack of definition and context. It names a phenomenon but illuminates no underlying mechanisms or structural relations.

Evaluation: Agricultural Technology Adoption

definition_precision — 1.0 / 5.0

There is no definition provided at all, making it impossible to assess precision or conceptual distinctness. Without a definition, this entity is essentially an empty placeholder.

source_grounding — 2.0 / 5.0

While Smith does discuss agricultural improvements and technological progress in "The Wealth of Nations," the specific framing of "technology adoption" as a distinct analytical category may impose modern conceptual frameworks onto 18th-century economic thought. The absence of source chapter specification makes verification impossible.

domain_placement — 3.0 / 5.0

Agricultural technology would reasonably fall within economic analysis of productivity and development, which aligns with Smith's concerns. However, without domain specification or definitional content, proper categorization cannot be confirmed.

vsm_relevance — 4.0 / 5.0

Agricultural technology adoption could map well to S4 (intelligence/environmental adaptation) as it represents how agricultural systems adapt to new knowledge and environmental challenges. It might also relate to S1 (primary operations) in terms of actual implementation of new techniques.

explanatory_value — 2.0 / 5.0

While technological adoption is potentially an important mechanism for economic development, this entity currently provides no explanatory content due to its lack of definition and context. It names a phenomenon but illuminates no underlying mechanisms or structural relations.

3.4 KiB Raw Blame History