Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.6 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

economical_table

null

2026-02-23T05:22:14.318493

4.2

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition is quite precise, clearly identifying this as Quesnai's mathematical representation showing distribution of annual produce among three classes under ideal conditions. It avoids circularity and captures a distinct analytical tool rather than a vague concept.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's discussion of Quesnai's work in Book IV, Chapter 9, where Smith explicitly describes these "arithmetical formularies" and the Economical Table's representation of ideal distribution under perfect liberty. The entity accurately reflects Smith's treatment of Physiocratic theory.

name	value	max_value	rationale
domain_placement	5.0	5.0	"General Theory" is the appropriate domain placement since this represents a theoretical framework for understanding economic distribution and national wealth circulation. It's a meta-level analytical tool rather than a specific policy or operational mechanism.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	This entity has moderate VSM relevance as it could map to S4 (intelligence/environmental modeling) since it represents a systematic attempt to model economic flows and relationships. However, as a static analytical framework rather than an active system component, the VSM mapping is not entirely natural.

name	value	max_value	rationale
explanatory_value	4.0	5.0	The entity provides strong explanatory value by illuminating how Physiocrats attempted to systematically model wealth distribution and the structural relationships between economic classes. It reveals an important methodological approach to understanding economic circulation that influenced Smith's thinking.

Evaluation: Economical Table

definition_precision — 4.0 / 5.0

The definition is quite precise, clearly identifying this as Quesnai's mathematical representation showing distribution of annual produce among three classes under ideal conditions. It avoids circularity and captures a distinct analytical tool rather than a vague concept.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's discussion of Quesnai's work in Book IV, Chapter 9, where Smith explicitly describes these "arithmetical formularies" and the Economical Table's representation of ideal distribution under perfect liberty. The entity accurately reflects Smith's treatment of Physiocratic theory.

domain_placement — 5.0 / 5.0

"General Theory" is the appropriate domain placement since this represents a theoretical framework for understanding economic distribution and national wealth circulation. It's a meta-level analytical tool rather than a specific policy or operational mechanism.

vsm_relevance — 3.0 / 5.0

This entity has moderate VSM relevance as it could map to S4 (intelligence/environmental modeling) since it represents a systematic attempt to model economic flows and relationships. However, as a static analytical framework rather than an active system component, the VSM mapping is not entirely natural.

explanatory_value — 4.0 / 5.0

The entity provides strong explanatory value by illuminating how Physiocrats attempted to systematically model wealth distribution and the structural relationships between economic classes. It reveals an important methodological approach to understanding economic circulation that influenced Smith's thinking.

3.6 KiB Raw Blame History