Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.2 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

payment_in_kind

null

2026-02-23T06:04:51.967719

4.2

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly distinguishes payment in kind from both pure barter and monetary exchange, positioning it as a specific intermediate stage. It precisely identifies the core characteristic (paying with goods/services rather than money) without circularity.

name	value	max_value	rationale
source_grounding	5.0	5.0	This concept is directly grounded in Smith's specific historical example of Saxon kings receiving revenues in "victuals and provisions" rather than money. The entity accurately reflects Smith's discussion of the evolution from in-kind to monetary payment systems.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Exchange" domain is perfectly appropriate, as payment in kind represents a fundamental mechanism of exchange that bridges barter and monetary systems. This is precisely about how value transfers occur between parties.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	Payment in kind has some relevance to S1 (as an operational exchange mechanism) and potentially S4 (as societies adapt payment systems to environmental constraints). However, it's more of a transactional method than a clear VSM system component.

name	value	max_value	rationale
explanatory_value	4.0	5.0	This entity illuminates an important structural mechanism in economic evolution, showing how societies transition between exchange systems. It explains a concrete process rather than merely naming a phenomenon, contributing to understanding of monetary development.

Evaluation: Payment In Kind

definition_precision — 4.0 / 5.0

The definition clearly distinguishes payment in kind from both pure barter and monetary exchange, positioning it as a specific intermediate stage. It precisely identifies the core characteristic (paying with goods/services rather than money) without circularity.

source_grounding — 5.0 / 5.0

This concept is directly grounded in Smith's specific historical example of Saxon kings receiving revenues in "victuals and provisions" rather than money. The entity accurately reflects Smith's discussion of the evolution from in-kind to monetary payment systems.

domain_placement — 5.0 / 5.0

The "Exchange" domain is perfectly appropriate, as payment in kind represents a fundamental mechanism of exchange that bridges barter and monetary systems. This is precisely about how value transfers occur between parties.

vsm_relevance — 3.0 / 5.0

Payment in kind has some relevance to S1 (as an operational exchange mechanism) and potentially S4 (as societies adapt payment systems to environmental constraints). However, it's more of a transactional method than a clear VSM system component.

explanatory_value — 4.0 / 5.0

This entity illuminates an important structural mechanism in economic evolution, showing how societies transition between exchange systems. It explains a concrete process rather than merely naming a phenomenon, contributing to understanding of monetary development.

3.2 KiB Raw Blame History