Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.4 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

combination_of_masters

null

2026-02-23T04:56:52.161555

4.6

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly captures a specific phenomenon - the tacit agreement among employers regarding wage levels - and distinguishes between the natural state of maintaining wages and the more secretive efforts to lower them. The concept is well-bounded and avoids circularity.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity directly reflects Smith's explicit discussion in Book I, Chapter 8 about how masters naturally combine to keep wages low, conducted with "silence and secrecy." The definition accurately captures Smith's observation about this being a constant, tacit agreement.

name	value	max_value	rationale
domain_placement	5.0	5.0	"Regulation" is the appropriate domain since this describes a mechanism that regulates wage levels in the labor market. The combination of masters functions as a regulatory force that constrains wage increases and attempts to suppress wages below natural rates.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This maps well to S3 (internal regulation) as it represents a regulatory mechanism within the economic system that maintains control over wage levels. It could also relate to S2 (coordination) as it involves coordinated action among employers to prevent wage oscillations.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This entity illuminates a crucial structural mechanism in Smith's analysis of how labor markets actually function, explaining why wages tend to remain at subsistence levels despite theoretical bargaining power. It reveals the asymmetric power dynamics that shape wage determination.

Evaluation: Combination Of Masters

definition_precision — 4.0 / 5.0

The definition clearly captures a specific phenomenon - the tacit agreement among employers regarding wage levels - and distinguishes between the natural state of maintaining wages and the more secretive efforts to lower them. The concept is well-bounded and avoids circularity.

source_grounding — 5.0 / 5.0

This entity directly reflects Smith's explicit discussion in Book I, Chapter 8 about how masters naturally combine to keep wages low, conducted with "silence and secrecy." The definition accurately captures Smith's observation about this being a constant, tacit agreement.

domain_placement — 5.0 / 5.0

"Regulation" is the appropriate domain since this describes a mechanism that regulates wage levels in the labor market. The combination of masters functions as a regulatory force that constrains wage increases and attempts to suppress wages below natural rates.

vsm_relevance — 4.0 / 5.0

This maps well to S3 (internal regulation) as it represents a regulatory mechanism within the economic system that maintains control over wage levels. It could also relate to S2 (coordination) as it involves coordinated action among employers to prevent wage oscillations.

explanatory_value — 5.0 / 5.0

This entity illuminates a crucial structural mechanism in Smith's analysis of how labor markets actually function, explaining why wages tend to remain at subsistence levels despite theoretical bargaining power. It reveals the asymmetric power dynamics that shape wage determination.

3.4 KiB Raw Blame History