Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.4 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

sea_sticks

null

2026-02-23T06:20:16.636448

4.2

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition is quite precise, clearly distinguishing sea-sticks as a specific stage of herring processing (caught and cured at sea but requiring additional processing before market sale). This captures a distinct concept in the fish processing chain rather than being vague or circular.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's actual discussion of herring fishery bounties in Book IV, Chapter 5, where he uses specific examples from the fishing industry to illustrate his critique of government subsidies. The term and concept appear authentically in the source text.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Production" domain assignment is exactly correct, as sea-sticks represent an intermediate stage in the production process of marketable fish products. This fits perfectly within Smith's analysis of productive processes and their economic implications.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	Sea-sticks map most naturally to S1 (primary operations) as they represent a specific operational output in the fishing production system. However, the mapping is somewhat indirect since this is primarily a product classification rather than a system function.

name	value	max_value	rationale
explanatory_value	4.0	5.0	This entity provides good explanatory value by illustrating Smith's broader argument about how subsidies can distort production incentives and market efficiency. It serves as a concrete example of the mechanisms by which government intervention affects natural market processes.

Evaluation: Sea Sticks

definition_precision — 4.0 / 5.0

The definition is quite precise, clearly distinguishing sea-sticks as a specific stage of herring processing (caught and cured at sea but requiring additional processing before market sale). This captures a distinct concept in the fish processing chain rather than being vague or circular.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's actual discussion of herring fishery bounties in Book IV, Chapter 5, where he uses specific examples from the fishing industry to illustrate his critique of government subsidies. The term and concept appear authentically in the source text.

domain_placement — 5.0 / 5.0

The "Production" domain assignment is exactly correct, as sea-sticks represent an intermediate stage in the production process of marketable fish products. This fits perfectly within Smith's analysis of productive processes and their economic implications.

vsm_relevance — 3.0 / 5.0

Sea-sticks map most naturally to S1 (primary operations) as they represent a specific operational output in the fishing production system. However, the mapping is somewhat indirect since this is primarily a product classification rather than a system function.

explanatory_value — 4.0 / 5.0

This entity provides good explanatory value by illustrating Smith's broader argument about how subsidies can distort production incentives and market efficiency. It serves as a concrete example of the mechanisms by which government intervention affects natural market processes.

3.4 KiB Raw Blame History