Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.7 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

specie

null

2026-02-23T06:23:51.858257

3.6

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly distinguishes specie as coin money made of precious metals, differentiating it from paper currency and other forms of money. The definition is precise and non-circular, though it could be slightly more specific about what constitutes "precious metals."

name	value	max_value	rationale
source_grounding	3.0	5.0	While Smith does discuss coins, bullion, and paper currency throughout his work, the specific term "specie" and its formal definition as presented here may be more of an analytical inference than an explicit concept Smith develops. The entity acknowledges this by noting Smith's "implied" distinction rather than direct usage.

name	value	max_value	rationale
domain_placement	5.0	5.0	The placement in the "Exchange" domain is entirely appropriate, as specie fundamentally concerns the medium of exchange and monetary systems. This aligns perfectly with Smith's discussions of currency and mercantile policies around money accumulation.

name	value	max_value	rationale
vsm_relevance	2.0	5.0	Specie is primarily a technical monetary instrument rather than a systemic function or organizational capability. While it might relate tangentially to S1 operations or S4 intelligence gathering about monetary policy, it doesn't naturally map to any specific VSM system as it's more of a tool than a systemic process.

name	value	max_value	rationale
explanatory_value	4.0	5.0	This entity provides significant explanatory value by clarifying the specific type of money that mercantile systems prioritized and helping readers understand the material basis of 18th-century monetary thinking. It illuminates why mercantilists focused on accumulating physical precious metal currency rather than other forms of wealth.

Evaluation: Specie

definition_precision — 4.0 / 5.0

The definition clearly distinguishes specie as coin money made of precious metals, differentiating it from paper currency and other forms of money. The definition is precise and non-circular, though it could be slightly more specific about what constitutes "precious metals."

source_grounding — 3.0 / 5.0

While Smith does discuss coins, bullion, and paper currency throughout his work, the specific term "specie" and its formal definition as presented here may be more of an analytical inference than an explicit concept Smith develops. The entity acknowledges this by noting Smith's "implied" distinction rather than direct usage.

domain_placement — 5.0 / 5.0

The placement in the "Exchange" domain is entirely appropriate, as specie fundamentally concerns the medium of exchange and monetary systems. This aligns perfectly with Smith's discussions of currency and mercantile policies around money accumulation.

vsm_relevance — 2.0 / 5.0

Specie is primarily a technical monetary instrument rather than a systemic function or organizational capability. While it might relate tangentially to S1 operations or S4 intelligence gathering about monetary policy, it doesn't naturally map to any specific VSM system as it's more of a tool than a systemic process.

explanatory_value — 4.0 / 5.0

This entity provides significant explanatory value by clarifying the specific type of money that mercantile systems prioritized and helping readers understand the material basis of 18th-century monetary thinking. It illuminates why mercantilists focused on accumulating physical precious metal currency rather than other forms of wealth.

3.7 KiB Raw Blame History