Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.5 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

registration_duties

null

2026-02-23T06:16:35.425805

4.2

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly distinguishes registration duties as taxes specifically on the official recording of legal documents and property transfers, making it distinct from other forms of taxation. It precisely captures the administrative nature of these duties tied to the registration process itself.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's text from Book V, Chapter 2, where he explicitly discusses registration duties alongside stamp duties as methods of taxing property transfers. The context accurately reflects Smith's analysis of both their benefits and potential for abuse.

name	value	max_value	rationale
domain_placement	5.0	5.0	"General Theory" is the appropriate domain placement as registration duties represent a specific mechanism within Smith's broader theoretical framework of public finance and taxation. This fits naturally within his systematic analysis of different tax types and their economic effects.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	Registration duties have moderate VSM relevance, primarily mapping to S3 (internal regulation/audit) as they involve administrative oversight and record-keeping functions. However, they also touch on S1 (operations) through revenue generation, making the VSM placement somewhat diffuse.

name	value	max_value	rationale
explanatory_value	4.0	5.0	This entity provides good explanatory value by illuminating a specific revenue mechanism and its dual function of generating income while providing legal security. It reveals the structural tension Smith identifies between administrative utility and potential revenue abuse.

Evaluation: Registration Duties

definition_precision — 4.0 / 5.0

The definition clearly distinguishes registration duties as taxes specifically on the official recording of legal documents and property transfers, making it distinct from other forms of taxation. It precisely captures the administrative nature of these duties tied to the registration process itself.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's text from Book V, Chapter 2, where he explicitly discusses registration duties alongside stamp duties as methods of taxing property transfers. The context accurately reflects Smith's analysis of both their benefits and potential for abuse.

domain_placement — 5.0 / 5.0

"General Theory" is the appropriate domain placement as registration duties represent a specific mechanism within Smith's broader theoretical framework of public finance and taxation. This fits naturally within his systematic analysis of different tax types and their economic effects.

vsm_relevance — 3.0 / 5.0

Registration duties have moderate VSM relevance, primarily mapping to S3 (internal regulation/audit) as they involve administrative oversight and record-keeping functions. However, they also touch on S1 (operations) through revenue generation, making the VSM placement somewhat diffuse.

explanatory_value — 4.0 / 5.0

This entity provides good explanatory value by illuminating a specific revenue mechanism and its dual function of generating income while providing legal security. It reveals the structural tension Smith identifies between administrative utility and potential revenue abuse.

3.5 KiB Raw Blame History