Files
markitect-main/examples/infospace-with-history/output/evaluations/certificates.md
tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)
Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-02-23 09:36:46 +01:00

65 lines
3.5 KiB
Markdown

---
entity_slug: certificates
evaluator: null
evaluated_at: '2026-02-23T04:42:30.141234'
overall_score: 4.6
scores:
- name: definition_precision
value: 5.0
max_value: 5.0
rationale: The definition is highly precise and non-circular, clearly specifying
that certificates are official documents from one parish allowing residence in
another without gaining settlement rights. It captures a distinct administrative
mechanism rather than a vague concept.
- name: source_grounding
value: 5.0
max_value: 5.0
rationale: This entity is directly grounded in Smith's text from Book I, Chapter
10, where he explicitly discusses certificates as part of his analysis of settlement
laws and their effects on labor mobility. The concept emerges naturally from Smith's
own discussion rather than being imposed externally.
- name: domain_placement
value: 5.0
max_value: 5.0
rationale: The "Regulation" domain assignment is perfectly appropriate, as certificates
represent a regulatory mechanism designed to manage the administrative problems
created by settlement laws. This is clearly a matter of institutional regulation
rather than production, exchange, or other economic domains.
- name: vsm_relevance
value: 4.0
max_value: 5.0
rationale: This entity maps well to S2 (coordination) as certificates serve to coordinate
labor movement between parishes and reduce oscillations/conflicts in the settlement
system. It also has some S3 (internal regulation) characteristics as an administrative
control mechanism.
- name: explanatory_value
value: 4.0
max_value: 5.0
rationale: The entity provides good explanatory value by illuminating how administrative
systems attempt to solve problems created by other regulations, showing the layered
complexity of institutional responses. However, it represents more of a symptomatic
response than a fundamental structural mechanism.
---
# Evaluation: Certificates
## definition_precision — 5.0 / 5.0
The definition is highly precise and non-circular, clearly specifying that certificates are official documents from one parish allowing residence in another without gaining settlement rights. It captures a distinct administrative mechanism rather than a vague concept.
## source_grounding — 5.0 / 5.0
This entity is directly grounded in Smith's text from Book I, Chapter 10, where he explicitly discusses certificates as part of his analysis of settlement laws and their effects on labor mobility. The concept emerges naturally from Smith's own discussion rather than being imposed externally.
## domain_placement — 5.0 / 5.0
The "Regulation" domain assignment is perfectly appropriate, as certificates represent a regulatory mechanism designed to manage the administrative problems created by settlement laws. This is clearly a matter of institutional regulation rather than production, exchange, or other economic domains.
## vsm_relevance — 4.0 / 5.0
This entity maps well to S2 (coordination) as certificates serve to coordinate labor movement between parishes and reduce oscillations/conflicts in the settlement system. It also has some S3 (internal regulation) characteristics as an administrative control mechanism.
## explanatory_value — 4.0 / 5.0
The entity provides good explanatory value by illuminating how administrative systems attempt to solve problems created by other regulations, showing the layered complexity of institutional responses. However, it represents more of a symptomatic response than a fundamental structural mechanism.