generated from coulomb/repo-seed
generic source-to-infospace generator
This commit is contained in:
@@ -0,0 +1,9 @@
|
||||
# Entity Contract
|
||||
|
||||
Each generated entity must be a Markdown artifact with:
|
||||
|
||||
- one top-level heading containing the entity title
|
||||
- a `## Definition` section
|
||||
- optional `## Context`, `## Source Evidence`, and `## Review Notes` sections
|
||||
|
||||
Entity titles should be stable, short, and reusable across source chunks.
|
||||
@@ -0,0 +1,10 @@
|
||||
# Evaluation Contract
|
||||
|
||||
Each evaluation must be Markdown with YAML frontmatter containing:
|
||||
|
||||
- `artifact_id`
|
||||
- `evaluator`
|
||||
- `evaluated_at`
|
||||
- `scores`
|
||||
|
||||
Scores should include groundedness and usefulness on a 0 to 5 scale.
|
||||
@@ -0,0 +1,11 @@
|
||||
# Relation Contract
|
||||
|
||||
Each generated relation must be a Markdown artifact with:
|
||||
|
||||
- one top-level heading containing the relation title
|
||||
- `## Subject`
|
||||
- `## Predicate`
|
||||
- `## Object`
|
||||
- optional `## Relation Type`, `## Evidence`, and `## Feedback Role`
|
||||
|
||||
Subject and object values should match generated entity titles whenever possible.
|
||||
@@ -0,0 +1,7 @@
|
||||
# Summary Contract
|
||||
|
||||
Each source summary should preserve:
|
||||
|
||||
- the core claims or concepts
|
||||
- evidence phrases useful for later review
|
||||
- unresolved ambiguities or extraction risks
|
||||
14
src/infospace_bench/profiles/general-knowledge/profile.yaml
Normal file
14
src/infospace_bench/profiles/general-knowledge/profile.yaml
Normal file
@@ -0,0 +1,14 @@
|
||||
id: general-knowledge
|
||||
name: General Knowledge
|
||||
description: Generic infospace generation profile for local articles, ebooks, and knowledge collections.
|
||||
terminology:
|
||||
source_chunk: Normalized source artifact
|
||||
entity: Durable concept, claim, method, person, place, work, or object
|
||||
relation: Typed link between two generated entities
|
||||
granularity:
|
||||
default: Extract entities that can stand alone as useful review artifacts.
|
||||
evaluation_criteria:
|
||||
- groundedness
|
||||
- usefulness
|
||||
- clarity
|
||||
- provenance
|
||||
@@ -0,0 +1,14 @@
|
||||
# Evaluate Entity
|
||||
|
||||
Profile: {{ macros.profile }}
|
||||
|
||||
Evaluate the generated entity as Markdown with YAML frontmatter. Include
|
||||
`artifact_id`, `evaluator`, `evaluated_at`, and scores for groundedness and
|
||||
usefulness on a 0 to 5 scale.
|
||||
|
||||
Entity artifact: {{ input.artifact_id }}
|
||||
Entity title: {{ input.title }}
|
||||
|
||||
## Entity
|
||||
|
||||
{{ input.content }}
|
||||
@@ -0,0 +1,15 @@
|
||||
# Extract Entities
|
||||
|
||||
Profile: {{ macros.profile }}
|
||||
|
||||
Extract reusable infospace entities from the source chunk. Return one Markdown
|
||||
bundle where each entity starts with `# Entity Title` and contains at least a
|
||||
`## Definition` section. Prefer durable concepts, claims, named methods,
|
||||
people, places, works, and objects over sentence fragments.
|
||||
|
||||
Source title: {{ input.title }}
|
||||
Source artifact: {{ input.artifact_id }}
|
||||
|
||||
## Source
|
||||
|
||||
{{ input.content }}
|
||||
@@ -0,0 +1,14 @@
|
||||
# Extract Relations
|
||||
|
||||
Profile: {{ macros.profile }}
|
||||
|
||||
Extract a small set of important relations from the source chunk. Return one
|
||||
Markdown relation artifact with sections `## Subject`, `## Predicate`, and
|
||||
`## Object`. Use entity-style names for subject and object.
|
||||
|
||||
Source title: {{ input.title }}
|
||||
Source artifact: {{ input.artifact_id }}
|
||||
|
||||
## Source
|
||||
|
||||
{{ input.content }}
|
||||
@@ -0,0 +1,13 @@
|
||||
# Summarize Source Chunk
|
||||
|
||||
Profile: {{ macros.profile }}
|
||||
|
||||
Summarize the source chunk as Markdown. Preserve concrete claims, named concepts,
|
||||
and evidence phrases that should guide later entity and relation extraction.
|
||||
|
||||
Source title: {{ input.title }}
|
||||
Source artifact: {{ input.artifact_id }}
|
||||
|
||||
## Source
|
||||
|
||||
{{ input.content }}
|
||||
@@ -0,0 +1,6 @@
|
||||
# Synthesize Collection Report
|
||||
|
||||
Profile: {{ macros.profile }}
|
||||
|
||||
Synthesize a concise report from generated source summaries, entities,
|
||||
relations, evaluations, and collection metrics.
|
||||
Reference in New Issue
Block a user