generated from coulomb/repo-seed
Agentic memory profile
This commit is contained in:
@@ -0,0 +1,51 @@
|
||||
schema_version: infospace-bench.memory-context-evaluation.v1
|
||||
evaluated_at: "2026-05-15T00:20:00Z"
|
||||
workplan: IB-WP-0017
|
||||
profile_id: infospace-agentic-memory-pilot
|
||||
graph_id: infospace-agentic-memory-graph
|
||||
selection: restart-context-selection.yaml
|
||||
questions:
|
||||
- id: restart-quality
|
||||
prompt: Can a later agent resume Wealth/VSM review with the selected package?
|
||||
score: 4.2
|
||||
max_score: 5.0
|
||||
result: pass
|
||||
- id: provenance-review
|
||||
prompt: Can a reviewer see why each memory item exists?
|
||||
score: 5.0
|
||||
max_score: 5.0
|
||||
result: pass
|
||||
- id: budget-realism
|
||||
prompt: Does the selection fit a compact restart budget?
|
||||
score: 4.0
|
||||
max_score: 5.0
|
||||
result: pass
|
||||
- id: noise-control
|
||||
prompt: Does the package omit low-value trace detail?
|
||||
score: 3.8
|
||||
max_score: 5.0
|
||||
result: watch
|
||||
metrics:
|
||||
restart_quality_score: 4.2
|
||||
provenance_coverage_ratio: 1.0
|
||||
selected_node_count: 7
|
||||
expected_item_count: 8
|
||||
context_package_budget_max_tokens: 1200
|
||||
live_llm_required: false
|
||||
findings:
|
||||
- id: finding.restart-risk
|
||||
summary: Decision-only memory is not enough; restart packages need the active source/entity neighborhood.
|
||||
- id: finding.neighborhood-improves-review
|
||||
summary: The Division of Labour source and entity references make the boundary decision actionable for review.
|
||||
- id: finding.profile-gap
|
||||
summary: Profile retention intent is useful, but acceptance thresholds remain application-level metrics in infospace-bench.
|
||||
recommended_contract_changes:
|
||||
markitect-tool:
|
||||
- Add an option for timestamp-stable context package fixture output to simplify cross-repo golden files.
|
||||
- Document when selected events should become package items versus metadata.
|
||||
kontextual-engine:
|
||||
- Import Markitect graph/profile envelopes and persist runtime audit events separately from contract events.
|
||||
- Keep durable write plans review-gated and export Markitect-compatible package input envelopes.
|
||||
infospace-bench:
|
||||
- Keep memory quality metrics and pilot corpora here.
|
||||
- Do not store user memory, credentials, or runtime graph state in an infospace.
|
||||
@@ -0,0 +1,273 @@
|
||||
schema_version: markitect.memory.graph.v1
|
||||
id: infospace-agentic-memory-graph
|
||||
title: Infospace Agentic Memory Pilot Graph
|
||||
intent: Preserve the reviewed memory decisions, workflow events, and Wealth/VSM artifact neighborhood used to evaluate restart context packages.
|
||||
namespace:
|
||||
project: infospace-bench
|
||||
task: IB-WP-0017
|
||||
nodes:
|
||||
- id: question.memory-decisions
|
||||
kind: question
|
||||
text: Which infospace generation and review decisions are useful enough to reactivate for later agent work?
|
||||
source_spans:
|
||||
- path: workplans/IB-WP-0017-agentic-memory-profile-pilot.md
|
||||
unit_kind: section
|
||||
selector: tasks[id=IB-WP-0017-T01]
|
||||
engine: selector
|
||||
metadata:
|
||||
title: Memory question
|
||||
summary: The pilot starts from concrete restart questions, not a runtime feature request.
|
||||
- id: decision.file-backed-pilot
|
||||
kind: decision
|
||||
text: Keep the pilot file-backed in infospace-bench and use Markitect contracts for validation and package compilation.
|
||||
source_spans:
|
||||
- path: docs/agentic-memory-profile-pilot.md
|
||||
unit_kind: section
|
||||
selector: heading[Decision]
|
||||
engine: selector
|
||||
metadata:
|
||||
title: File-backed pilot boundary
|
||||
summary: Infospace-bench owns evidence and evaluation while Markitect owns contract compilation.
|
||||
- id: constraint.no-durable-runtime
|
||||
kind: constraint
|
||||
text: Do not implement graph or event persistence in infospace-bench; durable runtime state belongs behind kontextual-engine.
|
||||
source_spans:
|
||||
- path: workplans/IB-WP-0017-agentic-memory-profile-pilot.md
|
||||
unit_kind: section
|
||||
selector: heading[Non-Goals]
|
||||
engine: selector
|
||||
metadata:
|
||||
title: No durable memory runtime
|
||||
- id: evidence.workplan-non-goal
|
||||
kind: evidence
|
||||
text: Workplan 17 explicitly forbids graph/event persistence, schema redefinition, live LLM requirements, and secrets in the infospace.
|
||||
source_spans:
|
||||
- path: workplans/IB-WP-0017-agentic-memory-profile-pilot.md
|
||||
unit_kind: section
|
||||
selector: heading[Non-Goals]
|
||||
engine: selector
|
||||
metadata:
|
||||
title: Workplan non-goal evidence
|
||||
- id: plan.restart-context-package
|
||||
kind: plan
|
||||
text: Evaluate a restart package that activates the boundary decision, one workflow trace, and the Wealth/VSM artifact neighborhood under a tight budget.
|
||||
source_spans:
|
||||
- path: infospaces/agentic-memory-profile-pilot/output/memory/restart-context-selection.yaml
|
||||
unit_kind: mapping
|
||||
selector: node_ids
|
||||
engine: yaml
|
||||
metadata:
|
||||
title: Restart package plan
|
||||
summary: The package should improve restart quality without becoming noisy.
|
||||
- id: turn.review-handoff
|
||||
kind: turn
|
||||
text: Reviewer asks whether a later agent can resume entity and relation review without rereading every generated report.
|
||||
source_spans:
|
||||
- path: infospaces/agentic-memory-profile-pilot/output/memory/traces/entity-review-restart.yaml
|
||||
unit_kind: trace
|
||||
selector: events[0]
|
||||
engine: yaml
|
||||
metadata:
|
||||
title: Review handoff turn
|
||||
- id: tool_call.generator-status
|
||||
kind: tool_call
|
||||
text: The workflow status check reports one source, two entities, one relation, one evaluation snapshot, and no stale source artifacts.
|
||||
source_spans:
|
||||
- path: infospaces/wealth-vsm-legacy-slice/output/metrics/metrics.yaml
|
||||
unit_kind: mapping
|
||||
selector: metrics
|
||||
engine: yaml
|
||||
metadata:
|
||||
title: Generator status check
|
||||
- id: observation.restart-risk
|
||||
kind: observation
|
||||
text: Restart context is incomplete if it contains only decisions and omits the source/entity neighborhood under review.
|
||||
source_spans:
|
||||
- path: infospaces/agentic-memory-profile-pilot/output/memory/context-package-evaluation.yaml
|
||||
unit_kind: mapping
|
||||
selector: findings[0]
|
||||
engine: yaml
|
||||
metadata:
|
||||
title: Restart risk observation
|
||||
- id: artifact.wealth-source
|
||||
kind: artifact
|
||||
text: The Wealth/VSM legacy slice source is Book I Chapter III, used as the bounded corpus for the memory profile pilot.
|
||||
source_spans:
|
||||
- path: infospaces/wealth-vsm-legacy-slice/artifacts/sources/book-1-chapter-03.md
|
||||
unit_kind: document
|
||||
selector: path
|
||||
engine: filesystem
|
||||
metadata:
|
||||
title: Book I Chapter III source
|
||||
artifact_id: source/book-1-chapter-03.md
|
||||
- id: entity.division-of-labour
|
||||
kind: entity
|
||||
text: Division of Labour is the generated entity whose review quality depends on preserving the source relation to market extent.
|
||||
source_spans:
|
||||
- path: infospaces/wealth-vsm-legacy-slice/artifacts/entities/division-of-labour.md
|
||||
unit_kind: document
|
||||
selector: path
|
||||
engine: filesystem
|
||||
metadata:
|
||||
title: Division of Labour
|
||||
artifact_id: entity/division-of-labour.md
|
||||
- id: entity.market-extent
|
||||
kind: entity
|
||||
text: Market Extent is the paired entity in the Wealth/VSM relation neighborhood.
|
||||
source_spans:
|
||||
- path: infospaces/wealth-vsm-legacy-slice/artifacts/entities/market-extent.md
|
||||
unit_kind: document
|
||||
selector: path
|
||||
engine: filesystem
|
||||
metadata:
|
||||
title: Market Extent
|
||||
artifact_id: entity/market-extent.md
|
||||
- id: finding.neighborhood-improves-review
|
||||
kind: finding
|
||||
text: The useful restart package combines the boundary decision with the concrete source and entity neighborhood being reviewed.
|
||||
source_spans:
|
||||
- path: infospaces/agentic-memory-profile-pilot/output/memory/context-package-evaluation.yaml
|
||||
unit_kind: mapping
|
||||
selector: findings[1]
|
||||
engine: yaml
|
||||
metadata:
|
||||
title: Neighborhood improves review
|
||||
- id: profile.agentic-memory-pilot
|
||||
kind: profile
|
||||
text: The profile enables reasoning, conversation, knowledge, and package memory kinds with review-gated durable writes.
|
||||
source_spans:
|
||||
- path: infospaces/agentic-memory-profile-pilot/output/memory/memory-profile.yaml
|
||||
unit_kind: mapping
|
||||
selector: $
|
||||
engine: yaml
|
||||
metadata:
|
||||
title: Agentic memory pilot profile
|
||||
- id: context_package.restart-package
|
||||
kind: context_package
|
||||
text: The restart package selection is capped at eight items and must preserve selected nodes, implied edges, events, policy metadata, and provenance.
|
||||
source_spans:
|
||||
- path: infospaces/agentic-memory-profile-pilot/output/memory/restart-context-selection.yaml
|
||||
unit_kind: mapping
|
||||
selector: $
|
||||
engine: yaml
|
||||
metadata:
|
||||
title: Restart context package
|
||||
package_id: memory:package:agentic-memory-profile-restart
|
||||
- id: policy.review-gate
|
||||
kind: policy
|
||||
text: Any future durable memory write must be planned, reviewed, and applied through an explicit runtime gate.
|
||||
source_spans:
|
||||
- path: docs/agentic-memory-profile-pilot.md
|
||||
unit_kind: section
|
||||
selector: heading[Engine Integration Plan]
|
||||
engine: selector
|
||||
metadata:
|
||||
title: Durable write review gate
|
||||
edges:
|
||||
- id: edge.evidence-supports-boundary
|
||||
kind: supports
|
||||
source: evidence.workplan-non-goal
|
||||
target: decision.file-backed-pilot
|
||||
- id: edge.constraint-supports-boundary
|
||||
kind: supports
|
||||
source: constraint.no-durable-runtime
|
||||
target: decision.file-backed-pilot
|
||||
- id: edge.question-led-to-boundary
|
||||
kind: led_to
|
||||
source: question.memory-decisions
|
||||
target: decision.file-backed-pilot
|
||||
- id: edge.boundary-led-to-package-plan
|
||||
kind: led_to
|
||||
source: decision.file-backed-pilot
|
||||
target: plan.restart-context-package
|
||||
- id: edge.turn-led-to-observation
|
||||
kind: led_to
|
||||
source: turn.review-handoff
|
||||
target: observation.restart-risk
|
||||
- id: edge.tool-call-led-to-observation
|
||||
kind: led_to
|
||||
source: tool_call.generator-status
|
||||
target: observation.restart-risk
|
||||
- id: edge.observation-supports-finding
|
||||
kind: supports
|
||||
source: observation.restart-risk
|
||||
target: finding.neighborhood-improves-review
|
||||
- id: edge.division-derived-from-source
|
||||
kind: derived_from
|
||||
source: entity.division-of-labour
|
||||
target: artifact.wealth-source
|
||||
- id: edge.market-derived-from-source
|
||||
kind: derived_from
|
||||
source: entity.market-extent
|
||||
target: artifact.wealth-source
|
||||
- id: edge.finding-references-division
|
||||
kind: references
|
||||
source: finding.neighborhood-improves-review
|
||||
target: entity.division-of-labour
|
||||
- id: edge.finding-references-market
|
||||
kind: references
|
||||
source: finding.neighborhood-improves-review
|
||||
target: entity.market-extent
|
||||
- id: edge.profile-governs-package
|
||||
kind: governs
|
||||
source: profile.agentic-memory-pilot
|
||||
target: context_package.restart-package
|
||||
- id: edge.policy-governs-package
|
||||
kind: governs
|
||||
source: policy.review-gate
|
||||
target: context_package.restart-package
|
||||
- id: edge.package-activates-plan
|
||||
kind: activates
|
||||
source: context_package.restart-package
|
||||
target: plan.restart-context-package
|
||||
events:
|
||||
- id: event.memory-questions-recorded
|
||||
kind: recorded
|
||||
timestamp: "2026-05-15T00:00:00Z"
|
||||
actor: infospace-bench
|
||||
task: IB-WP-0017-T01
|
||||
node_updates:
|
||||
- node_id: question.memory-decisions
|
||||
operation: create
|
||||
- node_id: decision.file-backed-pilot
|
||||
operation: create
|
||||
- id: event.workflow-restart-trace
|
||||
kind: recorded
|
||||
timestamp: "2026-05-15T00:05:00Z"
|
||||
actor: infospace-bench
|
||||
thread: agentic-memory-profile-pilot
|
||||
task: IB-WP-0017-T05
|
||||
node_updates:
|
||||
- node_id: turn.review-handoff
|
||||
operation: create
|
||||
- node_id: tool_call.generator-status
|
||||
operation: create
|
||||
- node_id: observation.restart-risk
|
||||
operation: create
|
||||
- id: event.restart-package-activated
|
||||
kind: activated
|
||||
timestamp: "2026-05-15T00:10:00Z"
|
||||
actor: infospace-bench
|
||||
task: IB-WP-0017-T03
|
||||
package_refs:
|
||||
- memory:package:agentic-memory-profile-restart
|
||||
activation_refs:
|
||||
- activation:agentic-memory-profile-restart-review
|
||||
metadata:
|
||||
selected_node_count: 7
|
||||
expected_item_count: 8
|
||||
- id: event.review-gate-policy
|
||||
kind: policy_decision
|
||||
timestamp: "2026-05-15T00:15:00Z"
|
||||
actor: infospace-bench
|
||||
task: IB-WP-0017-T04
|
||||
node_updates:
|
||||
- node_id: policy.review-gate
|
||||
operation: create
|
||||
policy:
|
||||
durable_writes: review_required
|
||||
decision: allow_fixture_only
|
||||
metadata:
|
||||
pilot_corpus: infospaces/wealth-vsm-legacy-slice
|
||||
workplan: IB-WP-0017
|
||||
lower_layer_contract: markitect.memory.graph.v1
|
||||
@@ -0,0 +1,70 @@
|
||||
schema_version: markitect.memory.profile.v1
|
||||
id: infospace-agentic-memory-pilot
|
||||
title: Infospace Agentic Memory Pilot Profile
|
||||
intent: Compile selected reasoning decisions, workflow events, and artifact neighborhoods into restart context packages for infospace evaluation.
|
||||
memory_kinds:
|
||||
- reasoning
|
||||
- conversation
|
||||
- knowledge
|
||||
- package
|
||||
stores:
|
||||
reasoning: markitect-memory-graph-fixture
|
||||
conversation: infospace-workflow-trace-fixtures
|
||||
knowledge: infospace-artifact-neighborhood
|
||||
package: markitect-context-package
|
||||
limits:
|
||||
reasoning:
|
||||
max_nodes: 40
|
||||
conversation:
|
||||
max_nodes: 20
|
||||
knowledge:
|
||||
max_nodes: 80
|
||||
package:
|
||||
max_items: 8
|
||||
latency:
|
||||
reasoning:
|
||||
target_ms: 50
|
||||
conversation:
|
||||
target_ms: 50
|
||||
knowledge:
|
||||
target_ms: 120
|
||||
retention:
|
||||
reasoning:
|
||||
strategy: keep-reviewed-decisions
|
||||
review_gate: required
|
||||
conversation:
|
||||
strategy: keep-accepted-handoff-events
|
||||
window_events: 12
|
||||
knowledge:
|
||||
strategy: supersede-with-artifact-version
|
||||
package:
|
||||
strategy: regenerate-from-selection
|
||||
refresh:
|
||||
cadence: manual
|
||||
trigger: source-artifact-or-profile-digest-change
|
||||
compaction:
|
||||
strategy: summarize-trace-after-review
|
||||
owner: markitect-tool-contract-output
|
||||
activation:
|
||||
max_items: 8
|
||||
max_tokens: 1200
|
||||
reserve_tokens: 150
|
||||
policy:
|
||||
required_labels:
|
||||
- project-local
|
||||
durable_writes: review-gated
|
||||
secrets_allowed: false
|
||||
observability:
|
||||
emit_events: true
|
||||
metrics:
|
||||
- restart_quality_score
|
||||
- provenance_coverage_ratio
|
||||
- context_package_budget_max_tokens
|
||||
failure:
|
||||
missing_runtime_store: degrade-to-file-backed-fixture
|
||||
stale_profile: require-regeneration
|
||||
metadata:
|
||||
workplan: IB-WP-0017
|
||||
contract_owner: markitect-tool
|
||||
runtime_owner: kontextual-engine
|
||||
evaluation_owner: infospace-bench
|
||||
@@ -0,0 +1,44 @@
|
||||
schema_version: infospace-bench.memory-context-expectation.v1
|
||||
package_id: memory:package:agentic-memory-profile-restart
|
||||
title: Agentic Memory Profile Restart Package
|
||||
intent: Activate the minimum useful context for resuming Wealth/VSM entity and relation review under the memory pilot boundary.
|
||||
profile_id: infospace-agentic-memory-pilot
|
||||
graph_id: infospace-agentic-memory-graph
|
||||
expected_item_count: 8
|
||||
expected_selected_nodes:
|
||||
- decision.file-backed-pilot
|
||||
- constraint.no-durable-runtime
|
||||
- plan.restart-context-package
|
||||
- artifact.wealth-source
|
||||
- entity.division-of-labour
|
||||
- finding.neighborhood-improves-review
|
||||
- policy.review-gate
|
||||
expected_selected_edges:
|
||||
- edge.constraint-supports-boundary
|
||||
- edge.boundary-led-to-package-plan
|
||||
- edge.division-derived-from-source
|
||||
- edge.finding-references-division
|
||||
expected_selected_events:
|
||||
- event.restart-package-activated
|
||||
budget:
|
||||
max_items: 8
|
||||
max_tokens: 1200
|
||||
reserve_tokens: 150
|
||||
strategy: first-fit
|
||||
acceptance:
|
||||
requires_source_spans: true
|
||||
max_token_estimate: 1200
|
||||
required_node_kinds:
|
||||
- decision
|
||||
- constraint
|
||||
- plan
|
||||
- artifact
|
||||
- entity
|
||||
- finding
|
||||
- policy
|
||||
deterministic_fields:
|
||||
- package_id
|
||||
- title
|
||||
- selected_nodes
|
||||
- selected_edges
|
||||
- selected_events
|
||||
@@ -0,0 +1,27 @@
|
||||
schema_version: markitect.memory.selection.v1
|
||||
graph: memory-graph.yaml
|
||||
profile: memory-profile.yaml
|
||||
title: Agentic Memory Profile Restart Package
|
||||
intent: Activate the minimum useful context for resuming Wealth/VSM entity and relation review under the memory pilot boundary.
|
||||
package_id: memory:package:agentic-memory-profile-restart
|
||||
namespace:
|
||||
project: infospace-bench
|
||||
task: IB-WP-0017
|
||||
node_ids:
|
||||
- decision.file-backed-pilot
|
||||
- constraint.no-durable-runtime
|
||||
- plan.restart-context-package
|
||||
- artifact.wealth-source
|
||||
- entity.division-of-labour
|
||||
- finding.neighborhood-improves-review
|
||||
- policy.review-gate
|
||||
event_ids:
|
||||
- event.restart-package-activated
|
||||
budget:
|
||||
max_items: 8
|
||||
max_tokens: 1200
|
||||
reserve_tokens: 150
|
||||
strategy: first-fit
|
||||
metadata:
|
||||
purpose: restart-quality-evaluation
|
||||
expected_task: resume Wealth/VSM review without rereading all workplans
|
||||
@@ -0,0 +1,31 @@
|
||||
schema_version: infospace-bench.memory-trace.v1
|
||||
id: trace.entity-review-restart
|
||||
title: Entity Review Restart Trace
|
||||
workplan: IB-WP-0017
|
||||
source_workflow: wealth-vsm-legacy-slice-review
|
||||
events:
|
||||
- id: trace-event.review-handoff
|
||||
kind: conversation_turn
|
||||
timestamp: "2026-05-15T00:05:00Z"
|
||||
actor: reviewer
|
||||
summary: A later agent needs to resume review of the Division of Labour relation without rereading every report.
|
||||
memory_nodes:
|
||||
- turn.review-handoff
|
||||
- id: trace-event.status-check
|
||||
kind: tool_call
|
||||
timestamp: "2026-05-15T00:06:00Z"
|
||||
actor: infospace-bench
|
||||
summary: The slice is compact and coherent enough for package evaluation.
|
||||
memory_nodes:
|
||||
- tool_call.generator-status
|
||||
- id: trace-event.restart-risk
|
||||
kind: observation
|
||||
timestamp: "2026-05-15T00:07:00Z"
|
||||
actor: infospace-bench
|
||||
summary: Decision-only context would miss the actual source/entity neighborhood under review.
|
||||
memory_nodes:
|
||||
- observation.restart-risk
|
||||
- finding.neighborhood-improves-review
|
||||
review_notes:
|
||||
- The selected package should include source and entity nodes, not only planning decisions.
|
||||
- Relation review improves when the active artifact neighborhood is visible.
|
||||
@@ -0,0 +1,25 @@
|
||||
schema_version: infospace-bench.memory-trace.v1
|
||||
id: trace.generation-plan-decision
|
||||
title: Generation Plan Decision Trace
|
||||
workplan: IB-WP-0017
|
||||
source_workflow: generic-source-generator
|
||||
events:
|
||||
- id: trace-event.select-corpus
|
||||
kind: planning_decision
|
||||
timestamp: "2026-05-15T00:00:00Z"
|
||||
actor: infospace-bench
|
||||
summary: Selected the Wealth/VSM legacy slice because it has source, entities, relation, evaluation, metrics, and engine sync evidence.
|
||||
memory_nodes:
|
||||
- question.memory-decisions
|
||||
- decision.file-backed-pilot
|
||||
- id: trace-event.boundary-check
|
||||
kind: review_gate
|
||||
timestamp: "2026-05-15T00:02:00Z"
|
||||
actor: infospace-bench
|
||||
summary: Confirmed the pilot should create fixtures and metrics, not reusable graph/event persistence.
|
||||
memory_nodes:
|
||||
- constraint.no-durable-runtime
|
||||
- policy.review-gate
|
||||
review_notes:
|
||||
- Keep this as a trace fixture until a runtime store exists behind kontextual-engine.
|
||||
- Convert only reviewed decisions and useful restart evidence into memory graph nodes.
|
||||
Reference in New Issue
Block a user