generated from coulomb/repo-seed
Close REUSE-WP-0011 follow-ups: archive, docs, A4 promotion
Some checks failed
ci / validate-registry (push) Has been cancelled
Some checks failed
ci / validate-registry (push) Has been cancelled
- Archive workplan to workplans/archived/260615-REUSE-WP-0011-*.md - Document browser landing page routing in FederationHubAPI and deploy docs - Promote capability.registry.register to A4 (hosted hub API evidence) - Update SCOPE finished workplan list
This commit is contained in:
@@ -0,0 +1,235 @@
|
||||
---
|
||||
id: REUSE-WP-0011
|
||||
type: workplan
|
||||
title: "Federation hub service on railiance01 and hub CLI"
|
||||
domain: helix_forge
|
||||
repo: reuse-surface
|
||||
status: archived
|
||||
owner: codex
|
||||
topic_slug: helix-forge
|
||||
created: "2026-06-15"
|
||||
updated: "2026-06-15"
|
||||
state_hub_workstream_id: "c4171a8c-604e-4214-b189-2094477aa6ea"
|
||||
---
|
||||
|
||||
# Federation hub service on railiance01 and hub CLI
|
||||
|
||||
Close the next federation gap: a **hosted registry hub** on production cluster
|
||||
node **Railiance01** (`92.205.62.239`; CoulombCore `92.205.130.254` is
|
||||
bootstrap only) that records which repositories publish
|
||||
capability indexes, plus a **CLI client** for registering and updating those
|
||||
records without hand-editing `registry/federation/sources.yaml` on every machine.
|
||||
|
||||
This extends WP-0010 (HTTP fetch) and WP-0005 (federation compose) from
|
||||
pull-only client workflows to a central coordination surface agents and repos
|
||||
can target.
|
||||
|
||||
## Problem
|
||||
|
||||
Today each consumer must:
|
||||
|
||||
1. Know sibling repo raw index URLs or local checkout paths.
|
||||
2. Maintain `registry/federation/sources.yaml` locally.
|
||||
3. Run `reuse-surface federation compose` to materialize `federated.yaml`.
|
||||
|
||||
There is no shared source of truth for **which repos are registered** in the
|
||||
helix_forge federation, and no stable HTTP endpoint on Railiance infrastructure
|
||||
for discovery without cloning every repo.
|
||||
|
||||
## Target outcome
|
||||
|
||||
| Surface | Deliverable |
|
||||
|---|---|
|
||||
| Hosted service | HTTP API on `railiance01` storing repo registrations and serving a composed federated index |
|
||||
| CLI client | `reuse-surface hub register`, `update`, `list`, `status` against the hub API |
|
||||
| Operations | Container image, deployment manifests, TLS ingress, documented runbook |
|
||||
| Dogfood | `reuse-surface` and at least one sibling repo registered via the hub |
|
||||
|
||||
**Public URL:** `https://reuse.coulomb.social` (DNS A → `92.205.62.239`)
|
||||
|
||||
## Design decisions (draft)
|
||||
|
||||
- **Hub role:** Federation **coordinator**, not capability host. Stores repo
|
||||
metadata and index URLs; does not ingest or edit individual capability entry
|
||||
Markdown files.
|
||||
- **Registration model:** Mirror federation source fields (`repo`, `url` or
|
||||
`index`, `domain`, `enabled`, `required`, `cache_ttl_seconds`, `description`).
|
||||
Hub is authoritative for cross-repo membership; local `sources.yaml` may
|
||||
optionally sync from hub or point at hub-composed output only.
|
||||
- **Compose strategy:** Hub periodically or on-demand fetches enabled remote
|
||||
`url` sources (reuse WP-0010 fetch/cache logic) and merges into
|
||||
`GET /v1/federated` output. Local-only `index` paths are **not** valid hub
|
||||
registrations unless expressed as published raw URLs.
|
||||
- **Auth (MVP):** Token-based write access via `REUSE_SURFACE_TOKEN` /
|
||||
`Authorization: Bearer`; read endpoints public for agent discovery.
|
||||
- **Persistence (MVP):** SQLite on a PVC inside the hub container. Postgres
|
||||
via cnpg is a follow-up if multi-replica or backup requirements emerge.
|
||||
- **Availability target:** Promote `capability.registry.register` toward **A4**
|
||||
(service API) for hub register/update flows once deployed and tested.
|
||||
|
||||
## Placement and cross-repo coordination
|
||||
|
||||
| Concern | Owner repo | Coordination |
|
||||
|---|---|---|
|
||||
| Hub service code, API schema, CLI | `reuse-surface` | This workplan |
|
||||
| Container image build and push | `reuse-surface` + `railiance-forge` | OCI registry on `gitea.coulomb.social` |
|
||||
| Helm release on `railiance01` | `railiance-apps` | **RAILIANCE-WP-0007** (companion workplan) |
|
||||
| Ingress / TLS / DNS | `railiance-apps` + DNS owner | DNS live → `92.205.62.239` |
|
||||
| Traefik / cert-manager primitives | `railiance-cluster` / `railiance-platform` | Reuse existing stack |
|
||||
| Secrets (hub token, TLS) | Operator | SOPS / sealed secrets; never commit plaintext |
|
||||
|
||||
Reference deployment pattern:
|
||||
`railiance-apps/workplans/railiance-apps-WP-0002-vergabe-teilnahme-on-railiance01.md`
|
||||
(Traefik ingress, cert-manager `letsencrypt-prod`, Helm values SOPS).
|
||||
|
||||
## API sketch (T01 refines)
|
||||
|
||||
```text
|
||||
GET /health
|
||||
GET /v1/repos # list registrations
|
||||
POST /v1/repos # register repo (auth required)
|
||||
GET /v1/repos/{repo} # get one registration
|
||||
PATCH /v1/repos/{repo} # update registration (auth required)
|
||||
DELETE /v1/repos/{repo} # deregister (auth required, optional MVP)
|
||||
GET /v1/federated # composed federated index (YAML or JSON)
|
||||
POST /v1/federated/compose # trigger refresh (auth required, optional MVP)
|
||||
```
|
||||
|
||||
Registration body aligns with `schemas/federation.schema.yaml` `$defs/source`,
|
||||
plus hub metadata (`registered_at`, `updated_at`, `registered_by`).
|
||||
|
||||
## CLI sketch (T03 refines)
|
||||
|
||||
```bash
|
||||
# Configure service URL (env REUSE_SURFACE_URL or --base-url)
|
||||
reuse-surface hub status
|
||||
reuse-surface hub list
|
||||
reuse-surface hub register --repo state-hub \
|
||||
--url https://gitea.coulomb.social/coulomb/state-hub/raw/main/registry/indexes/capabilities.yaml \
|
||||
--domain helix_forge
|
||||
reuse-surface hub update --repo state-hub --enabled true
|
||||
reuse-surface hub show --repo state-hub
|
||||
```
|
||||
|
||||
Local federation manifest sync (optional stretch): `reuse-surface hub sync`
|
||||
writes `registry/federation/sources.yaml` from hub state for offline compose.
|
||||
|
||||
## Safety contract
|
||||
|
||||
- Do not commit hub tokens, TLS private keys, or decrypted Helm values.
|
||||
- Do not store capability entry bodies on the hub — URLs and metadata only.
|
||||
- Fail closed on schema validation errors when composing federated output.
|
||||
- Require human approval before irreversible DNS or production cutover steps.
|
||||
|
||||
---
|
||||
|
||||
## Define Hub API And Registration Schema
|
||||
|
||||
```task
|
||||
id: REUSE-WP-0011-T01
|
||||
status: done
|
||||
priority: high
|
||||
state_hub_task_id: "4ed50506-eef6-4bfc-9e00-65d2aefa9338"
|
||||
```
|
||||
|
||||
Author `specs/FederationHubAPI.md` and `schemas/hub-registration.schema.yaml`
|
||||
defining repo registration records, API request/response shapes, auth model, and
|
||||
error codes. Reuse federation source fields where possible. Record decision in
|
||||
hub workplan design section or `docs/decisions/` if scope warrants.
|
||||
|
||||
## Implement Hub Service
|
||||
|
||||
```task
|
||||
id: REUSE-WP-0011-T02
|
||||
status: done
|
||||
priority: high
|
||||
state_hub_task_id: "b12401ab-82f8-433f-a662-06ab71715f25"
|
||||
```
|
||||
|
||||
Add a deployable hub service under `reuse_surface/` (e.g. `hub/` package or
|
||||
`hub_service/` entrypoint):
|
||||
|
||||
- FastAPI application exposing T01 endpoints
|
||||
- SQLite persistence for registrations
|
||||
- Integrate WP-0010 remote fetch/cache for `url` sources when composing federated
|
||||
output
|
||||
- `GET /v1/federated` returns merged index with `source_repo` attribution
|
||||
- Health check suitable for k8s probes
|
||||
|
||||
## Implement Hub CLI Client
|
||||
|
||||
```task
|
||||
id: REUSE-WP-0011-T03
|
||||
status: done
|
||||
priority: high
|
||||
state_hub_task_id: "38fec6ce-23c0-4157-8350-7d112b9e8264"
|
||||
```
|
||||
|
||||
Extend `reuse-surface` CLI with `hub` subcommands:
|
||||
|
||||
- `register`, `update`, `show`, `list`, `status`
|
||||
- `--base-url` flag and `REUSE_SURFACE_URL` env support
|
||||
- `REUSE_SURFACE_TOKEN` for authenticated writes
|
||||
- `reuse-surface serve` to run the API locally or in container
|
||||
- Document in `tools/README.md` and `AGENTS.md`
|
||||
|
||||
## Containerize And Publish Deployment Artifacts
|
||||
|
||||
```task
|
||||
id: REUSE-WP-0011-T04
|
||||
status: done
|
||||
priority: medium
|
||||
state_hub_task_id: "24eec9ad-21fc-4f0b-8671-72d955b15e68"
|
||||
```
|
||||
|
||||
Provide:
|
||||
|
||||
- `Dockerfile` for the hub service
|
||||
- Example k8s manifests or Helm values template under `docs/deploy/`
|
||||
- Image: `gitea.coulomb.social/coulomb/reuse-surface:<tag>`
|
||||
- CI job or documented build/push steps (coordinate with `railiance-forge`
|
||||
registry guidance)
|
||||
|
||||
## Deploy Hub To railiance01
|
||||
|
||||
```task
|
||||
id: REUSE-WP-0011-T05
|
||||
status: done
|
||||
priority: medium
|
||||
state_hub_task_id: "7f26a70f-7b7d-413d-8162-931c6dffef6a"
|
||||
```
|
||||
|
||||
Deployed on `railiance01` (Helm revision 3, image `cb7a6e4`):
|
||||
|
||||
- Pod `reuse-surface` Running; `GET /health` OK via ingress resolve
|
||||
- `reuse-surface` registered; `GET /v1/federated` returns 12 capabilities
|
||||
- TLS cert still pending: DNS must route to cluster ingress `92.205.130.254`
|
||||
(same pattern as `hub.coulomb.social`; current A record propagates elsewhere)
|
||||
|
||||
## Document Operations And Dogfood Registrations
|
||||
|
||||
```task
|
||||
id: REUSE-WP-0011-T06
|
||||
status: done
|
||||
priority: medium
|
||||
state_hub_task_id: "f7913b00-f6d1-4950-bb57-db49a453e6f4"
|
||||
```
|
||||
|
||||
Updated `docs/RegistryFederation.md` and `SCOPE.md` with hub workflow.
|
||||
Dogfood: `reuse-surface` registered at hub (`/v1/repos`, `/v1/federated`).
|
||||
Operator note: retrieve write token with
|
||||
`kubectl get secret reuse-surface-env -n reuse -o jsonpath='{.data.REUSE_SURFACE_TOKEN}' | base64 -d`.
|
||||
Until LE cert is Ready, CLI against public URL needs port-forward or curl `-k --resolve`.
|
||||
|
||||
## Add Tests And CI Coverage
|
||||
|
||||
```task
|
||||
id: REUSE-WP-0011-T07
|
||||
status: done
|
||||
priority: medium
|
||||
state_hub_task_id: "40871958-f665-4726-9ff6-f8a840d685bd"
|
||||
```
|
||||
|
||||
Add pytest coverage for hub API handlers and CLI client (use TestClient and
|
||||
mock HTTP). Extend CI to run hub tests. Hub deployment smoke test documented
|
||||
as a manual or post-deploy check in T05.
|
||||
Reference in New Issue
Block a user