Files
llm-connect/deploy/k8s/activity-core-llm-connect
tegwick 90eb39c247
Some checks failed
CI / test (3.10) (push) Has been cancelled
CI / test (3.11) (push) Has been cancelled
CI / test (3.12) (push) Has been cancelled
Complete activity-core LLM endpoint handoff (LLM-WP-0006)
Switch the custodian triage default from anthropic/claude-sonnet-4 to
google/gemini-2.5-flash, which advertises structured-output support on
OpenRouter. Tighten the OpenRouter adapter to send strict JSON schema
requests and set provider.require_parameters=true so routing only hits
providers that honor the requested response_format.

Update Kubernetes deploy docs and config for the verified coulombcore
handoff: Containerfile build path, image-pull-policy=Never for smoke
pods, credential-routing notes, and live smoke evidence. Mark
LLM-WP-0006 finished with closure notes from 2026-06-18.
2026-06-19 13:51:12 +02:00
..

activity-core llm-connect Service

This overlay deploys llm-connect as an internal activity-core namespace service for daily WSJF triage.

Stable in-cluster URL after apply:

http://llm-connect.activity-core.svc.cluster.local:8080

Create provider credentials outside Git before applying the Deployment. For the default OpenRouter config:

kubectl -n activity-core create secret generic llm-connect-provider-secrets \
  --from-literal=OPENROUTER_API_KEY="$OPENROUTER_API_KEY"

Provider API key custody belongs to the operator/OpenBao-to-Kubernetes Secret path. ops-warden documents this as outside its issuance scope; do not paste key values into Git, State Hub, logs, or chat.

Apply:

docker build -f Containerfile -t docker.io/library/llm-connect:latest .
docker save docker.io/library/llm-connect:latest | ssh coulombcore sudo k3s ctr -n k8s.io images import -
kubectl apply -k deploy/k8s/activity-core-llm-connect
kubectl -n activity-core rollout status deployment/llm-connect

Smoke from inside the namespace, using an image that includes this repo's fixtures and scripts/smoke_activity_core_endpoint.py:

kubectl -n activity-core run llm-connect-smoke \
  --rm -i --restart=Never \
  --image=llm-connect:latest \
  --image-pull-policy=Never \
  --env=LLM_CONNECT_URL=http://llm-connect.activity-core.svc.cluster.local:8080 \
  --env=LLM_CONNECT_TIMEOUT_SECONDS=300 \
  -- python scripts/smoke_activity_core_endpoint.py

Then set activity-core's runtime config:

LLM_CONNECT_URL=http://llm-connect.activity-core.svc.cluster.local:8080
LLM_CONNECT_TIMEOUT_SECONDS=300

Do not commit provider keys, live prompt payloads, or smoke response bodies that contain operational State Hub data.