Recovered. The node is Ready / Active / Reachable, it is carrying tasks again, and the whole manager set is reachable with a stable leader.
The concrete casualty in this ticket is also…
Found it: it's Traefik's InfluxDB metrics push
Traefik's metrics.influxdb2 exporter pushes on a 10s interval by default — an exact match for the reported cadence (90 rejections per…
Diagnosis + fix in PR #275 (with #559 — same mechanism, one PR).
Root cause — three separate holes, all in BookAnalysisService:
- **
ExtractChaptersWithLLMhad a blanket `catch…
Diagnosis: host-side jtop dependency, not config and not credentials
The reporter reads each board's stats from the host's jtop daemon over a bind-mounted unix socket (/run/jtop.sock).…
Diagnosis + fix in PR #275 (with #557 — same mechanism, one PR).
Root cause. QuizGenerationService.ParseGeneratedQuestions returned an empty list whenever the model's JSON was…
Verified against the live endpoint before touching anything — this is already fixed and deployed.
/healthz currently returns HTTP 200 with status Degraded (12 checks Healthy,…
Diagnosis — your option 1 is correct
The tile service was never deployed / was decommissioned. Verified read-only against the swarm: a scan of all **94 services matches nothing on…
Diagnosis
Confirmed, and the headline symptom is already resolved.
The 503 is gone. /healthz currently returns HTTP 200 / "status": "Degraded" — 12 checks Healthy, TileServerG…
Acute condition resolved: SERVER root is now 32% used, 286 GB free (was 94% and climbing, alerting every ~2 min).
Reclaimed by moving the MinIO data root onto the FusionIO card and deleting…
Both halves are fixed and verified.
The VRAM lease under-declaration — image-description declared a 16 GB lease while actually holding 18.2 GiB, so the coordinator believed there was room to…
Root cause is deeper than the crash loop, and the crash loop was hiding it.
The image pin is fixed — ES 8.11.0 (matching what wrote the data volume) is now 1/1, cluster green, stable through…
I need to rebuild this image from my windows desktop, and include the information and repo into the spikersoft infra repo.. put this on hold until I go this
QA Team — symptom resolved 2026-07-14 ~06:10Z: remediation's disk-space incidents for SERVER:/ stopped firing (last occurrence #98; the detector fires every ~2 min while above threshold,…
QA Team — ✅ END-TO-END VERIFIED, 2026-07-14 05:58:03Z: quiz generation for book 6a55ad64… completed with 42 questions — Stage=Completed, user notified. First successful quiz since…