spikerj commented on issue spikerj/spikersoft-issues#489 2026-07-12 20:56:10 +00:00
[Bug][Backend] Missing reference data on prod — GeoLite2-City.mmdb + postal-code dataset absent, features degraded

Status split (2026-07-12, verified against prod /healthz):

  • Postal code data: RESOLVED — the health check now reports Healthy — Postal code data available: 317,784 records. Half of…
spikerj closed issue spikerj/spikersoft-issues#480 2026-07-12 20:55:31 +00:00
[Bug][Infra] spikersoft-node-agent running on 1/10 nodes — rejected on missing /var/log/journal and /etc/timezone binds
spikerj commented on issue spikerj/spikersoft-issues#480 2026-07-12 20:55:30 +00:00
[Bug][Infra] spikersoft-node-agent running on 1/10 nodes — rejected on missing /var/log/journal and /etc/timezone binds

Deployed and verified in production. Seq, 2026-07-12 19:39–19:42 UTC: 12 × "Host journal access available (mode=MountedDirectory, ...)" startup events across the fleet — 2 tasks reading the…

spikerj commented on issue spikerj/spikersoft-issues#481 2026-07-12 20:28:56 +00:00
[Bug][Infra] jaeger_elasticsearch down ~24h on SERVER (exit 1) — MaxAttempts exhausted, tracing backend offline

Fresh verification (2026-07-12 ~20:30 UTC) from the Jaeger query API: the tracing backend is serving and retaining traces again — /api/services lists the full service catalog, and trace…

spikerj closed issue spikerj/spikersoft-issues#345 2026-07-12 20:12:00 +00:00
[Bug] Authenticated app bootstrap crashes with NG0200 (circular DI) — blank shell for logged-in users
spikerj commented on issue spikerj/spikersoft-issues#345 2026-07-12 20:12:00 +00:00
[Bug] Authenticated app bootstrap crashes with NG0200 (circular DI) — blank shell for logged-in users

Closing with fresh evidence (2026-07-12). Fresh master production bundle, real Keycloak UI login, full authenticated walk (54 specs):

  • 0 × NG0200 anywhere in the run (the original crash…
spikerj opened issue spikerj/spikersoft-issues#514 2026-07-12 19:58:41 +00:00
[Infra][CI] Gitea Actions leaves GITEA-ACTION* volumes behind → build nodes recurrently fill up (need runner auto-cleanup / scheduled prune)
spikerj commented on issue spikerj/spikersoft-issues#480 2026-07-12 19:43:32 +00:00
[Bug][Infra] spikersoft-node-agent running on 1/10 nodes — rejected on missing /var/log/journal and /etc/timezone binds

Both PRs merged: backend #242 (journal-store resolver + volatile fallback; CI is shipping the new agent image now) and infra #47 (parent-dir binds /var/log + /run/log).

Remaining to close…

spikerj closed issue spikerj/spikersoft-issues#403 2026-07-12 19:43:32 +00:00
[infra drift] image-description & trellis3d deploy to /mnt/infrastructure folders that don't exist
spikerj commented on issue spikerj/spikersoft-issues#403 2026-07-12 19:43:31 +00:00
[infra drift] image-description & trellis3d deploy to /mnt/infrastructure folders that don't exist

Closing — both halves resolved:

  • image-description: infra #36 stack folder + CI deploy verified live in production (consumer drained the image.description.requested queue during the…
spikerj commented on issue spikerj/spikersoft-issues#403 2026-07-12 19:37:58 +00:00
[infra drift] image-description & trellis3d deploy to /mnt/infrastructure folders that don't exist

Trellis3d half: backend PR #243 makes the workflow workflow_dispatch-only. Every auto-triggered run was a guaranteed red X (the deploy step cds into `/mnt/infrastructure/spikersoft-trellis3…

spikerj commented on issue spikerj/spikersoft-issues#480 2026-07-12 19:34:13 +00:00
[Bug][Infra] spikersoft-node-agent running on 1/10 nodes — rejected on missing /var/log/journal and /etc/timezone binds

Architectural fix up — the runbook is no longer a deploy precondition. Two paired PRs:

backend #242 (fix/480-journal-dir-resolver): the agent now resolves the journal store **per tail…

spikerj opened issue spikerj/spikersoft-issues#513 2026-07-12 19:33:27 +00:00
[Bug][Infra][Deploy] docker-monitor: new correctly-named stack exits 0 on startup (stuck 0/1) + duplicate misspelled 'spiekersoft-docker-monitor' stack running in parallel
spikerj commented on issue spikerj/spikersoft-issues#483 2026-07-12 19:26:29 +00:00
[Bug][Infra] InfluxDB rejecting a client every ~10s ("authorization not found") — stale/missing token on a poller

Fix up: infra PR #46 (fix/483-traefik-influx-token-env). Attribution firmed up without probing the credential: SpikerSoft.Api's InfluxDB health check is currently Healthy in prod (its…

spikerj commented on issue spikerj/spikersoft-issues#512 2026-07-12 19:23:08 +00:00
[Bug][Frontend] Author's own staff-removed blog posts show on the dashboard with no moderation indicator

Closing: spikersoft-angular PR #167 merged — dashboard "Stories from the Road" cards now show a moderation badge overlay (gavel icon, "Removed by staff"/"Retirada por el personal", deletionRea…

spikerj commented on issue spikerj/spikersoft-issues#484 2026-07-12 19:23:08 +00:00
[Bug][Infra] API /healthz returns 503 — TileServerGL check failing (tiles.spikersoft.com 404s, no tile-server deployed)

Fresh production verification (2026-07-12): GET https://api.spikersoft.com/healthz now returns HTTP 200 / "Degraded" with only TileServerGL: Degraded — tile returned NotFound; the other…

spikerj closed issue spikerj/spikersoft-issues#512 2026-07-12 19:23:08 +00:00
[Bug][Frontend] Author's own staff-removed blog posts show on the dashboard with no moderation indicator
spikerj closed issue spikerj/spikersoft-issues#511 2026-07-12 19:23:07 +00:00
[Bug][Infra][Deploy] quiz-generation rolling update races the image push — 'No such image' reject loops + UpdateStatus=paused
spikerj closed issue spikerj/spikersoft-issues#505 2026-07-12 19:23:07 +00:00
[Bug][Infra] MinIO single drive faulted under first sustained concurrent write load — writers aborted mid-stream, task left LB
spikerj commented on issue spikerj/spikersoft-issues#511 2026-07-12 19:23:07 +00:00
[Bug][Infra][Deploy] quiz-generation rolling update races the image push — 'No such image' reject loops + UpdateStatus=paused

Closing with evidence: backend PR #239 merged (deploy-race gate — post-push docker manifest inspect retry, 12×5s — now guards all 28 image-publishing workflows incl. quiz-generation) and…