Joseph Spiker

spikerj opened issue spikerj/spikersoft-issues#488

2026-07-12 00:32:20 +00:00

[Bug][Backend][Security] Data Protection keys are ephemeral + unencrypted (container-local) — redeploy logs users out, replicas can't share keys

spikerj commented on issue spikerj/spikersoft-issues#486

2026-07-12 00:32:20 +00:00

[Bug][Prod] SafetyCheck art-pipe resident worker missing 'torch' → ArtPipeProcessor host crash-loops (24x)

Upstream root cause confirmed from Seq Warnings: ServeWorkerProcessFactory logs 'Model venv python not found at /opt/art_pipe/models/SafetyCheck/venv/bin/python; falling back to python3.…

spikerj commented on issue spikerj/spikersoft-issues#485

2026-07-12 00:28:20 +00:00

[Observability][Backend] Client-abort exceptions (OperationCanceled / 'client reset request stream') logged as Error + 500 — noise in Seq/traces

Resolved in spikersoft-backend PR #211 (merged to master). Client aborts (OperationCanceledException tied to RequestAborted; Kestrel 'client reset the request stream' IOException) now log…

spikerj closed issue spikerj/spikersoft-issues#485

2026-07-12 00:28:20 +00:00

[Observability][Backend] Client-abort exceptions (OperationCanceled / 'client reset request stream') logged as Error + 500 — noise in Seq/traces

spikerj opened issue spikerj/spikersoft-issues#487

2026-07-12 00:26:57 +00:00

[Bug][Backend] MediatR (Lucky Penny) commercial license expired — Error logged on every startup, renew before hard enforcement

spikerj opened issue spikerj/spikersoft-issues#486

2026-07-12 00:26:57 +00:00

[Bug][Prod] SafetyCheck art-pipe resident worker missing 'torch' → ArtPipeProcessor host crash-loops (24x)

spikerj commented on issue spikerj/spikersoft-issues#484

2026-07-12 00:23:40 +00:00

[Bug][Infra] API /healthz returns 503 — TileServerGL check failing (tiles.spikersoft.com 404s, no tile-server deployed)

API half merged (spikersoft-backend PR #210) — /healthz now reports Degraded/200 instead of 503 when only the tile server is missing; CI auto-deploys the API so the liveness symptom clears with…

spikerj commented on issue spikerj/spikersoft-issues#481

2026-07-12 00:23:03 +00:00

[Bug][Infra] jaeger_elasticsearch down ~24h on SERVER (exit 1) — MaxAttempts exhausted, tracing backend offline

Correction after checking Jaeger directly (http://192.168.0.105:16686): tracing is NOT down — /api/services returns 200 and traces are queryable (e.g. trace 2890c9d4...). So Jaeger is serving.

Ro…

spikerj opened issue spikerj/spikersoft-issues#485

2026-07-12 00:23:02 +00:00

[Observability][Backend] Client-abort exceptions (OperationCanceled / 'client reset request stream') logged as Error + 500 — noise in Seq/traces

spikerj commented on issue spikerj/spikersoft-issues#483

2026-07-12 00:17:58 +00:00

[Bug][Infra] InfluxDB rejecting a client every ~10s ("authorization not found") — stale/missing token on a poller

Triage from the repo side (no prod probing from this session): the ~10s cadence exactly matches Traefik's influxdb2 metrics push — traefik/docker-stack.yml pushes to https://influxdb.spikersoft.co…

spikerj commented on issue spikerj/spikersoft-issues#484

2026-07-12 00:17:58 +00:00

[Bug][Infra] API /healthz returns 503 — TileServerGL check failing (tiles.spikersoft.com 404s, no tile-server deployed)

API-side fix in spikersoft-backend PR (fix/healthz-tileserver-degraded-484): the check now honors the registered FailureStatus and is registered as Degraded — /healthz reports Degraded (HTTP 200)…

spikerj commented on issue spikerj/spikersoft-issues#483

2026-07-12 00:12:30 +00:00

[Bug][Infra] InfluxDB rejecting a client every ~10s ("authorization not found") — stale/missing token on a poller

Likely caller: spikersoft-backend (SpikerSoft.Api) polls InfluxDB every ~10s. Its health check hits /ping and /ready (no auth, so the check reports Healthy), but the app also fires POST /api/v2/que…

spikerj commented on issue spikerj/spikersoft-issues#483

2026-07-12 00:12:21 +00:00

[Bug][Infra] InfluxDB rejecting a client every ~10s ("authorization not found") — stale/missing token on a poller

Likely caller identified: spikersoft-backend (SpikerSoft.Api) polls InfluxDB every ~10s. Its InfluxDB health check hits /ping and /ready (no auth -> the health check reports Healthy), but…

spikerj opened issue spikerj/spikersoft-issues#484

2026-07-12 00:12:21 +00:00

[Bug][Infra] API /healthz returns 503 — TileServerGL check failing (tiles.spikersoft.com 404s, no tile-server deployed)

spikerj commented on issue spikerj/spikersoft-issues#481

2026-07-12 00:10:30 +00:00

[Bug][Infra] jaeger_elasticsearch down ~24h on SERVER (exit 1) — MaxAttempts exhausted, tracing backend offline

Repo-side hardening in spikersoft-infrastructure PR #30: both jaeger services move from restart_policy on-failure/max_attempts=3 (which is how the backend stayed dead ~24h — swarm permanently…

spikerj commented on issue spikerj/spikersoft-issues#480

2026-07-12 00:10:29 +00:00

[Bug][Infra] spikersoft-node-agent running on 1/10 nodes — rejected on missing /var/log/journal and /etc/timezone binds

Repo-side fix in spikersoft-infrastructure PR #29: dropped the redundant /etc/timezone bind (Debian-ism missing on laptop-server; /etc/localtime already provides the zone) and documented the…

spikerj closed issue spikerj/spikersoft-issues#235

2026-07-12 00:08:31 +00:00

chore(deps): pnpm 11.1.2 → 11.7.0 + config migration (deferred from #229)

spikerj closed issue spikerj/spikersoft-issues#479

2026-07-12 00:08:31 +00:00

[Bug][Infra] sonarqube_backups stuck in reject-loop — no Sonar backups running (missing placement constraint)

spikerj commented on issue spikerj/spikersoft-issues#479

2026-07-12 00:08:31 +00:00

[Bug][Infra] sonarqube_backups stuck in reject-loop — no Sonar backups running (missing placement constraint)

Resolved in spikersoft-infrastructure PR #28 (merged to master). Four defects fixed, not one: (1) the missing node.hostname == SERVER pin from this ticket; (2) pg_dump targeted -h postgres but the…

spikerj commented on issue spikerj/spikersoft-issues#235

2026-07-12 00:08:31 +00:00

chore(deps): pnpm 11.1.2 → 11.7.0 + config migration (deferred from #229)

Resolved in spikersoft-angular PR #163 (merged to master), going past the ticket's 11.7.0 to current latest 11.12.0: pnpm devDep ^11.12.0 + CI PNPM_VERSION 11.12.0 in all three workflows (was…