Joseph Spiker spikerj
  • Joined on 2025-11-03
spikerj commented on issue spikerj/spikersoft-issues#419 2026-07-12 21:44:33 +00:00
[lint coverage] ~75 library projects are unlinted by CI + their eslint configs reference uninstalled plugins

Slice 2 up: angular PR #173wasm-voxel is back under lint, coverage 66 → 67.

The real mechanism behind its 78 "errors": nearly all were Definition for rule not found — the…

spikerj commented on issue spikerj/spikersoft-issues#513 2026-07-12 21:40:14 +00:00
[Bug][Infra][Deploy] docker-monitor: new correctly-named stack exits 0 on startup (stuck 0/1) + duplicate misspelled 'spiekersoft-docker-monitor' stack running in parallel

Update: the exit-0 half is FIXED — docker-monitor was redeployed at 21:35 on a new digest 8afdb709 (was the crashing c14863a1) and the correctly-named spikersoft-docker-monitor is now Running…

spikerj commented on issue spikerj/spikersoft-issues#510 2026-07-12 21:40:14 +00:00
[Exploration][Infra] Resilience to SERVER node flaps — restart-policy windows, auto-reconcile sweep, de-SPOF the SERVER-pinned stateful tier

Item B (auto-reconcile sweep) has LANDED — commit b96976bd 'feat(docker-monitor): auto-reconcile sweep for stranded services (#510-B)'. Adds ServiceAutoReconciler.cs (167 LOC) wired into…

spikerj commented on issue spikerj/spikersoft-issues#482 2026-07-12 21:31:31 +00:00
[Bug][Infra] Keycloak Postgres TOAST corruption (pg_toast_2619 / pg_statistic) — ClearExpiredEvents failing, events not purged

Recovery runbook up: infra PR #49docs/keycloak-postgres-toast-recovery.md. Summary of the approach (full detail + exact commands in the doc):

  1. Blast-radius gate: `SELECT count(*)…
spikerj commented on issue spikerj/spikersoft-issues#493 2026-07-12 21:29:49 +00:00
[Infra][MinIO] Pilot: deploy MinIO + migrate security-scanner off /mnt/fusionio to S3 (proves the pattern for #413)

Staging mirror verified live in production (the gate this ticket was waiting on). Two real uploads today:

  • 19:52:52 UTC — `S3StagingMirror: Staging mirror: uploaded uploads/ebooks/spikerj_17…
spikerj commented on issue spikerj/spikersoft-issues#513 2026-07-12 21:27:00 +00:00
[Bug][Infra][Deploy] docker-monitor: new correctly-named stack exits 0 on startup (stuck 0/1) + duplicate misspelled 'spiekersoft-docker-monitor' stack running in parallel

Root-caused and fixed — backend PR #245. I pulled the exact c14863a1 amd64 image and ran it locally: the container is NOT silent — it logs a loud Serilog fatal and exits 0:

Unable to…
spikerj commented on issue spikerj/spikersoft-issues#514 2026-07-12 21:23:35 +00:00
[Infra][CI] Gitea Actions leaves GITEA-ACTION* volumes behind → build nodes recurrently fill up (need runner auto-cleanup / scheduled prune)

Durable fix up: infra PR #48gitea-act-runner/cleanup/ with a name-filtered prune script (GITEA-ACTION* volumes + GITEA-ACTIONS-* networks + 48h build-cache + dangling images; real named…

spikerj commented on issue spikerj/spikersoft-issues#419 2026-07-12 21:06:32 +00:00
[lint coverage] ~75 library projects are unlinted by CI + their eslint configs reference uninstalled plugins

Correction on the spikersoft-web exclude note in PR #172: a completed solo run shows it fails lint normally (exit 1 with failed task, not a silent crash — my earlier check just caught it…

spikerj commented on issue spikerj/spikersoft-issues#419 2026-07-12 21:05:43 +00:00
[lint coverage] ~75 library projects are unlinted by CI + their eslint configs reference uninstalled plugins

First slice up: angular PR #172 — CI lint coverage goes from the curated 7 projects to 66 (nx run-many -t lint --all with a 9-project exclude list, so new libraries are covered by…

spikerj commented on issue spikerj/spikersoft-issues#489 2026-07-12 20:56:10 +00:00
[Bug][Backend] Missing reference data on prod — GeoLite2-City.mmdb + postal-code dataset absent, features degraded

Status split (2026-07-12, verified against prod /healthz):

  • Postal code data: RESOLVED — the health check now reports Healthy — Postal code data available: 317,784 records. Half of…
spikerj closed issue spikerj/spikersoft-issues#480 2026-07-12 20:55:31 +00:00
[Bug][Infra] spikersoft-node-agent running on 1/10 nodes — rejected on missing /var/log/journal and /etc/timezone binds
spikerj commented on issue spikerj/spikersoft-issues#480 2026-07-12 20:55:30 +00:00
[Bug][Infra] spikersoft-node-agent running on 1/10 nodes — rejected on missing /var/log/journal and /etc/timezone binds

Deployed and verified in production. Seq, 2026-07-12 19:39–19:42 UTC: 12 × "Host journal access available (mode=MountedDirectory, ...)" startup events across the fleet — 2 tasks reading the…

spikerj commented on issue spikerj/spikersoft-issues#481 2026-07-12 20:28:56 +00:00
[Bug][Infra] jaeger_elasticsearch down ~24h on SERVER (exit 1) — MaxAttempts exhausted, tracing backend offline

Fresh verification (2026-07-12 ~20:30 UTC) from the Jaeger query API: the tracing backend is serving and retaining traces again/api/services lists the full service catalog, and trace…

spikerj closed issue spikerj/spikersoft-issues#345 2026-07-12 20:12:00 +00:00
[Bug] Authenticated app bootstrap crashes with NG0200 (circular DI) — blank shell for logged-in users
spikerj commented on issue spikerj/spikersoft-issues#345 2026-07-12 20:12:00 +00:00
[Bug] Authenticated app bootstrap crashes with NG0200 (circular DI) — blank shell for logged-in users

Closing with fresh evidence (2026-07-12). Fresh master production bundle, real Keycloak UI login, full authenticated walk (54 specs):

  • 0 × NG0200 anywhere in the run (the original crash…
spikerj opened issue spikerj/spikersoft-issues#514 2026-07-12 19:58:41 +00:00
[Infra][CI] Gitea Actions leaves GITEA-ACTION* volumes behind → build nodes recurrently fill up (need runner auto-cleanup / scheduled prune)
spikerj commented on issue spikerj/spikersoft-issues#480 2026-07-12 19:43:32 +00:00
[Bug][Infra] spikersoft-node-agent running on 1/10 nodes — rejected on missing /var/log/journal and /etc/timezone binds

Both PRs merged: backend #242 (journal-store resolver + volatile fallback; CI is shipping the new agent image now) and infra #47 (parent-dir binds /var/log + /run/log).

Remaining to close

spikerj closed issue spikerj/spikersoft-issues#403 2026-07-12 19:43:32 +00:00
[infra drift] image-description & trellis3d deploy to /mnt/infrastructure folders that don't exist
spikerj commented on issue spikerj/spikersoft-issues#403 2026-07-12 19:43:31 +00:00
[infra drift] image-description & trellis3d deploy to /mnt/infrastructure folders that don't exist

Closing — both halves resolved:

  • image-description: infra #36 stack folder + CI deploy verified live in production (consumer drained the image.description.requested queue during the…
spikerj commented on issue spikerj/spikersoft-issues#403 2026-07-12 19:37:58 +00:00
[infra drift] image-description & trellis3d deploy to /mnt/infrastructure folders that don't exist

Trellis3d half: backend PR #243 makes the workflow workflow_dispatch-only. Every auto-triggered run was a guaranteed red X (the deploy step cds into `/mnt/infrastructure/spikersoft-trellis3…