Joseph Spiker spikerj
  • Joined on 2025-11-03
spikerj opened issue spikerj/spikersoft-issues#704 2026-07-18 23:56:34 +00:00
[GpuCoordinator][Bug] Lease grant races physical VRAM eviction — quiz-generation grant-fail-release cycles to DLQ while ImageDescription yields correctly
spikerj commented on issue spikerj/spikersoft-issues#703 2026-07-18 22:57:49 +00:00
[Backend][Bug] Embeddings (and latent: quiz-generation) model self-provision fails — named cache volume root-owned, worker runs as app (#527 fallout)

Fix verified live end-to-end (2026-07-18 ~22:57Z): PR #421 merged + deployed, both prod volumes chowned to 999:999 (quiz-generation on 4090 directly; embeddings via one-shot SERVER-pinned job).…

spikerj closed issue spikerj/spikersoft-issues#703 2026-07-18 22:51:05 +00:00
[Backend][Bug] Embeddings (and latent: quiz-generation) model self-provision fails — named cache volume root-owned, worker runs as app (#527 fallout)
spikerj opened issue spikerj/spikersoft-issues#703 2026-07-18 22:46:29 +00:00
[Backend][Bug] Embeddings (and latent: quiz-generation) model self-provision fails — named cache volume root-owned, worker runs as app (#527 fallout)
spikerj commented on issue spikerj/spikersoft-issues#698 2026-07-18 22:27:32 +00:00
[Bug][Reliability] Workers pass healthcheck with a DEAD RabbitMQ consumer → pipeline stages silently stall (image.description: 128 msgs/0 consumers)

Durable fixes are up as spikersoft-backend PR #420 (branch fix/698-lease-deadlock-durable): (1) coordinator replies GpuLeaseRejectMessage on stale discard instead of silently dropping; (2) Python…

spikerj commented on issue spikerj/spikersoft-issues#698 2026-07-18 22:09:08 +00:00
[Bug][Reliability] Workers pass healthcheck with a DEAD RabbitMQ consumer → pipeline stages silently stall (image.description: 128 msgs/0 consumers)

Recurred 2026-07-18, and the mechanism is now fully root-caused — it's a compound failure across the Python worker and the gpu-coordinator:

  1. 07:02Z swarm leader blip → both `spikersoft-image-d…
spikerj closed issue spikerj/spikersoft-issues#702 2026-07-18 20:36:55 +00:00
[ArtPipe][Bug] Modeling stage fails offline — TripoSR's DINO image encoder (facebook/dino-vitb16) never baked (same class as #699)
spikerj opened issue spikerj/spikersoft-issues#702 2026-07-18 20:34:50 +00:00
[ArtPipe][Bug] Modeling stage fails offline — TripoSR's DINO image encoder (facebook/dino-vitb16) never baked (same class as #699)
spikerj closed issue spikerj/spikersoft-issues#701 2026-07-18 19:45:55 +00:00
Move My Journey into the playground curriculum pane as a Progress tab
spikerj opened issue spikerj/spikersoft-issues#701 2026-07-18 19:44:25 +00:00
Move My Journey into the playground curriculum pane as a Progress tab
spikerj closed issue spikerj/spikersoft-issues#620 2026-07-18 18:46:20 +00:00
EPUB sidebar chapter nav is off by one (loads the page before the chapter)
spikerj closed issue spikerj/spikersoft-issues#624 2026-07-18 18:40:08 +00:00
[Infra][CI] lesson-video-processor never deploys: swarm service name 67 chars exceeds 63-char limit (stack+service name doubled)
spikerj commented on issue spikerj/spikersoft-issues#624 2026-07-18 18:40:08 +00:00
[Infra][CI] lesson-video-processor never deploys: swarm service name 67 chars exceeds 63-char limit (stack+service name doubled)

Verified resolved end-to-end — closing. (Ticket-triage loop 2026-07-18.)

  1. Fix applied: spikersoft-infrastructure commit c647854 renamed the service key to worker (with an in-file…
spikerj closed issue spikerj/spikersoft-issues#690 2026-07-18 18:37:27 +00:00
[Security][Hardening] JWT validation deviates from secure defaults: RequireHttpsMetadata=false, ValidateIssuer=false
spikerj commented on issue spikerj/spikersoft-issues#690 2026-07-18 18:37:27 +00:00
[Security][Hardening] JWT validation deviates from secure defaults: RequireHttpsMetadata=false, ValidateIssuer=false

Resolved in backend PR #417 (merged to master 2026-07-18). Production now runs require-https=true + validate-issuer=true

spikerj commented on issue spikerj/spikersoft-issues#663 2026-07-18 18:37:27 +00:00
Reading Journey: quiz answer review never shows correct answers/explanations (no backend endpoint ships the answer key)

Backend half up as PR #419 (mergeable). Claim verified: QuizForReviewDto/ToReviewDto() existed with the full answer key…

spikerj commented on issue spikerj/spikersoft-issues#698 2026-07-18 18:37:27 +00:00
[Bug][Reliability] Workers pass healthcheck with a DEAD RabbitMQ consumer → pipeline stages silently stall (image.description: 128 msgs/0 consumers)

Framework half merged — PR #418 is on master: every EventHandlerHostBuilder worker's /healthz now fails (→ Swarm…

spikerj commented on issue spikerj/spikersoft-issues#698 2026-07-18 18:32:34 +00:00
[Bug][Reliability] Workers pass healthcheck with a DEAD RabbitMQ consumer → pipeline stages silently stall (image.description: 128 msgs/0 consumers)

Framework half fixed — backend PR #418. Verified the root-cause claim first: /healthz really ran zero checks

spikerj commented on issue spikerj/spikersoft-issues#690 2026-07-18 18:25:14 +00:00
[Security][Hardening] JWT validation deviates from secure defaults: RequireHttpsMetadata=false, ValidateIssuer=false

Verify-first step completed; hardening up as backend PR #417.

Verification performed (the gate this ticket set before…

spikerj commented on issue spikerj/spikersoft-issues#529 2026-07-18 18:23:27 +00:00
[Infra][MinIO] Uploads-tree coordinated batch cutover — 7 services off /mnt/fusionio (epic #413)

Phase-0 checklist update after the 2026-07-18 provision run + merges (infra #125/#126/#127, backend #415):

  • #613 movement-svc — created in MinIO with movement-svc-storage; **one…