Joseph Spiker

spikerj opened issue spikerj/spikersoft-issues#595

2026-07-14 21:15:33 +00:00

[Bug][Prod][ArtPipe] Concept-art generation is silently dead — consumer can NEVER start (artpipe-gpu pin vs SERVER-only /mnt/fusionio bind, same class as #553) and SDXL generator is at replicas=0; live user request stuck unread in queue

spikerj opened issue spikerj/spikersoft-issues#594

2026-07-14 21:12:24 +00:00

[Bug][Backend][Observability] Serilog MinimumLevel is hardcoded to Debug in EventHandlerHostBuilder — EVERY appsettings log-level setting is dead config, and ~2.9M Debug events/day are shipped to Seq

spikerj commented on issue spikerj/spikersoft-issues#557

2026-07-14 21:12:22 +00:00

[Bug][Backend] BookAnalysisService (ExtractChapters / AnalyzeBookWithLLM) silently ships degraded book data on GPU/model-load failure — same class as quiz-gen #553, different pipeline

Status check after PR #275 (merged to master at 06:31Z, b3287f5).

The silent-degradation half is fixed and shipped. Verified on master: the blanket `catch (Exception) { return new…

spikerj opened issue spikerj/spikersoft-issues#593

2026-07-14 21:12:06 +00:00

[Bug][Backend][Books] Chapter extraction is orphaned end-to-end — nothing ever populates Book.Chapters, and GET /books/{id}/chapters returns [] for every book, always

spikerj closed issue spikerj/spikersoft-issues#559

2026-07-14 21:11:14 +00:00

[Bug][Backend][Quality] Quiz pages whose LLM output fails JSON parsing silently contribute 0 questions (WRN only) — quizzes ship smaller than requested

spikerj commented on issue spikerj/spikersoft-issues#559

2026-07-14 21:11:10 +00:00

[Bug][Backend][Quality] Quiz pages whose LLM output fails JSON parsing silently contribute 0 questions (WRN only) — quizzes ship smaller than requested

Resolved in spikersoft-backend PR #275, merged to master at 06:31Z (b3287f5). Verified present on master: QuizResponseParser, LlmOutputUnparsableException, Quiz.DegradedPageNumbers,…

spikerj closed issue spikerj/spikersoft-issues#591

2026-07-14 21:09:15 +00:00

[Bug][Tests][Curriculum] CurriculumSmokeTests picks whatever python3 is first on PATH — macOS system Python 3.9 fails the match-statement lessons (21300/21301) with a raw SyntaxError

spikerj commented on issue spikerj/spikersoft-issues#591

2026-07-14 21:09:10 +00:00

[Bug][Tests][Curriculum] CurriculumSmokeTests picks whatever python3 is first on PATH — macOS system Python 3.9 fails the match-statement lessons (21300/21301) with a raw SyntaxError

Resolved in spikersoft-backend PR #287 (merged to master).

Root cause was neither the curriculum nor the product code: the test harness invoked bare python3, which on macOS resolves to the…

spikerj closed issue spikerj/spikersoft-issues#574

2026-07-14 21:09:02 +00:00

[Bug][Backend][API] UploadBookCommandHandler.Lean reads its own RabbitMQ:* config with hardcoded 'dockerUser/dockerPassword' defaults — bypasses the shared messaging config path

spikerj commented on issue spikerj/spikersoft-issues#574

2026-07-14 21:08:58 +00:00

[Bug][Backend][API] UploadBookCommandHandler.Lean reads its own RabbitMQ:* config with hardcoded 'dockerUser/dockerPassword' defaults — bypasses the shared messaging config path

Resolved in spikersoft-backend PR #286 (merged to master).

The hardcoded credentials are gone, but the more serious bug was one this ticket didn't mention: both publish sites were **fire-and-for…

spikerj closed issue spikerj/spikersoft-issues#588

2026-07-14 21:08:39 +00:00

[Bug][Telemetry] Every service reports service.namespace='1.0.0' — AddService()'s 2nd positional arg is serviceNamespace, not serviceVersion. Spans also carry no node identity

spikerj commented on issue spikerj/spikersoft-issues#588

2026-07-14 21:08:36 +00:00

[Bug][Telemetry] Every service reports service.namespace='1.0.0' — AddService()'s 2nd positional arg is serviceNamespace, not serviceVersion. Spans also carry no node identity

Both PRs are merged to master:

spikersoft-backend #288 — named-arg AddService behind a shared SpikerSoftResource, host.name node identity, and TraceSources.KeycloakEvents…

spikerj commented on issue spikerj/spikersoft-issues#587

2026-07-14 21:07:07 +00:00

[Bug][Prod][Registry] 14 images have no :latest manifest (manifest unknown / 404) — any reschedule onto a fresh node will fail to start

QA Team — RETRACTION. This ticket's claim that it is "the root cause of #562" is WRONG. I filed that; I'm correcting it.

#562 is a pull-path problem, not a manifest problem. `git.spikerso…

spikerj commented on issue spikerj/spikersoft-issues#562

2026-07-14 21:06:34 +00:00

[Bug][Infra][Deploy] Dreamstream nodes reject fresh tasks with 'No such image' for 1-3 minutes after (re)scheduling — 4th distinct service tonight; pulls likely fighting the UDM hairpin

QA Team — root cause CONFIRMED. Your original hairpin theory was right. Evidence below.

git.spikersoft.com resolves to a public IP from inside the cluster:

spikerj commented on issue spikerj/spikersoft-issues#588

2026-07-14 21:04:47 +00:00

[Bug][Telemetry] Every service reports service.namespace='1.0.0' — AddService()'s 2nd positional arg is serviceNamespace, not serviceVersion. Spans also carry no node identity

Fixed across two PRs (both open, awaiting merge). All three items in this ticket are covered.

spikersoft-backend #288 — the code fix
spikersoft-infrastructure #82 — the…

spikerj commented on issue spikerj/spikersoft-issues#587

2026-07-14 20:49:35 +00:00

[Bug][Prod][Registry] 14 images have no :latest manifest (manifest unknown / 404) — any reschedule onto a fresh node will fail to start

QA Team — still live, still causing #562. Re-verified 2026-07-14.

The dangling manifests have not self-healed. Spot-check from a swarm node:

spikerj commented on issue spikerj/spikersoft-issues#579

2026-07-14 20:49:35 +00:00

[Bug][CI][Infra] gitea-runners arm_v8_2 crash-looping on dreamstream6 since the #539 outage — ARM CI capacity silently down 3→2

QA Team — still flapping. Re-verified 2026-07-14.

gitea-runners_arm_v8_2_act_runner on dreamstream6 is still crash-looping, ~3 days on:

spikerj commented on issue spikerj/spikersoft-issues#582

2026-07-14 20:48:34 +00:00

[Bug][Prod][GPU] #553 is CLOSED but the fix never reached production — quiz-generation still on SERVER's 8GB card, 13h and counting

QA Team — update: the placement half of this ticket is RESOLVED, but do not close it yet.

Infra #81 merged and deployed at 2026-07-14 20:11 UTC. Verified live on the swarm:

spikerj closed issue spikerj/spikersoft-issues#586

2026-07-14 20:48:16 +00:00

[Bug][Tests][QuizGeneration] ValidRequest_IsConsumedAcked_QuizCompletesWithFakedQuestions_AndNotifies fails on master — quiz contains questions from pages other than the expected page 4

spikerj opened issue spikerj/spikersoft-issues#592

2026-07-14 20:48:11 +00:00

[Bug][Prod][GPU] quiz-generation is green, consuming, and CANNOT generate a quiz — deployed with an empty Storage__SecretKey and no model bind (follow-on to #553 / infra #81)