Track 1: Floyo video pipeline (value-first)

[WalksWithASwagger]

Floyo = hosted ComfyUI REST API (api.floyo.ai, Bearer FLOYO_KEY): upload → POST /runs → poll → download MP4. Maps 1:1 onto the Replicate provider pattern.

Milestone 1 — one real clip end-to-end (de-risker, build first)

• M1a minimal lib/providers/floyo_provider.py (upload/run/poll/download, dry-run gated, FLOYO_KEY) + tests
• M1b minimal lib/floyo_jobs.py (plan + manifest + cost) for one workflow: wan22_endframe (start_image + end_image → clip, no audio); generate.py floyo + rafiki_floyo_* MCP + config/pricing.json + .env.example
• M1c one real --execute run → an Andromeda clip produced via Rafiki and viewable. Acceptance gate for M1.

Phase 2 — widen the pipeline

• remaining workflows incl. lip-sync (infinitetalk/multitalk templates) + inputmaps
• plate/faceswap resolver (~6-line source/→swapped/)
• clip ingest + manifest (port ingest_clips.py: match/mux/provenance) + tests
• keyframe-gen surface (beat-config keyframes.json → rafiki_generate) + tests

Notes

Lip-sync = workflow templates (no separate engine). Faceswap = plate convention (no engine). Needs ffmpeg/ffprobe.

Part of epic #268 (value-first retirement). Pattern: lib/providers/replicate_provider.py + lib/video_jobs.py. Dry-run-first; --execute operator-only spend. Audit: meta/audits/2026-06-28-alex-samuel-consolidation-audit.md.

[WalksWithASwagger]

M1 shipped (PR #273, merged to main):

• M1a — lib/providers/floyo_provider.py (upload/run/poll/download, dry-run, FLOYO_KEY, urllib multipart)
• M1b — lib/floyo_jobs.py + config/floyo_workflows/wan22_endframe + CLI floyo generate + rafiki_floyo_generate MCP + pricing/.env/docs
• M1c — real --execute clip: gated on FLOYO_KEY (not in env; KK supplies). Plates available under andromeda_project/plates/.

467 tests pass; ruff/docs:check/public:check/MCP-docs-sync green. Phase 2 next: lip-sync (infinitetalk/multitalk) workflows, clip ingest+mux, keyframe-gen surface.

[WalksWithASwagger]

M1c (real clip) — pipeline proven; blocked by intermittent Floyo-side error.

Ran 3 real renders with the key. Findings + fixes (PR #275, merged):

• Floyo CDN is Cloudflare-protected → plain urllib gets 1010 (upload) / 403 (download). Switched upload_asset + download_output to curl (api calls stay urllib). curl upload confirmed HTTP 200.
• A run can return status:done with a system_error → now treated as failed; download failures are recorded (run id/manifest persist).

Remaining blocker is Floyo-side, not Rafiki: wan22_endframe intermittently returns {system_error: 'unknown error, we have been notified'} with non-retrievable (404) outputs. Of 3 runs: 1 produced a retrievable output (proving the path), 2 system-errored on Floyo's backend. Re-running later should catch a good run; the curl-download fix then saves the clip.

Pipeline (upload → submit → poll → resolve presigned → download → record) is verified end-to-end. M1a/M1b done; M1c gated on a clean Floyo run.

[WalksWithASwagger]

✅ M1c achieved — real clip rendered via Rafiki.

Retry produced a valid clip end-to-end: output/gorgeous-ghost/floyo-run-20260628-200445/wan22_endframe_run_bthv1a6SUrufQL1a_vid_00014.mp4 — 6.56s, 832×480, h264, 4.07 MB, plays. The @lex morph (base plate → flame-red glam alien).

Note: Floyo flags the run failed via a noisy system_error even though it returned a valid downloadable output. The curl-download fix (#275) saved it. Known wrinkle for Phase 2: treat a run with successfully-downloaded outputs as succeeded regardless of Floyo's error flag (clip-ingest will reconcile this).

Milestone 1 complete (M1a provider + M1b pipeline/CLI/MCP + M1c real clip). Track 1 Phase 2 next: lip-sync (infinitetalk/multitalk), clip ingest, keyframes.