docs: add AGENTS.md with T4/headless-setup notes#72
Open
moduvoice wants to merge 2 commits into
Open
Conversation
Document behavior observed while benchmarking the AICoverGen Mod flow on a real Tesla T4: the launcher notebook is Colab-only (Drive mounts, /content paths, rot13-obfuscated clone of the real code repo) and does not run headlessly as-is; the default run has no bundled RVC voice model and no_ui.py's default -dir Daemi does not exist; MDX vocal separation silently falls back to CPU without extra CUDA runtime libraries (nvidia-curand/cufft/nvrtc), with a measured 2.05x speedup once supplied; and fp16 is the correct dtype on T4 (no bf16 trap, since "Tesla T4" doesn't match the GTX 16xx fp32-downgrade heuristic). No code changes.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Motivation
While benchmarking the AICoverGen Mod inference flow on a real NVIDIA Tesla T4 (Turing, 16GB), I hit several non-obvious setup issues that aren't documented anywhere in this repo. Adding an
AGENTS.mdso the next person running this outside Colab (or an AI coding agent doing the same) doesn't have to rediscover these from scratch.Changes
Doc-only — new
AGENTS.md, no code touched. It documents four things about existing behavior:Hina_Mod_AICoverGen_colab.ipynbmounts Drive, hardcodes/content/...paths, and clones the actual inference code from a rot13-obfuscated URL (ardha27/AICoverGen-Mod). None of this runs as-is on a non-Colab GPU box. Notes the headless path (python src/main.py) and the dependency reconstruction needed (torch 2.0.1+cu118,python3.10-devfor buildingfairseq==0.12.2from source,huggingface_hub==0.23.4,setuptools<81, ffmpeg/sox).download_models.pyonly fetches the MDX/hubert/rmvpe models, not an RVC voice model, sono_ui.py's default-dir Daemipoints at a folder that doesn't exist and the run crashes immediately. Notes that users must supply their own RVC model.nvidia-curand/cufft/nvrtc, not bundled with thetorch cu118wheel). Measured 2.05x speedup (28.7s → 14.0s per separation pass) once supplied, with a VRAM trade-off (~2GB → ~13.8GB peak) worth flagging for 16GB cards.Confighardcodes fp16, and the GTX 16xx fp32-downgrade heuristic checks for the substring"16"in the GPU name —"Tesla T4"doesn't match it, so T4 correctly stays fp16. Also notes that the 16xx downgrade branch, when it does trigger, rewrites config JSON files on disk as a side effect.Testing