Skip to content

AnyFlow: flow map distillation core#2728

Merged
bghira merged 17 commits into
mainfrom
feature/nvidia-anyflow
Jun 7, 2026
Merged

AnyFlow: flow map distillation core#2728
bghira merged 17 commits into
mainfrom
feature/nvidia-anyflow

Conversation

@bghira
Copy link
Copy Markdown
Owner

@bghira bghira commented May 26, 2026

This pull request adds support for a new distillation method called "anyflow" across the codebase and documentation. The main changes include implementing the AnyFlowDistiller class, registering the new method in the factory and registry, and updating documentation in multiple languages to reflect the new option.

Support for the "anyflow" distillation method:

  • Added a new AnyFlowDistiller class implementing the "anyflow" distillation strategy for flow-matching models, including batch preparation, loss computation, and model-specific requirements. (simpletuner/helpers/distillation/anyflow/distiller.py)
  • Registered the "anyflow" method in the distillation registry and ensured it is imported in the factory for availability. (simpletuner/helpers/distillation/anyflow/__init__.py, simpletuner/helpers/distillation/factory.py) [1] [2] [3]

Documentation updates:

  • Updated the --distillation_method option in the training documentation to include "anyflow" in all supported languages. (documentation/OPTIONS.md, documentation/OPTIONS.es.md, documentation/OPTIONS.hi.md, documentation/OPTIONS.ja.md, documentation/OPTIONS.pt-BR.md, documentation/OPTIONS.zh.md) [1] [2] [3] [4] [5] [6] [7] [8] [9] [10] [11] [12]

These changes enable users to select "anyflow" as a distillation method and provide the necessary implementation and documentation for its use.

This comment was marked as resolved.

@bghira
Copy link
Copy Markdown
Owner Author

bghira commented May 27, 2026

target_anyflow.mp4

AnyFlow validation output

@bghira
Copy link
Copy Markdown
Owner Author

bghira commented Jun 7, 2026

@copilot resolve the merge conflicts in this pull request

# Conflicts:
#	simpletuner/helpers/models/ideogram/quantized_loading.py
#	tests/test_ideogram_fp8_linear.py
Copy link
Copy Markdown
Contributor

Copilot AI commented Jun 7, 2026

@copilot resolve the merge conflicts in this pull request

Resolved the merge conflicts in commit bffef15. The two conflicted files were:

  • simpletuner/helpers/models/ideogram/quantized_loading.py: took origin/main's improved _Fp8LinearScaledMm (added _dequantized_forward fallback, better dtype handling, layout-error recovery) and the Fp8Linear.forward dtype validation
  • tests/test_ideogram_fp8_linear.py: took origin/main's updated test suite covering the new functionality

Copilot finished work on behalf of bghira June 7, 2026 00:14
@bghira bghira merged commit eefbdd9 into main Jun 7, 2026
@bghira bghira deleted the feature/nvidia-anyflow branch June 7, 2026 00:24
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants