Skip to content

Add Whisper candidate output and beam search#1426

Open
maciej wants to merge 2 commits into
ml-explore:mainfrom
maciej:maciej/whisper-beam-search-candidates
Open

Add Whisper candidate output and beam search#1426
maciej wants to merge 2 commits into
ml-explore:mainfrom
maciej:maciej/whisper-beam-search-candidates

Conversation

@maciej

@maciej maciej commented Jun 15, 2026

Copy link
Copy Markdown

Summary

  • add an opt-in return_candidates decoding option and surface ranked candidates in transcribe segments
  • implement MLX Whisper beam search with KV-cache reordering and dense final candidates
  • add CLI --beam-size, unit coverage, and env-gated integration smoke tests

Commit structure

  1. Add decoding candidate return option
  2. Implement Whisper beam search decoding

Validation

  • PYTHONPATH=whisper /tmp/mlx-whisper-beam-venv/bin/python -m pytest -q
  • PYTHONPATH=whisper RUN_MLX_WHISPER_INTEGRATION=1 MLX_WHISPER_TEST_MODEL=mlx-community/whisper-medium /tmp/mlx-whisper-beam-venv/bin/python -m pytest -q whisper/test_beam_search_integration.py -s

@maciej maciej marked this pull request as ready for review June 15, 2026 13:22
@maciej maciej marked this pull request as draft June 15, 2026 19:13
@maciej maciej marked this pull request as ready for review June 15, 2026 20:02
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant