Bilingual Japanese / English zipformer recipe (multi_ja_en) and MLS English recipe (mls_english)#2015

Open

kinanmartin wants to merge 145 commits into

k2-fsa:masterfrom

reazon-research:multi_ja_en_mls_english_clean

Commits on Jul 28, 2025

WIP v0 MLS English recipe
kinanmartin
committed
update prepare.sh, fix asr_datamodule.py
kinanmartin
committed
change default path
kinanmartin
committed
replace file
kinanmartin
committed
cleaned-up version of recipe
kinanmartin
committed
symlink copied files to librispeech recipe dir
kinanmartin
committed
separate transcript prep stage from bpe train stage
kinanmartin
committed
pre-commit hooks
kinanmartin
committed
readme
kinanmartin
committed
instead of on-the-fly features, precompute fbank and manifests in prepare.sh
kinanmartin
committed
move compute_fbank_mls_english.py, add validate_manifest.py, add shared symlink to librispeech
kinanmartin
committed
adjusted prepare.sh to only calculate fbank and manifest together; adjust datamodule to load from manifest files
kinanmartin
committed
fix validation manifest name
kinanmartin
committed
fix stage 2 and 3
kinanmartin
committed
optimize with num_jobs on save_audios
kinanmartin
committed
new version of multi_ja_en prepare.sh script which swaps Librispeech for MLS English
kinanmartin
committed
add fbank

baileyeet
authored and
kinanmartin
committed
Revert "add fbank"

baileyeet
authored and
kinanmartin
committed
deprecate params.bilingual=0, replace ReazonSpeechAsrDataModule for MultiDatasetAsrDataModule, not tested yet
kinanmartin
committed
remove bilingual tag from train.py

baileyeet
authored and
kinanmartin
committed
restore version of mls_english compute_fbank_mls_english.py and prepare.sh from commit 547f5c5
kinanmartin
committed
fix stage 5 output pathing
kinanmartin
committed
switch mls_english clone from https to ssh
kinanmartin
committed
use huggingface_hub library to download mls_english
kinanmartin
committed
Combined updates. Changed BBPE path structure, changed dataset path structure, added script to update cutset paths. WIP
kinanmartin
committed
fix decode script data module usage
kinanmartin
committed
add utility file for updating the storage_path of cutsets for use in the multilingual training recipe directory structure
kinanmartin
committed
add utility file for creating subsets of mls english. must be fixed to make dev and test splits have matching sizes to reazonspeech
kinanmartin
committed
Parametrize dev and test split sizes.
kinanmartin
committed
Add failsafe for MLS English dev set key alternate name as validation
kinanmartin
committed
Update README.md to reflect MLS English dataset
kinanmartin
committed
add step 4: display manifest stats to mls_eng

baileyeet
authored and
kinanmartin
committed
update manifest dir path

baileyeet
authored and
kinanmartin
committed
add stage 6 - update cutset paths to prepare

baileyeet
authored and
kinanmartin
committed
remove commented out codels

baileyeet
authored and
kinanmartin
committed
changes to train script - no need for limiting utterance length here

baileyeet
authored and
kinanmartin
committed
remove unused local scripts

baileyeet
authored and
kinanmartin
committed
make prepare.sh symlinks relative
kinanmartin
committed
changes to asr_datamodule for musan support

baileyeet
authored and
kinanmartin
committed
typos

baileyeet
authored and
kinanmartin
committed
commenting

baileyeet
authored and
kinanmartin
committed
remove comment

baileyeet
authored and
kinanmartin
committed
resolve typos and import issues

baileyeet
authored and
kinanmartin
committed
update musan path

baileyeet
authored and
kinanmartin
committed
update musan paths

baileyeet
authored and
kinanmartin
committed
update musan symlinks

baileyeet
authored and
kinanmartin
committed
attempt to fix musan paths

baileyeet
authored and
kinanmartin
committed
working changes for musan mixing

baileyeet
authored and
kinanmartin
committed
Update egs/multi_ja_en/ASR/local/utils/update_cutset_paths.py

authored and
kinanmartin
committed
Update egs/multi_ja_en/ASR/local/utils/update_cutset_paths.py

authored and
kinanmartin
committed
Update egs/multi_ja_en/ASR/local/utils/update_cutset_paths.py

authored and
kinanmartin
committed
Update egs/multi_ja_en/ASR/local/utils/update_cutset_paths.py

authored and
kinanmartin
committed
black and isort formatting

baileyeet
authored and
kinanmartin
committed
PR review suggestions implemented

baileyeet
authored and
kinanmartin
committed
Update RESULTS.md

baileyeet
authored and
kinanmartin
committed
Musan implementation for ReazonSpeech (#1988)

baileyeet
authored and
kinanmartin
committed
Manually fix merge conflict in multi_ja_en/ASR/zipformer/train.py
kinanmartin
committed

Commits on Aug 5, 2025

Validate generated manifest files. (#338)

csukuangfj
authored and
baileyeet
committed
WIP v0 MLS English recipe

kinanmartin
authored and
baileyeet
committed
update prepare.sh, fix asr_datamodule.py

kinanmartin
authored and
baileyeet
committed
change default path

kinanmartin
authored and
baileyeet
committed
replace file

kinanmartin
authored and
baileyeet
committed
cleaned-up version of recipe

kinanmartin
authored and
baileyeet
committed
symlink copied files to librispeech recipe dir

kinanmartin
authored and
baileyeet
committed
separate transcript prep stage from bpe train stage

kinanmartin
authored and
baileyeet
committed
pre-commit hooks

kinanmartin
authored and
baileyeet
committed
readme

kinanmartin
authored and
baileyeet
committed
instead of on-the-fly features, precompute fbank and manifests in prepare.sh

kinanmartin
authored and
baileyeet
committed
move compute_fbank_mls_english.py, add validate_manifest.py, add shared symlink to librispeech

kinanmartin
authored and
baileyeet
committed
adjusted prepare.sh to only calculate fbank and manifest together; adjust datamodule to load from manifest files

kinanmartin
authored and
baileyeet
committed
fix validation manifest name

kinanmartin
authored and
baileyeet
committed
fix stage 2 and 3

kinanmartin
authored and
baileyeet
committed
optimize with num_jobs on save_audios

kinanmartin
authored and
baileyeet
committed
new version of multi_ja_en prepare.sh script which swaps Librispeech for MLS English

kinanmartin
authored and
baileyeet
committed
add fbank
baileyeet
committed
Revert "add fbank"
baileyeet
committed
deprecate params.bilingual=0, replace ReazonSpeechAsrDataModule for MultiDatasetAsrDataModule, not tested yet

kinanmartin
authored and
baileyeet
committed
remove bilingual tag from train.py
baileyeet
committed
restore version of mls_english compute_fbank_mls_english.py and prepare.sh from commit 547f5c5

kinanmartin
authored and
baileyeet
committed
fix stage 5 output pathing

kinanmartin
authored and
baileyeet
committed
switch mls_english clone from https to ssh

kinanmartin
authored and
baileyeet
committed
use huggingface_hub library to download mls_english

kinanmartin
authored and
baileyeet
committed
Combined updates. Changed BBPE path structure, changed dataset path structure, added script to update cutset paths. WIP

kinanmartin
authored and
baileyeet
committed
fix decode script data module usage

kinanmartin
authored and
baileyeet
committed
add utility file for updating the storage_path of cutsets for use in the multilingual training recipe directory structure

kinanmartin
authored and
baileyeet
committed
add utility file for creating subsets of mls english. must be fixed to make dev and test splits have matching sizes to reazonspeech

kinanmartin
authored and
baileyeet
committed
Parametrize dev and test split sizes.

kinanmartin
authored and
baileyeet
committed
Add failsafe for MLS English dev set key alternate name as validation

kinanmartin
authored and
baileyeet
committed
Update README.md to reflect MLS English dataset

kinanmartin
authored and
baileyeet
committed
add step 4: display manifest stats to mls_eng
baileyeet
committed
update manifest dir path
baileyeet
committed
add stage 6 - update cutset paths to prepare
baileyeet
committed
remove commented out codels
baileyeet
committed
changes to train script - no need for limiting utterance length here
baileyeet
committed
remove unused local scripts
baileyeet
committed
make prepare.sh symlinks relative

kinanmartin
authored and
baileyeet
committed
Validate generated manifest files. (#338)

csukuangfj
authored and
baileyeet
committed
changes to asr_datamodule for musan support
baileyeet
committed
typos
baileyeet
committed
commenting
baileyeet
committed
remove comment
baileyeet
committed
resolve typos and import issues
baileyeet
committed
update musan path
baileyeet
committed
update musan paths
baileyeet
committed
update musan symlinks
baileyeet
committed
attempt to fix musan paths
baileyeet
committed
working changes for musan mixing
baileyeet
committed
Update egs/multi_ja_en/ASR/local/utils/update_cutset_paths.py

baileyeet
and
yuta0306
committed
Update egs/multi_ja_en/ASR/local/utils/update_cutset_paths.py

baileyeet
and
yuta0306
committed
Update egs/multi_ja_en/ASR/local/utils/update_cutset_paths.py

baileyeet
and
yuta0306
committed
Update egs/multi_ja_en/ASR/local/utils/update_cutset_paths.py

baileyeet
and
yuta0306
committed
black and isort formatting
baileyeet
committed
PR review suggestions implemented
baileyeet
committed
support left pad for make_pad_mask (#1990)

yfyeung
authored and
baileyeet
committed
Update RESULTS.md
baileyeet
committed
Musan implementation for ReazonSpeech (#1988)
baileyeet
committed
Fix transformer decoder layer (#1995)

csukuangfj
authored and
baileyeet
committed
Validate generated manifest files. (#338)

csukuangfj
authored and
baileyeet
committed
musan implementation for mls_english
baileyeet
committed
revert unrelated transformer.py diffs from rebase
baileyeet
committed

Commits on Aug 6, 2025

Commits on Aug 11, 2025

training and decoding compatibility changes
baileyeet
committed

Commits on Aug 14, 2025

Commits on Aug 22, 2025

Merge pull request #4 from reazon-research/musan-mls-clean-final
kinanmartin
authored

Commits on Aug 29, 2025

Remove changes to files outside of relevant recipes
kinanmartin
committed

Commits on Sep 3, 2025

Update training commands and decode.py accuracy values, add streaming model section
kinanmartin
committed

Commits on Sep 4, 2025

Update streaming train and export commands
kinanmartin
committed