How to improve the synthesized results?

[sanjeevani279]

I have trained the model for 200k steps, and still, the synthesised results are extremely bad. The sampling rate I have used is 22050 Hz and the batch size used is 16.

This is how my loss curve looks after 200k steps. Can you help me with what can I do now to improve my synthesized audio results?

[chazo1994]

@sanjeevani279 I have same problem with 22050 hz, while 1600hz is ok. Did you resolve this problem ?

[Summerxu86]

@chazo1994 Are you using 1600Hz and the batchsize is 16? How is the synthesis effect?

[chazo1994]

@chazo1994 Are you using 1600Hz and the batchsize is 16? How is the synthesis effect?

@Summerxu86 I train two model 22050khz and 16khz, both use batchsize 48. Model 16k is faster convergence, and the synthesized audio at 200k step of model 16khz is much better than model 22k.

[Aliraheem]

@chazo1994 Are you using 1600Hz and the batchsize is 16? How is the synthesis effect?

@Summerxu86 I train two model 22050khz and 16khz, both use batchsize 48. Model 16k is faster convergence, and the synthesized audio at 200k step of model 16khz is much better than model 22k.

What vocoder did you use? in the case of 16k and 22050? Did you use a different pre trained vocoder for each sampling rate?