[Question] included vmaf Models, howto load models

[bitspyer]

Hi,
Two Questions:

1. which Models for vmaf are included?

2. how do i load models, for example, from netflix . When i try to load the .jsons, which i downloaded from the netflix repo, nvencc i got this Error:

libvmaf WARNING no such built-in model: "/home/ltest/_conf/vmaf_4k_v0.61neg.json"
libvmaf WARNING no such built-in model collection: "/home/test/_conf/vmaf_4k_v0.61neg.json"
ssim/psnr/vmaf/vship: problem loading model version: /home/test/_conf/vmaf_4k_v0.61neg.json

[bitspyer]

--vmaf [<param1>=<value>][,<param2>=<value>][...] Calc vmaf. Please note that this is very CPU intensive and likely to become bottleneck, strongly affecting encoding perfromance. params model=<string> set model version/filepath [default:vmaf_v0.6.1]. threads=<int> cpu thread(s) to calculate vmaf score. subsample=<int> interval for frame subsampling calculating vmaf score. phone_model=<bool> use phone model which generate higher vmaf score. enable_transform=<bool> enable transform when calculating vmaf score.

In the Docs aren't any further Information about buildin Models. Only the default Model is listed, and i know, that vmaf_4k_v0.61 is integrated.
Also, the example in the docs says:
Example: --vmaf model=vmaf_v0.6.1.json

and so i tried to load the json.

Maybe it's an Linux Problem to load the json from other locations....

[rigaya]

The built in models can be selected from below.

• vmaf_v0.6.1
• vmaf_b_v0.6.3
• vmaf_v0.6.1neg
• vmaf_4k_v0.6.1
• vmaf_4k_v0.6.1neg
• vmaf_v1.0.16_3d0h
• vmaf_v1.0.16_3d0h_2160
• vmaf_v1.0.16_5d0h
• vmaf_v1.0.16_1d5h_2160
• vmaf_v1.0.16_hfr_3d0h
• vmaf_v1.0.16_hfr_3d0h_2160
• vmaf_v1.0.16_hfr_5d0h
• vmaf_v1.0.16_hfr_1d5h_2160

Using internal models

Windows

NVEncC64.exe -i input.mp4 -o output.mp4 --vmaf model=vmaf_v0.6.1

Linux

nvencc -i input.mp4 -o output.mp4 --vmaf model=vmaf_v0.6.1

Using external models

Windows

NVEncC64.exe -i input.mp4 -o output.mp4 --vmaf "model=X:\Encoders\vmaf_4k_v0.6.1neg.json"

Linux

nvencc -i input_4k.mp4 -o output.mp4 --vmaf model=/home/user/models/vmaf_4k_v0.6.1neg.json

I think vmaf_4k_v0.61neg.json might be vmaf_4k_v0.6.1neg.json.

---

I've also found out that I've missed to enable CUDA support for vmaf on previous NVEnc 9.23 release build for Linux (Windows build was fine).

If using Linux binary, please have a try with the following nightly build.
https://nightly.link/rigaya/NVEnc/actions/runs/28866648768/nvencc_ubuntu2004_cuda11_deb.zip

[rigaya]

NVEnc 9.24 has improved error messages when json file cannot be loaded.

[bitspyer]

I try the new v1 profiles, and i got this msg:
libvmaf ERROR could not initialize feature extractor "Cambi_feature_cambi_score"
ssim/psnr/vmaf/vship: problem loading feature extractors from model: vmaf_v1.0.16_3d0h_2160

the old versions 0.6 work fine.

Maybe you need to rebuild libvmaf...