Skip to content

Lack of cuDNN 5 and WINOGRAD algorithm support #2

Description

@wenwei202

I tried to run
./scripts/exp_case_alexnet_scalability.sh
and raised a butch of Warning and got no profiling results:

WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:192] Unsupported algorithm: CUDNN_CONVOLUTION_FWD_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:192] Unsupported algorithm: CUDNN_CONVOLUTION_FWD_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:192] Unsupported algorithm: CUDNN_CONVOLUTION_FWD_ALGO_WINOGRAD
INFO build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:393] Tile FFT: 1 (32x32) 1D: False
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:246] Unsupported algorithm: CUDNN_CONVOLUTION_BWD_DATA_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:246] Unsupported algorithm: CUDNN_CONVOLUTION_BWD_DATA_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:246] Unsupported algorithm: CUDNN_CONVOLUTION_BWD_DATA_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:192] Unsupported algorithm: CUDNN_CONVOLUTION_FWD_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:192] Unsupported algorithm: CUDNN_CONVOLUTION_FWD_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:192] Unsupported algorithm: CUDNN_CONVOLUTION_FWD_ALGO_WINOGRAD
INFO build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:393] Tile FFT: 1 (32x32) 1D: False
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:246] Unsupported algorithm: CUDNN_CONVOLUTION_BWD_DATA_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:246] Unsupported algorithm: CUDNN_CONVOLUTION_BWD_DATA_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:246] Unsupported algorithm: CUDNN_CONVOLUTION_BWD_DATA_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:192] Unsupported algorithm: CUDNN_CONVOLUTION_FWD_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:192] Unsupported algorithm: CUDNN_CONVOLUTION_FWD_ALGO_WINOGRAD
INFO build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:393] Tile FFT: 1 (32x32) 1D: False
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:246] Unsupported algorithm: CUDNN_CONVOLUTION_BWD_DATA_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:246] Unsupported algorithm: CUDNN_CONVOLUTION_BWD_DATA_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:246] Unsupported algorithm: CUDNN_CONVOLUTION_BWD_DATA_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:192] Unsupported algorithm: CUDNN_CONVOLUTION_FWD_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:246] Unsupported algorithm: CUDNN_CONVOLUTION_BWD_DATA_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:246] Unsupported algorithm: CUDNN_CONVOLUTION_BWD_DATA_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:246] Unsupported algorithm: CUDNN_CONVOLUTION_BWD_DATA_ALGO_WINOGRAD
INFO build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:393] Tile FFT: 1 (32x32) 1D: False
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:192] Unsupported algorithm: CUDNN_CONVOLUTION_FWD_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:246] Unsupported algorithm: CUDNN_CONVOLUTION_BWD_DATA_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:192] Unsupported algorithm: CUDNN_CONVOLUTION_FWD_ALGO_WINOGRAD
INFO build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:393] Tile FFT: 1 (32x32) 1D: False
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:246] Unsupported algorithm: CUDNN_CONVOLUTION_BWD_DATA_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:246] Unsupported algorithm: CUDNN_CONVOLUTION_BWD_DATA_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:246] Unsupported algorithm: CUDNN_CONVOLUTION_BWD_DATA_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:192] Unsupported algorithm: CUDNN_CONVOLUTION_FWD_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:192] Unsupported algorithm: CUDNN_CONVOLUTION_FWD_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:192] Unsupported algorithm: CUDNN_CONVOLUTION_FWD_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:246] Unsupported algorithm: CUDNN_CONVOLUTION_BWD_DATA_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:246] Unsupported algorithm: CUDNN_CONVOLUTION_BWD_DATA_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:246] Unsupported algorithm: CUDNN_CONVOLUTION_BWD_DATA_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:192] Unsupported algorithm: CUDNN_CONVOLUTION_FWD_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:192] Unsupported algorithm: CUDNN_CONVOLUTION_FWD_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:192] Unsupported algorithm: CUDNN_CONVOLUTION_FWD_ALGO_WINOGRAD
INFO build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:393] Tile FFT: 1 (32x32) 1D: False
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:246] Unsupported algorithm: CUDNN_CONVOLUTION_BWD_DATA_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:246] Unsupported algorithm: CUDNN_CONVOLUTION_BWD_DATA_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:246] Unsupported algorithm: CUDNN_CONVOLUTION_BWD_DATA_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:192] Unsupported algorithm: CUDNN_CONVOLUTION_FWD_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:192] Unsupported algorithm: CUDNN_CONVOLUTION_FWD_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:192] Unsupported algorithm: CUDNN_CONVOLUTION_FWD_ALGO_WINOGRAD
INFO build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:393] Tile FFT: 1 (32x32) 1D: False
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:246] Unsupported algorithm: CUDNN_CONVOLUTION_BWD_DATA_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:246] Unsupported algorithm: CUDNN_CONVOLUTION_BWD_DATA_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:246] Unsupported algorithm: CUDNN_CONVOLUTION_BWD_DATA_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:192] Unsupported algorithm: CUDNN_CONVOLUTION_FWD_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:246] Unsupported algorithm: CUDNN_CONVOLUTION_BWD_DATA_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:246] Unsupported algorithm: CUDNN_CONVOLUTION_BWD_DATA_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:246] Unsupported algorithm: CUDNN_CONVOLUTION_BWD_DATA_ALGO_WINOGRAD
INFO build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:393] Tile FFT: 1 (32x32) 1D: False
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:192] Unsupported algorithm: CUDNN_CONVOLUTION_FWD_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:246] Unsupported algorithm: CUDNN_CONVOLUTION_BWD_DATA_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:192] Unsupported algorithm: CUDNN_CONVOLUTION_FWD_ALGO_WINOGRAD
INFO build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:393] Tile FFT: 1 (32x32) 1D: False
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:246] Unsupported algorithm: CUDNN_CONVOLUTION_BWD_DATA_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:246] Unsupported algorithm: CUDNN_CONVOLUTION_BWD_DATA_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:246] Unsupported algorithm: CUDNN_CONVOLUTION_BWD_DATA_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:192] Unsupported algorithm: CUDNN_CONVOLUTION_FWD_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:192] Unsupported algorithm: CUDNN_CONVOLUTION_FWD_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:192] Unsupported algorithm: CUDNN_CONVOLUTION_FWD_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:246] Unsupported algorithm: CUDNN_CONVOLUTION_BWD_DATA_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:246] Unsupported algorithm: CUDNN_CONVOLUTION_BWD_DATA_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:246] Unsupported algorithm: CUDNN_CONVOLUTION_BWD_DATA_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:192] Unsupported algorithm: CUDNN_CONVOLUTION_FWD_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:192] Unsupported algorithm: CUDNN_CONVOLUTION_FWD_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:192] Unsupported algorithm: CUDNN_CONVOLUTION_FWD_ALGO_WINOGRAD
INFO build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:393] Tile FFT: 1 (32x32) 1D: False
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:246] Unsupported algorithm: CUDNN_CONVOLUTION_BWD_DATA_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:246] Unsupported algorithm: CUDNN_CONVOLUTION_BWD_DATA_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:246] Unsupported algorithm: CUDNN_CONVOLUTION_BWD_DATA_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:192] Unsupported algorithm: CUDNN_CONVOLUTION_FWD_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:192] Unsupported algorithm: CUDNN_CONVOLUTION_FWD_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:192] Unsupported algorithm: CUDNN_CONVOLUTION_FWD_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:246] Unsupported algorithm: CUDNN_CONVOLUTION_BWD_DATA_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:246] Unsupported algorithm: CUDNN_CONVOLUTION_BWD_DATA_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:246] Unsupported algorithm: CUDNN_CONVOLUTION_BWD_DATA_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:192] Unsupported algorithm: CUDNN_CONVOLUTION_FWD_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:192] Unsupported algorithm: CUDNN_CONVOLUTION_FWD_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:192] Unsupported algorithm: CUDNN_CONVOLUTION_FWD_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:246] Unsupported algorithm: CUDNN_CONVOLUTION_BWD_DATA_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:246] Unsupported algorithm: CUDNN_CONVOLUTION_BWD_DATA_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:246] Unsupported algorithm: CUDNN_CONVOLUTION_BWD_DATA_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:192] Unsupported algorithm: CUDNN_CONVOLUTION_FWD_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:192] Unsupported algorithm: CUDNN_CONVOLUTION_FWD_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:192] Unsupported algorithm: CUDNN_CONVOLUTION_FWD_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:246] Unsupported algorithm: CUDNN_CONVOLUTION_BWD_DATA_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:246] Unsupported algorithm: CUDNN_CONVOLUTION_BWD_DATA_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:246] Unsupported algorithm: CUDNN_CONVOLUTION_BWD_DATA_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:192] Unsupported algorithm: CUDNN_CONVOLUTION_FWD_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:246] Unsupported algorithm: CUDNN_CONVOLUTION_BWD_DATA_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:246] Unsupported algorithm: CUDNN_CONVOLUTION_BWD_DATA_ALGO_WINOGRAD
WARNING build/bdist.linux-x86_64/egg/paleo/profilers/flops_profiler.py:246] Unsupported algorithm: CUDNN_CONVOLUTION_BWD_DATA_ALGO_WINOGRAD

What might be the problem? Thanks

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions