tensorflow - Loaded runtime CuDNN library: 5005 (compatibility version 5000) but source was compiled with 5103 (compatibility version 5100)

Question

I've the following error. I'm using a conda installation of tensorflow. I'm struggling to try to use it with my GPU.

Loaded runtime CuDNN library: 5005 (compatibility version 5000) but source was compiled with 5103 (compatibility version 5100). If using a binary install, upgrade your CuDNN library to match. If building from sources, make sure the library loaded at runtime matches a compatible version specified during compile configuration. F tensorflow/core/kernels/conv_ops.cc:526] Check failed: stream->parent()->GetConvolveAlgorithms(&algorithms) Aborted (core dumped)

which nvcc returns /usr/local/cuda-7.5/bin/nvcc

nvcc version returns Cuda compilation tools, release 7.5, V7.5.17

I tried downloading CuDNN v5.1 and did the following but it didn't work either ``` sudo cp lib* /usr/local/cuda-7.5/lib64/ sudo cp include/cudnn.h /usr/local/cuda-7.5/include/ sudo ldconfig

```

I tried on the other folder too sudo cp lib* /usr/local/cuda/lib64/ sudo cp include/cudnn.h /usr/local/cuda/include/ sudo ldconfig

Answer 1

There's a good explanation of what it means here - What does the error: `Loaded runtime CuDNN library: 5005 but source was compiled with 5103` mean?

Short answer is that you have CuDNN 5.0 but you should install CuDNN 5.1

It looks like that's what you are attempting to do. It worked for me to just follow the the instructions here - https://www.tensorflow.org/get_started/os_setup#optional_install_cuda_gpus_on_linux

Before doing this, I checked the contents of /usr/local/cuda/include/cudnn.h and indeed it had these lines towards the top indicating it was version 5.0.5

#define CUDNN_MAJOR      5
#define CUDNN_MINOR      0
#define CUDNN_PATCHLEVEL 5

If your /usr/local/cuda/include/cudnn.h is already 5.1, then there is another CuDNN in another directory that is getting referenced. I have the following in my .bashrc -- perhaps try adding this or checking the Tensorflow instructions for what to add.

export LD_LIBRARY_PATH="$LD_LIBRARY_PATH:/usr/local/cuda/lib64:/usr/local/cuda/extras/CUPTI/lib64"
export CUDA_HOME="/usr/local/cuda"