If I just want to play with this as a toy without any performance considerations, is it possible to run this on a CPU only? Or do I need to faf about with getting CUDA and that nonsense running?
You probably want to check this port : https://github.com/ggerganov/whisper.cpp