I've been using the python-neat library in open-ai's retro with some success. And while it works quickly, it normally finds local maximas. It seems to struggle with long sequences. And defining the fitness function/parameters is an artform.
Here's a video of Donkey Kong Country played by python-neat in open-ai's retro. It took 8 generations of 20 genones to beat level one. I'll post the code if anyone's interested.
Please do!
Just letting you know he posted his code under that viemo video. https://github.com/CodeReclaimers/neat-python and https://github.com/openai/retro/