I had a look, and both GD as Imagick are installed. How can I tell which one is being used? Apparently the latter shows way better colors. Well one very bad way to check is to just disable one.
dpkg --get-selections | grep -i php
sudo phpdismod gd
So my question is now; how can I use a different library