After doing a bit more battling with it. I've managed to get it to work

Although there seems to be a bug somewhere.

I've had to add this to my mt-config.cgi

CaptchaSourceImageBase /var/www/mt/images/captcha-source

Of course change the directory to suit your own setup.