For starters, goldfish are one the absolute worst feeders you can offer them. Pure garbage, no nutritional value, and can offer a huge parasite load. I would offer him some nightcrawlers, krill, etc and see his reaction. What are the temps and set up like? Can you post pics please?
-----
www.frogfreaks.com