i have had the same "problem", and i sure everyone here has had as well. he sees you as a very large predator. the advise given to me is to place one hand behind him and one in front, sort of cupping him. coax him onto the hand in front of him. NEVER grab or just pick him up. you risk hurting him. once out i usually take him to another bush i have(a ficus) and let him calm down there, outside his cage and "treat" him to a couple mealies or crickets in a small cup. i have done this once or twice a week for the past 2 months since he was 3 months old and now only recently has he NOT been afraid of me.
with all this said though you should handle him as little as possible.

-----
compasscreek backcountry adventures