You are 100% correct. Having just completed my 3rd semester of Veterinary school and just finished my Veterinary parasitology course I can say that there is actually very little chance of catching parasites from your reptiles. Especially bearded dragons. The Isospora aka coccidia and pin worms that Beardeds carry is 100% species specific. You would have to BE a bearded dragon to catch them.
There are a select few types of flukes or tapeworms that you COULD catch if you ATE your lizards. But again this would require your lizard to HAVE these parasites, which are very uncommon, and then you'd have to eat them.
There is a protozoan parasite that is often found in turtles but is asymptomatic that if transfered to a snake WILL KILL THE SNAKE. So if you have both turtles or torts and snakes, keep them appart and wash your hands well in between.
You're more at "danger" from the bacteria found in your reptile's GI system. There you'll find Salmonellas and E. coli that would be foreign to your system and could cause illness.
Common sense goes a long way though. Wash your hands after handling your reptile. DOn't eat them. Don't eat their poop. Don't kiss your reptile or lick it or stick it in your mouth. Don't let your reptile in your kitchen or your bathroom. And keep a clean cage. Cleaner cages mean less poop, less poop means less parasites and bacteria around.