Missing a meal or two is no concern for bearded dragons. They can stop eating because they are in a shed cycle and that can be distracting them from food, etc. It is if they do not eat for several days, that you should start to be concerned.
For now, I would just leave your dragon alone. Being bathed 3 times in one day may be stressing him out more than anything. Offer him food tomorrow as normal and see what happens.
Silkworms are great as a staple insect. They are easy to care for though are more expensive to buy and care for than crickets. Silkworms eat one of two foods only. They will eat anything offered them but they will die in a couple days if not fed exclusively either mulberry leaves or silkworm chow. Silkworms are more filling, so once your dragon is able to eat the bigger silkworms, they fill them up quickly. Each silkworm can equal several crickets in bulk and nutrition.
-----
PHLdyPayne