If so - I get em in my gulf coast toad's soil & live plants terrarium when it's a little wetter than it probably should be. If they're the same thing, they're pretty much harmless, although they may annoy your frog. You might switch everything out, wash & wipe the tank, & then put in all new clean substrate. I don't keep that kind of frog but they need wet enclosures right? So the white bugs might come back - I just try to keep my soil not so wet. Dunno if you can do that with your species.
I've heard, but can't confirm, that if you put a slice of banana in the tank, all the little white bugs will swarm onto it & then you can pitch it outside or flush it down the toilet. They love banana (I'm told) & I guess you could do this until they're mostly gone. Dunno if it works, but I doubt it'd hurt your frog to try it.
-----
~kimhotep 