Hydrogen peroxide, in small quantities, is not harmful. In fact, there is some evidence that it fights or prevents cancer. Too large a quantity can cause vomiting. If your cat is not vomiting after the rinse, you are not giving too much.