I do the same thing, always wash it off with Dawn or Joy dish detergent.
Haven't had any fish eyes since doing that, I quit using the
wax and grease remover afterwards long ago.
Also wipe as much water off afterwards as quick as you can,
water that dries on the surface leaves residues (spots) behind.
I squeege the surface off and dry with a towel after washing.
I usually wait till the next day before painting, it has to be
completely dry.