You said that you "wet sanded" with 400. That may be one of the reasons that it is taking so long. I would be dry sanding it with 400 on a block if it was me. If you want to "wet sand", it should be just prior to painting, just to remove to final extremely fine scratches, and with the finest paper that you plan to use. I usually use 600 or 800 for that step.