Are you certain that the dipstick is reading correctly and that your not putting too much oil in it?
Might try draining the oil, all of it. May need to remove the filter if it dosen't have an anti-drainback valve. Re-install the drain plug. Fill it with 4 quarts of oil and wait an hour and check the dipstick a couple of times. If you have a 4 quart pan the stick should read full or close to it.