Does is have a pcv valve? If so it might be stopped up. That would cause the blowby to push oil out of the dipstick tube. If it doesn't have a pcv valve just make sure that the engine is ventilated somehow so it won't build up pressure inside.
As for the rockers knocking, you might have a plunger stuck down in the lifter.