Yep you need to fix this if the cam bore plug is stopping the cam it will have to be punched out and replaced. Pushing it backwards might result in an oil leak that cannot be fixed without engine removal so on a risk verses consequences scale it is worth doing this job correctly.
I’m not sure whether you are talking about a flat tappet or OEM roller. In the case of a flat tappet or aftermarket retro roller cam but either of these use the large bolt circle gear with a retainer fitting. This gear is designed to be in contact with a mating surface on the block face. This is the aft movement thrust surface, there being no forward thrust retainer on flat tappet cams. If you are using an aftermarket roller cam then an adjustable thrust button is used between the cam gear center and the timing case cover. Setting this adjustment is a big PIA as it is variable with flex in the cover and the gasket thickness between the cover and block, if you’re doing this please announce such as this is a lengthy paragraph of instruction and caution on its own.
If you are using a factory OEM roller cam the cam’s nose extends about 1/8th inch ahead of the classic gear thrust surface on the block. This is the same location in 3 dimensional space for flat tappet and factory roller blocks. However, where the factory (Original Equipment Manufacturer thus the term OEM) roller cam is used the thrust plate occupies this eighth inch of space. The stepped nose extension of the cam passes through the thrust plate to mount the reduced depth cam gear. The forward thrust of the cam is absorbed by the leading forward edge of the number one cam journal through its clearance to the thrust plate while rearward thrust is absorbed by the timing gear clearance to the thrust plate. This is the same motion as with a flat tappet cam but there the thrust is applied to the block. The OEM roller cam’s gear uses a smaller bolt pattern than the flat tappet/aftermarket (retro) roller cam so these gears do not interchange. The OEM roller also does not and cannot fit the metal bolt retainer of the flat tappet or retro roller cam gear. The factory (OEM) cam gear is retained with pan head, Allen or TORX screws and liquid thread locker for clearance and retention.
So all of this boils down to for either a flat tappet and retro roller or for an OEM roller; the cam gear must properly fit to the block or to the thrust plate as the designs would each require. If the cam will not allow this, you must find out why and correct the situation. The addendum to this is if it is the rear cam bore plug being driven to deeply, it is better to remove the one installed and replace the whole thing after inspecting for cleanliness and damage to the bore as the only fix if this thing leaks oil is to pull the engine back out. Well maybe not the only fix the other is drop the transmission and what ever that uses flex plate or flywheel to gat at the back of the block from underneath, this not being much fun either.
Bogie