PistollPeet As Axlaser has pointed out, you can increase the Z lift on travel moves to help eliminate this issue. It should be set to 0.2 mm by default, but it probably depends on the printer. Some printers can have issues when this is too high.
I would increase to at least 0.2 mm and try again, going higher if needed. The setting in Prusa is under Printer Settings > Extruder > Retraction > Lift Z. Also make sure the "Only Lift Z" range is reasonable so that the Z lift is actually used. This range is designed to prevent Z lift at the top of the Z range from pushing past the end stops. Should be 0 to some number close to the Z height of your printer.