The best way to get rid of razor bumps is to stop shaving. However, applying a warm compress, exfoliating, and using a topical treatment that contains benzoyl peroxide or hydrocortisone may help the ...