Unlike the prescription drugs that most Americans are saddled with, Medicare late enrollment penalties do not have an expiration date; they are for life, or for as long as the individual carries Medicare.