What if I fail to withdraw my RMD that year? That would be a costly mistake. Regardless of whether the IRA is yours or you inherited it, failure to withdraw the designated RMD by 31 December will result in a 50% penalty fee.