CDs typically charge penalties if you withdraw your money before the end of the term length. No-penalty CDs are the exception: With a no-penalty CD, you won't have to pay an early withdrawal penalty.