Is there a penalty to close a CD early or before maturity?

Yes, there is as penalty to close a CD prior to maturity.

However there are exceptions. There are no penalties to withdraw when the CD has posted interest, is within the 10 day grace period, or due to the owner's death.