Not all government securities do. Dated government securities can pay periodic coupon interest, while T-Bills and CMBs are zero-coupon instruments that are issued at a discount and redeemed at face value.