When using Pay As You Go, you are given 128GB of temporary storage which is deleted 3 hours after your session ends.
With a subscription however, your Cloud PC is never deleted and storage can be expanded up to 1TB. Programs and games will remain on your Cloud PC as long as your subscription remains active (until you cancel it or a PayPal recurring payment fails).