How do I delete a gallery?

Open the gallery and press "Delete this gallery" at the bottom. It happens straight away, and files not used in any other gallery are deleted with it.

Download anything you want to keep first. If you only want to stop the client getting in, set an expiry date instead.