How do I pause/stop a batch?

When a batch is running simply hold the option key on a Mac or the alt key on Windows and once the current image is done being batched, you will get a popup asking you if you want to pause or stop your batch.

Note: This feature isn't supported in Photoshop CS3