How to remove puzzles from the "In progress" folder?

In order to delete a puzzle, press it and hold a finger on the screen for at least 2 seconds. You'll see a trash bin icon. Tap it, then tap Delete.