To delete a payment, click the "Delete" button:
Note: Payment can have linked invoices, and if you delete a payment, all the linked invoices will be uncovered.