Can I delete a payment off an invoice I made by mistake?

If the payment is a credit card payment that you need to delete, you will have to go through the refund process to fix it. 

However, if the payment is a cash, check, or other type of "cash-like" payment, a manager or owner can delete the payment by clicking the trashcan icon next to the payment.