To delete a custom category, just tap on the 'Spending' tab on the navigation bar, then on the 'Your Spending' section tap on 'Edit custom categories'. You can then add a new custom category, or manage any categories you have set up. Tapping the '. . .' will allow you to edit or delete the category.
Any transactions assigned to this category will then move back into their previous categories.