You can use the Delete Delivery button on the Deliveries page (Messages->All Deliveries) to delete a specific delivery.