Q: Is there a way to quickly override Sku Grid's default handling time with a set of values that we can import?
A: There isn't a way to set it via CSV although the feature request has been submitted to the developers.
But you can use multi-item actions to apply a different default handling time to selected items and then force reprice them. Or it should be set individually per item when adding them to the grid.