Colorbar titles in matplotlib

In matplotlib sometimes you want to put some title in a colorbar, when producing a filled contour plot or similar. One way is to simply:

Another way is to use the set_title or the set_xlabel of your colorbar axes. For the first:

However in this way I don't know how to set the title at a distance from the axes. For the second, this can be done using the labelpad: