The height is to the center of the handle on the breaker or operating mechanism.

I also keep the center of fuses at that height.

But that begs the old question of whether the fuse is really considered a "switch". I consider it so but it is always good to see if there is someone who knows of the exception to the addendum that would allow different heights.