No, not talking about the lug nuts.
The drum can be removed without taking the axle out, pulling the bearing retaining nuts and bearings, and pulling the entire assembly. That is, if you can get the 'little' nuts off. Then worry the drum off, which ain't easy.
It is a lot easier for me, to just pull the whole magilla. If one has a stout leather belt around the drum as a handle (with room for your fingers, of course), it makes the task much easier.
Besides, any time you have got that far into it, you might as well repack the bearings.
Dennis