Same here MJ. I just carry the screwdrivers I use the most, ditto pliers, cutters, strippers, and so on.

If I'm working near my toolbox I'll just pick up and put down other tools as I need them, or if I have to climb a ladder or otherwise work out of reach of the box, I'll just add the tools I need for that portion of the job.