I've only got a few planner bits, but they keep drifting between my desk and bag. Sorting by type makes things easier to find; keeping the bits I use this week together makes packing quicker. I prefer the small grab-and-go set, even if I have to hunt for an occasional extra.
One designated spot on the desk for the bits when they come out of the bag helps stop them getting scattered before the next pack.