Gok, I think you are the only one that goes to the extent that you do for storage.
I've not lost a single accessory in my adult collection. I prefer to keep my accessories on the figure, it completes the look of the figure normally. If it's a product I have the box for, eg: Takara Tomy Masterpiece's, I just keep the unused accessories in the bubble in the box. If I don't have the box or have flattened the box I keep unused accessories in sandwich bags in the cupboard of my computer desk.