When a collection gets past a certain size, into the multiple hundreds, or more than a thousand, having a house with enough room for display of the entire collection without taking over the entire living space is not practical or in most cases reasonable. I wish it wasn't the case but I doubt I'll ever have my entire collection on display at the same time.
Especially if you both have collections.