I'm pretty sure I know how it works, but I'll let a few more people play before I say anything. It is cool though!
Ok, here's how it works:
first, your number is associated with a color. Let's use purple numbers as examples:
purple
21, 22, 1, 14, 6
now, at the end when you pick a house, there is only one purple number in each house:
house a b c...
more