They are all great choices. Brass is EXTREMELY hard, and the 2nd best conductor of the 3. I think the biggest and only downside to brass is it will tarnish rapidly, so you may want to polish your device frequently.
SS is low maintenance, but the worst conductor. Also a very strong metal. SS does not tarnish easily, but you may want an SS model with brass battery pins to help with the connection a little bit
Aluminum is the best conductor of the 3 but very soft. Not likely to tarnish, but the contacts tend to build up, so if you do not clean the contact points frequently it will lose performance. However a lot of aluminum mods tend to have brass pins which help significantly with this. The biggest downside to aluminum is the 510 connection, even the lightest of tightening and you will wear out your 510 threads. First they get a little wobble, then they eventually become unusable. Aluminum IS however extremely lightweight, which makes it easy to carry around.
A good mixture i think would be cool, aluminum body, SS or brass 510 threading, and silver pins would make for a mean mod out of the box. However many still prefer a mod made completely of SS or brass, and even the aluminum body is prone to scratching/damage.