It's not so much that the color will mask it... but the brighter, fruity colors of the original GBA made it look like something for young children. Silver says, "I'm a toy, but a toy adults can play with."
Never really was an issue for me. It could be pink and I'd still play it. I use the devices for games, not fashion statements.
The jury is still out on the DS for me, but its looking tempting...