The Mothers of Invention are a stereotypical choice, right? Ray Collins wasn't ugly, though. Zappa really isn't that ugly; just stern-looking.
I think for a lot of the punk bands, one guy saves the band from being uniformly ugly. Dee Dee Ramone, for example. Or Paul Simonon. Or Richard Lloyd.