Celine Dion - Let's Talk About Love (it's about a Celine Dion album, but it's really an exploration about how we talk about taste and how it interacts with things like class and culture, while also going over Dion's biography in a way that made her seem much more interesting to me than she did before).
Talking Heads - Fear Of Music (by Jonathan Lethem, a decent novelist who writes well about what makes it special to him)
Young Marble Giants - Colossal Youth
Kinks - VGPS
ABBA - Gold (all three of these are pretty straightforward, but fine reads nonetheless)
Liz Phair - Exile in Guyville (focuses more on the context of Chicago's indie rock scene than the music, and gets repetitive quickly)