Since we're talking about women alt rockers from the '90s, I'll also throw out a recommendation for Juliana Hatfield. She lacks a single standout album but her solo debut, Hey Babe, would probably be my suggested starting place.
EP is probably my favorite Fiery Furnaces release so I'll have to check out that new song.
I'm very hit-and-miss on Genesis but I like "After The Ordeal". It made my Genesis playlist, tracklist below:
Where the Sour Turns to Sweet
A Place to Call My Own
Try a Little Sadness (demo)
For Absent Friends
The Fountain of Salmacis
Image Blown Out (demo)
Watcher of the Skies
Dancing With the Moonlit Knight
I Know What I Like
After the Ordeal
Aisle of Plenty
Most of The Lamb Lies Down so I won't type out the individual track names