The criteria would be: defunct bands (not just those on extended hiatuses) which you started to follow when the debut full-length album was the only album yet released (or before), and which you then followed until they disbanded. Minimum three albums released.
One for me would be The Mars Volta. It's not as if I'm a fan of every album, but I did discover them right when they started and I either got or heard every album along the way as they were released.
I'm sure there are others.