I'm the same with Bowie
I'm a fair-weather fan and have always stressed that his main strength is sonic textures rather than composition. And yeah, even his best albums are patchy. But "Blackstar" is a case where if you listen to it, it's clear he knew he was dying and consciously set out to make a cohesive, ambitious final artistic statement and completely succeeded. It's also a more confident and individual take on the krautrocky sound he explored on the "Berlin Trilogy" but arguably beats those albums in terms of both maturity and consistency.
But yeah, Bowie's one of those artists who I go back and forth re: best album. "Blackstar"'s the one I mostly default to but "Station To Station" is way up there too, mainly because it's his funkiest album and I really like his coked out version of funk (also an early photo-Berlin Trilogy hint of the krautrock influence). But "Hunky Dory"'s way up there too, even if it's less edgy bro