"odds and ends collections usually aren't particularly good albums"
Agreed but "Pisces" is a major exception (you also mention "20/20", which is another exception) and maybe the only example I can think of where an "odds and sods" collection is an artist's best release.
Not sure whether you'd enjoy "Stereopathetic Soulmaure" or "One Foot In The Grave". I was personally bored to tears by "Morning Phase" but it's a self-conscious "Sea Change" sequel and I know you love that one so it's probably worth a listen. And "Midnite Vultures" is maybe Beck's silliest album which is saying a lot but it's a lot of fun if you judge it on its own terms.
"Well I know the hits, which will probably prove to be good enough for me"
I can understand feeling this way about The Beach Boys but think most Beatles fans would agree that their deep cuts are often their best- is probably true of the later albums you're familiar with, isn't it?