I mean, we're talking about one of ny all time favorite albums but I also know where you're coming from. When I started listening to soul albums back in high school, I'd really only heard Motown and 90's R&B hits. I loved that stuff but being used to listen to a whole album took getting used to and like jazz, it sounded a bit repetitive at first. Think this is common when exploring an alien musical genre, especially one informed by a different cultural background than yours.
All I can say re: both soul and Brazilian stuff is try to remember that getting into jazz took you awhile as well but now you seem to love it. Gotta retrain your ears. That's part of the fun.
I'm generally not a discography guy but Harry doesn't seem like a bad choice. He's one of my absolute favorite singers and songwriters so I'm obviously biased but he has very few stinkers. In fact, "Skidoo" is the only one I'd adamantly dissuade anyone from listening to.