*I actually am not much of a fan of Big Boi's first LP (Sir Lucious Left Foot is probably what you meant) either.
*I LOVE Prince Paul, and Dust Bros. did some of the craziest sampling ever. so it's not like we're totally on different pages here.
*Not familiar with Daedalus outside the track you mentioned, Accordion. I usually check out the Stones Throw artists but never dug into him. Probably should remedy that.
*RJD2 is trash for white people. LOL, sorry, I always found him to be pedestrian. In college everyone found him to be a big deal and my reaction was always 'meh' I don't think he's terribly comparable to Madlib.
*Kanye is a great producer who uses lots of weird samples. Madlib was a big influence to Kanye (they ended up linking up for The Life Of Pablo on one track).
Not sure what I could do to get you into Madlib. He's a jazz artist as much as a hip-hop artist (although maybe not your cup of tea).
I think you would like Quasimoto (Lord Quas). It's Madlib speeding up his voice and pretending to be this criminal alter ego... Madlib himself raps back and forth with "Quas." ('Lib isn't necessarily the greatest rapper, but his stoned flow works for his own projects.) He claimed to have made the first record, The Unseen, on a mushroom binge. It's not for most people, but you seem to gravitate toward weird/experimental stuff, so I would recommend The Unseen if you want to give it a shot. Maybe try Lootpack, as well, his first group where he was the producer.
I dunno... I have never found a producer with as diverse a sample source as Madlib. He pulls all kinds of crazy stuff... he has beat tapes of all Indian music, all African and so on. The scope of his work is overwhelming.