It wasn't even among the first Elephant 6 albums I heard (I think those would have been Her Wallpaper Reverie and Satanic Panic), when I first heard of E6 the albums I mainly saw praised as their most notable releases were I think Dusk at Cubist Castle, Gay Parade, and Fun Trick Noisemaker.
At the time ITAOTS struck me as something unique and special. It also helped that Mangum was still in his mysterious reclusive mode at the time. Now that the album has been turned into a meme and Mangum tours around milking the fanbase some of the lustre has worn off, and I can definitely understand rolling your eyes at the album if you try getting into it in the current environment. but the memories of how the album felt back then still remain when I listen to it.