I think the elephant in the room
is that Star Wars is just not a very profound or serious narrative. It's less about the characters as people than the emotions they stir in the audience. Vader's redemption at the end of ROTJ is so beautiful and total bullshit at the same time, for example. The original trilogy had the right balance of action and emotional weight to get by this problem; Lucas and Kennedy only magnified it when they both revived the series.