I think age at the time of the release plays a role in how much influence those (OT) movies had. At least I feel it did for me.
I was 7 when SW came out, spent a few years playing with the toys, admiring the trading cards, going to bed looking at the wallpaper, dreaming about it regularly. Keep in mind there wasn't much else going on in in the late 70s. Like I've said in the past; there's a period before SW, and a very different one after. So at 10, when ESB came out, my child's mind was ready for some serious hardcoding. ESB (and its open-ending) took care of that. That's why for me, ESB is up there.
ROTJ had too much closure. Jabba dies, BF "dies", Yoda dies, the Emperor "dies", Vader dies, the Empire is "defeated".
Nearly 40 years later I'm still watching ROTJ a few times a year. Crazy.