Lucas didn't direct ROTJ either. He also wasn't the only writer in ROTJ and ESB which in my opinion is where the difference was.
I really enjoy Episode III, once you get past Anakin it's a really well made movie. Plus it shows the fall of the Jedi and that's pretty emotional to a Fanboy. After that it was ESB for me.