Yeah, this "toxic fans" narrative didn't make sense to me then and it doesn't make sense to me now. It's made to sound as if there were legions of fans that had nothing better to do than harass these actors (prior to social media mind you) on a daily basis. Jake Lloyd sadly has mental issues. Judging from his appearance in the Mandalorian, Ahmed Best probably didn't have the acting chops to get further in Hollywood. I highly doubt casting directors would have cared that he played an unpopular cgi cartoon character that in no way resembles his real-life acting persona/image, that 99% of an audience wouldn't recognize him from. Hayden just got hit with bad luck. He starred in a few movies post Star Wars that weren't successful enough to make him a bankable actor. After that, the "Star Wars 'stigma'" that afflicted Hamill, Fisher, and Williams latched onto him. As for George... I think he couldn't give less of a damn about what people thought. I'm sure he was disappointed that the prequels weren't better received but, to suggest toxic fans are the reason for him no longer wanting to make films is pretty hard to believe. I doubt someone as highly driven as he was would get that hurt by some fans crying over a set of movies.
This is all just apologists projecting their own victim mentalities.