A thing to remember about lightsabers... The actual "blade" is near-one-dimensional. More like a self-terminating laser (but it's not a laser), less than a millimeter across in section. Except, by special dispensation, the Darksaber, but I'm not talking about that thing. Dooku's prong and Ahsoka's and Cal's shrouds wouldn't be touched by the blade. They're just within the nimbus of charged particles the blade generates (and possibly help with the attenuation of such). And the emitters themselves don't need to be lightsaber-resistant, any more than lasers slag themselves when turned on. It's a highly-energetic, tightly-collimated plasma arc. The separate generating and emitting elements in the hilt are fine with what they're interacting with. It all comes together within the magnetic or other force (small 'f') fields within the emitter itself. The finished blade never comes in contact with any part of the saber.
And yeah, the handling characteristics are why they only ever caught on with Jedi (possibly specifically developed by Jedi from the simpler and more ubiquitous plasma cutter). Using one effectively (and not accidentally slicing off your own leg) is essentially a meditative focus, with Force-enhanced precognition, strength, and dexterity all coming into play. Otherwise, a member of the general public picking one up will likely be able to do, say, a short, stroke to open up a tauntaun's belly without much trouble, but beyond that would get tricky. All the actual weight is in the hilt (and probably pommel-heavy, at that, where the power cell is).
The blade, when ignited, imparts a strong gyroscopic effect as the arc node generator pairs cycle at near-lightspeed, creating, effectively, a spinning blade that allows a swing in any direction to be a cutting edge. The wielder has to be braced and ready for that before hitting the 'on' switch. And then, once activated, it's going to be difficult to get the saber moving, and in the direction one wants. And then, once moving in a given direction, hard to get it to change direction or stop. So the blade will take a lot of strength to get where one wants it, when once wants it there. Almost like it's incredibly heavy.
This effect can be reduced somewhat by higher "tuning" (which also shifts the color spectrum toward the shorter wavelengths). Inveterate tinkerer Anakin Skywalker found ways to disrupt the harmonic, so his final saber was blue-shifted, but more scattered in frequency. And then he did the same for Ahsoka's sabers. Those three would probably be the easiest-to-wield lightsabers ever made -- after the Darksaber, which has no spin at all.