I, for one, will say this: I have been associated with the SSPX for 10 years and admire them and their priests, and am grateful for what they have done, and continue to do, in service of the Faith and the Tridentine Mass. I do not pretend to agree with every one of their positions - which in themselves do not bind anyone - let alone the opinions of all their bishops, priests or lay faithful in their chapels. In fact, I strongly disagree with many. Fortunately, the majority of the SSPX-supporting laity I have met (admittedly not a great number), are mainly just devout Catholics looking for a place to keep their Faith. However, the overall impression one gets from Trad forums is of the stereotype SSPXer - whom, unfortunately, I have also met in real life - bitter and twisted, cynical, self-righteous, neo-Jansenistic, crypto-sedevacantist Puritans who lash out at anyone who dares disagree with their little group, and calumniates anyone outside the SSPX milieu, especially those who choose to leave it, as quislings, compromising faint-hearts, neo-cons who just love smells and bells and Latin and lace, etc, etc. This "extra SSPX nulla salus" mentality is sick sick sick. Fortunately, in my own chapel, only a few conform to this stereotype, and most do not. I imagine this is the case in most places.
In digesting your point here this is what I umderstamd: although the laity who frequent the same Society chapel as you do don't fit this steriotype and you have met very few in fact who do so yet you feel compelled to point out that the Society laity in general are "bitter, twisted, cynical, self-righteous, neo-Jansenistic, Crypto-sedevacantist Puritans" and are "sick sick sick".
I hope that you don't mind if I feel somehow offended by this.

The attitude of the OP is that "I am leaving but don't have to defend my decision". I believe that's because his reason for leaving is indefensible and he knows it. I don't have to be a Janseistic Puritan to see that since it's simple human psychology.
In witnessing this type of behavior before at least twice that I can recall they ranted and raved against the Society, thanked God for seeing the light and rushed off into the darkness. Later they quietly and sheepishly returned after reexperiencing the craziness of the Novus Ordo.
Deja vu. Pray for him.
~In JMJ