Human nature

I've just been thinking/ noticing something. If someone is rude to us on the street or the road or wherever we react to them in some way right? (even if it's in our head) but if someone is rude to us at church so many people react towards the church instead of the individual. Is it only obvious to me that obnoxious people and stereotypes are everywhere? So why do people go away from the church because they're ignored or offended or for any other reason regarding people when it has nothing to do with the church itself? Are we so primeval that we see the church as guilty by association instead of seeing the obvious; that arrogant and self righteous people are in any large group? High school, work, the gym, centrelink, facebook...
I could be wrong but people seem to me to go away from the church because they either misunderstand the doctrine (sometimes because someone's preaching false doctrine and the person doesn't find out for themself) or for people related issues. I like to think that human beings are intelligent, but denying a perfectly good organization because of some person or people in it denies logic. Having said that I myeself spent some time away from the church for both of those reasons, but as soon as I understood the principles of the Gospel and gained an open hearted testimony of our Saviour Jesus Christ, the people issues became an irrelevant inconvenience (as far as church activity goes anyway) and the doctrinal questions eventually lead to answers so in the meantime my testimony fills in the blanks until those answers come. Jesus said that the well need no physician, so maybe that's why there are crazy people coming to church. They see a light even if they don't know what to do with it. The world is full of nice people as well as obnoxious little snots, so why should the church come into that at all?