By and large, Furries are just people who share an interest and/or love for anthropomorphic animals. There are various other aspects to the fandom, such as therians (of which I also identify as), but the interest in and love for anthros is the unifying trait among furries. That, and actually considering yourself to be one, as a number of anthro artists don't consider themselves as furries.
To me, it sounds like a lot of your thoughts about furries have come from the mainstream media, who as Puncia said, have demonized us at almost every turn.