Generally, I've always thought they were separate things, my furriness and my sexuality.
To be fair, though, I don't think I ever would've considered that I'm bi if I hadn't joined the fandom.
But yeah, I don't mind if people link the two. Whatever people like is their own business, and it doesn't affect me.
Judging is just a natural part of being anything different, really. If you like an old TV show, if you listen to jazz or classical music, if you're gay... If you're that into something (excluding sexuality, which isn't a choice), then you should be prepared to be judged.