One of the things that contributed to me coming here from twitta, was the twitteratti obsession with followers.
There is even an app that posts how many new followers they have and how many they lost.
Not exactly great reading on a post imho.
I follow people if they post things I find interesting or funny.
I dont see it as required that you follow back.
Your choice.
I am not the messiah or the pied piper, So I really dont care.