Twitter Karma is one way to check out who is following you on Twitter and who is NOT following you on Twitter. It is a completely FREE service and you can check as often as you would like. I try to check weekly or bi-weekly. Especially in the beginning - if you follow too many you cannot follow anymore; so why waste following someone if they are not conversing or following you back?
Reasons to follow someone:
Reasons not to follow someone: