You can not completely remove them from following you on twitter. Only by blocking them. Follow these steps to block a user.
Login to Twitter and go to your Followers page:http://twitter.com/followers
Find the person that you don't want following you and choose "Block" to block them.
They won't be able to see your updates and they won't be able to follow you in future.