Then you need to willing to actually engage the folks who you follow and follow you...
For example SaraforCongress, when you were accused of doing some 'interesting poling' regarding some of the questions that were asked.
Don't think you are going to be able to get away with some sort of half answer half evade thing... Why, because by starting to twitter you have tried to create the illusion of having a two way conversation with people, once you start responding to people via something like twitter everyone who uses it will feel they also should be getting a response.
If you are going to engage in social media, you need to be well, social. You need to answer the tough questions. Because it wasn't just me who asked you about this on twitter. You decided to engage in a conversation using social media, I would suggest you actually do so.