I didn't really have a problem with them until one time I had this begger chick nagging me so I went up a nerby wall. While climbing up she said something like " clean the city of filth" and threw a rock at me.
When ever the opportunity arises I enjoy watching beggars slump on my hidden blade and those "pushers" get nailed with a knife.
You know the mission that has you going out into the shipyards? When I got out there and saw all those drunkers I knew I had my work cut out for me and made sure to visit every boat those asses where and tossed them over. Come to find out it actually helps cause later on I have to go that way to reach my target.
The draw back here is the temporary lose of sync bars, which dosent really bother me considering the amount of satisfaction I get from it.