So basicly re-write it from scratch, then...
Even if you do something fancy like that, three people could gang up to pick on someone.

I can make it so only positive rep can be left, but even that can be abused.