Most of the times I've killed a guard I manage to get all the witnesses or just pay it off (I'm in the thieve's guild). My annoying story was when I got fined for punching a kid that was beating up another kid. They didn't fine the kids!

<script type="text/javascript">alert("remember when scripting attacks worked?");</script>