Meeting violence in another

Me again lol... soooo, is this saying that if my neighbor gets violent that my reactions to it - to defend myself or others from it, are self defence and not a definite indication that I am violent too as long as it is purely from a self defence state of mind? That is how I take it ... (right? wrong?)