No. You handled it completely right. It comes with experience, wisdom, and confidence. Jack asses jump out of their cars with their chests puffed up. We are old warrior lions with nothing left to prove. Only weak men who doubt themselves feel the need to try to meet every perceived slight with violence, it's because they doubt themselves and their courage, and they are always trying to reassure themselves they are tough guys because they don't believe it. We know what we are, and don't need to prove it to ourselves or anyone else. Of course we could walk through the world regulating and leaving a trail of suplexed mush in our wakes, but to what end?
You stared the man down and then had the pleasure of watching him self destruct. People who come over the top with aggression are venting fear. He was weak, you were strong.