Should I finally fight him or ignore him? Kind of long but please help.?

I dont think you should fight him because after you beat the **** out of him. He will return with his little buddies and beat the **** out of you. Or he might attack you with weapons. Just start trash talking him and let him attack you. Dont attack him back just block or push him off if you think you can handle it. then let him deal with the police.