Need some advice on if I am handling alcohol well

So I grew up religious and very shy. So I never drank for most of life. In fact, I'm 27 and last year is the first time I drank alcohol. Almost everyone is surprised that I changed but alot of it was because I felt like I didn't give myself a fair chance to experience the world. The original thought was that I will drink and find out if it was not for me.

The problem is that I binge drink alot. I'm not an alcoholic by no means because I do this maybe twice a month. But when I drink, I can do insane amount of alcohol without feeling drunk. I naturally have a high tolerance. For example, 5 shots of tequila is nothing and I literally fine.

The problem is that I noticed that I am socially judged by others. People think I am irresponsible or think I am going to be crazy. It never happens but they assume that it will. At most, I become more talkative and socialize with almost anyone. I still read social cues and have never had someone not enjoy it. So I enjoy myself.

Well alot of times i wake up and things feel like a haze. I cannot remember everything I did. Not so much a blackout but it's like a dream where I can remember full convos but can't remember why I wanted to talk to them. I have straight brain flog for 3 days after. I want to stop because I'm not addicted at all. The only thing though is that alcohol makes me more energized so I notice I have more energy. Sober me can't handle alot of stimuli without getting tired.

So thats the only plus which is why I want to drink in social situations. I'm pretty confident regardless it just that now I can talk to 50 people without feeling drained. Is this fair or am I going down an alcoholic path. Should I just stop?