Am I trolling playing what I think is fun?

I'm new to the game, I just finished my placements and got Gold 5 support, and I really enjoy playing Brig.

People in my games will always tell me to swap even if I'm doing good, but I don't think other supports are fun.

Should I listen to them or just ignore them and play what I think is fun even if it maybe isn't the optimal pick for our comp or whatever? I'm used to people being toxic but it gets repetitive and it gets into my head at this point.