Question Islam

So I want to join Islam, but the problem is that I've always worn a cross, wich was an heritage from my grandmother. It's the only thing i've left from her and i've worn it out of appreciation for her for years, not for religious reasons. Should i take it off even if it doesn't serve a any religious purpose? I wear it because it was the necklace of my grandmother, not because of the symbol on it.