I replied to a spam email asking for my details?

[Luke]

Right long sotry short, this happened about a year ago and I only just remembered it but now after reading several websites I'm really worried. I recieved a message from someone saying they were my long lost lover so I replied saying they must have the wrong email, they kept replying backa nd said they had millions of dollars but they needed my credit card details and address to get to it, I messaged them back saying to leave me alone and they stopped; I didn't give away any details in my messages back but I searched on the internet a bit and apparently if you reply to a spammer they can trace your address and steal your identity so I'm really worried, is this true, should I be concerned?
This was on my emails BTW