Because of the way email works, you can "fake" where the email comes from.
Just like post office mail. You can put a fake return address on a letter, and drop it in the mailbox. The receiver will not know the real sender, only the "spoofed" address.
So, it is likely someone "spoofed" your gmail email address, so the person who received the spam thought you were the sender and replied.