The notification gets sent when the reply is submitted. Sometimes the author will change his mind and delete it, maybe even post a replacement, then delete that one. You might get several notices and come back to see no replies. If the notices bother you then you can turn them off through the Email Reply Notification option ('Account' menu, select 'Change Options')