All perfect praise be to Allah, The Lord of the Worlds. I testify that there is none worthy of worship except Allah, and that Muhammad is His slave and Messenger.
These are nothing but whispers. As long as you are not certain, a certainty upon which you can swear, that you have discharged something, then just ignore all this and do not pay any attention to it. You have to act according to the principle that you are on the state of purity.
For more benefit on whispers about purity and how to treat them, please refer to Fatawa 92050 and 92641.
Allah Knows best.