Correlation is not causation, and yet, a correlation exists and I'd rather lose these visitors than getting headaches later.
And sure, you can always rationalize anything, but I still see a difference between a pop-up that offers something the reader might like against a dark pattern that forces or tricks someone to sing up.
I'm not annoying: I'm annoyed by these annoying practices.