Ah, yeah, then that means the render needs to re-update.  It may take a few hours to disappear from the render.

If it isn't there when you go into edit mode, then it has already been removed

What you see when not in edit mode is a render, and it can take a while to update.