A file comes in two parts: the actual blocks of data that hold the file itself, and a directory entry with the name of the file, and the location of the first block.
When you delete a file, it only scrubs out the directory entry, and re-lists the data blocks as available for use.
If you want twenty minutes of rage-filled ranting, ask me about vscode-server sometime.