Hi there,
Its beacause the file is still open as its the last one "media" played and it doesn't really stop, just pauses.
Put an mp3 on an SD card and play that one, then pause\stop and you can delete the file\folder off the HDD.
Then you can pop the SD card out.
That worked for me!
Good luck,
Jason.