Currently, there are two things missing from the most recently used file list.
1. You cannot remove an entry without modifying the Windows Registry. In Visual Studio you can right-click and remove.

1. It is missing duplicate checking. If I open the same file twice, I get two copies in the list.