Recycle Bin.BIN issue

On a machine with some HDs and only FAT32 partitions after using a VistaPE built (about 1,5 years old) then a folder named "Recycle Bin.BIN" is created on every existing drive.
This folder is ("obviously", seen its name) hidden and with the windows bin icon, furthermore with a double-click then its name in address bar results as "$RECYCLE.BIN" and so I've just created a batch file in order to delete all of them (once VistaPE is unloaded).

Does someone know the why of this (normal?) behaviour?
Is there a (API?) way in order to avoid this folders creation?

Any thought appreciated.

Does someone know the why of this (normal?) behaviour?

 
Yes, it is the normal behaviour for Vista+ ... not just WinPE derived thereof, but their full installs, too, in a multiboot system cause the exact same problem. So, on one hand it's "by design", and on the other it's plain and simply just *bad design*. Now, Raymond Chen tells a story about it in the reference cited below (in the quoted text), which may be true, but just confirms it as no more than bad design:
 

The actual location of the Recycle Bin depends on the type of operating system and file system. On older FAT file systems (typically Windows 98 and prior), it is located in Drive:\RECYCLED. In the NTFS filesystem (Windows 2000, XP, NT) it is Drive:\RECYCLER. On Windows Vista and Windows 7 it is Drive:\$Recycle.Bin folder. Source: English Wikipedia, citing The Old New Thing, by Raymond Chen as the original source.

For FAT systems, "$RECYCLE.BIN" is the 8.3 name, while "Recycle Bin.BIN" is the long filename, which is the one usually shown. I have also created a simple script to delete them across all the machine's partitions on fixed disks, and, unfortunately, I haven't found any way of preventing their creation, either.