If we are not going to use the locales temp dir, we remove it immediately. Otherwise it will be left in /tmp/ forever (usually until a system reboot).
Fixes: #56