I've opened a ticket with bugtracker on torproject.org (bug #16847).
In the meantime, I've noticed the Portable version of Torbrowser installs just fine.
Google: torbrowser portable
The first result is from sourceforge, download the latest version from them (currently it's: 5.0.1). This worked for me.