UPSes come in a few formats, tower mount and rack mount. However, most UPS can be mounted in whatever direction you want. Some rack mounts work great turned sideways as small workstation UPS.
The only direction you cant mount is upside down.
But surprising, according to NASA, your UPS's lead acid batteries will work will in space.
