Yes this is certainly possible, but you will need to use a USB programming cable or Bluetooth dongle etc. to reprogram the controller's voltage setting to 24V and the throttle and motor will work fine.
However, the battery gauge on the throttle will not work, as none of the LEDs on the 48V throttle are likely to light up with a 24V battery.
Alan
