So today I noticed that the motor was spinning on its own without any input from the throttle. It has been snowing, so I had a good build up of slush on the bike. I disconnected the battery a couple times and the motor still wanted to go on it's own. It wasn't full power either. Was more in spurts. It would respond to the throttle, so that was good. It wasn't till I lifted the rear of the bike up, and applied my back breaks to stop the wheel, that it stayed stopped. I was able to get home just fine after that. I wonder if the throttle was shorting a little bit ?
EDIT: After drying out for awile. I tried it again, and it did the same thing. The more I applied the throttle and let go. The slower the motor got, till it eventually stopped on it's own.