I agree. Aluminum is very brittle. While steel might start to show some signs, aluminum will fail suddenly, and without warning. Why bother with an aluminum frame or fork? You're adding at least forty pounds to the bike with the motor and battery anyway. You should use a steel frame and go on a diet. You'll look better, and probably save more weight.
I hammered an aluminum frame into submission with a rear hub, no torque arm, no rear shock (hard tail), and it still survives. The only time it failed was with the bike stand bracket with the y bike stand like this one.
And yes it was sudden but not catastrophic and it was torn off at the welds.
With 28kgs of lead on the top bar it put too much stress on the rork (rear fork) reinforcement plate where those stand attach to, it failed when standing the bike up onto the Y stand.. The alloy frame still operated for months with out a hitch, I moved to a steel frame.
I haven't seen a aluminum frame with a rear motor fail yet I could be wrong, but I have seen countless aluminum forks fail. Usually with no torque arms and or on very powerful motors pushed to the limits.
Most alloy frames and forks are fine with heavy riders going down hill over bumps, its the twisting action the hubs place onto any front fork dropout that amount to the majority of failures.
I have witnessed a 10 km ride with a 36v pack, with a rear motor, with no torque arms, and two loose wheel nuts on my aluminum frame to survive. I had even a wheel nut pop off due to the thickness of the alloy dropouts and wheel not being centered making it hard to get enough thread over the axle, still no axle spin out was caused.
I will say my alluminium frame was very thick, the dropouts were heavy plate aluminum.
I honestly get worried even with front steel suspension forks with a rear motor, I look at them moving back and forth when I apply the brakes, Aluminium maybe even more of a worry as they don't flex as much. A front hub *gulps*.
I think as long as you have good torque arms and are not speeding at 45kph and bike with rider weighs less than 120kg I think you will be safe.. If your setup feels safe then this is a good sign. If you feel unsafe then you need to feel comfortable and safe when you ride and this is most important you fix any concerns.
Otherwise
No good changing things if you don't need to.