Tuesday, April 25, 2023

Relu functions

Despite their practical success, Relu activations are theoretically ill-defined. This is due to the existence of numerous trivial local optima where the gradient is zero, and we are optimizing them with approximate local optimizers.
at

No comments:

Post a Comment

Subscribe to: Post Comments (Atom)

AI

Despite the benefits of AI we are starving for humanity.

  • Robot Dish Washer
    It is difficult to create robot that cleans our arbitrary dirty dishes. However  , if we put some digital information on dishes (special des...
  • Time Zones
    Our parents were arranging their schedule according to sunrise and sunset. They are still consistent in their habit. However, in our generat...
  • (no title)
    Robot Particles Display: Current display devices can show any image for a very cheap price. But it will be very intresting if someone tr...