The way I see it, the two most important features of Neural Networks that make them so powerful are 1. Differentiability and 2. Compositionality. Differentiability enables optimization using gradient descent, which is orders of magnitude faster than most other numerical…

Bojan’s Newsletter