The one-liner

A neural network is a giant adjustable function.

Numbers go in, numbers come out, and millions of internal dials decide what happens in between. Everything it 'knows' is just the positions of those dials.