A parrot implies it is only memorising but neural networks compress data, they are not a lookup table. If you can compress data without losing accuracy you have learnt the underlying representation of that data. This is partly what your brain does.