From the YouTube page:
Ilya Sutskever full talk "Sequence to sequence learning with neural networks: what a decade" at NeurIPS 2024 in Vancouver, Canada.
"Pre-training as we know it will end" and what comes next is superintelligence: agentic, reasons, understands and is self aware.
NeurIPS 2024 — 2024 Conference on Neural Information Processing Systems.
On super-intelligence, check out yesterday's long chat with Claude 3.5 Sonnet about super-intelligence. We started with chess and went on from there. No details on how to build it – it wasn't that kind of chat – but some speculation about the relationship between human intelligence and putative super-intelligence.
As for the AI of the future, the one Sutskever claims will be agentic, capable of reasoning (which has the side-effect of making it unpredictable), and capable of understanding, I can offer some thoughts about the brain. Some years ago David Hays and I reviewed a wide range of materials in neuroscience, developmental psychology, the phylogeny of brain development and so forth, and published a speculative paper: Principles and Development of Natural Intelligence. More recently I've extended those speculations with some new ones: Relational Nets Over Attractors, A Primer.