Software 2.0
From binary to learned maps to natural-language programming
A Universal Turing Machine is what we call a computer, it is a machine that can be programmed to run computation. So, first computers were programmed quite manually with 0 and 1 to add numbers together, until we invented assembly language. Assembly language allowed humans to program faster, in a more intuitive way, being closer to our natural language with things such as “add”. Then we invented compilers, which turns language even closer to our natural language into this assembly thingy.
Deep learning was the next step, instead of using “if this do that”, the machine learned a map of the territory.
Software 2.0 has been used in large companies for a while, at Google they may have started using models around 2000.
But since 2019, there is public access to GPT3 which is Software 3.0, basically, coding in natural language.
Mentions of Software 2.0 / Software 3.0
- Lex Fridman Podcast - 333 – Andrej Karpathy — Tesla AI, Self-Driving, Optimus, Aliens, and AGI
- NVIDIA’s Clément Farabet on Orchestrating AI Training for Autonomous Vehicles - Ep. 175