Technical talk by OpenAI’s Andrej Karpathy, which is nevertheless accessible enough for the lay audience. Especially good on what happens on the pre-training phase, as well as a guided tour on the history of the GPT’s (2,3,4 etc). Give it a go people.