The first half of the video, Andrej goes over some fundamentals of how LLMs are trained and can be run in practice today.
Understanding the core technology and techniques behind training and running these models is important to building up a higher level understanding of how he pictures using them in an LLM OS later in the talk.