Building Infrastructure for AI Training & Inferencing
How do you define infrastructure to support inferencing? Today we discuss that and more, including training. We walk through what it's going to take to understand what to buy, what to build, how to build, how to put it together, and how hard it is to actually know what goes into the infrastructure behind an AI cluster. Importantly, exploring why we don't have the answers is the first phase of understanding. Transcript: https://otter.ai/u/2SIZyiLDtfyi_zGrol8qHvHc0gA?utm_source=copy_url