How do Graphics Cards Work? Exploring GPU Architecture

Interested in working with Micron to make cutting-edge memory chips? Work at Micron: https://bit.ly/micron-careers Learn more about Micron's Graphic Memory! Explore Here: https://bit.ly/micron-graphic-memory Curious about AI memory and HBM3E? Take a look: https://bit.ly/micron-hbm3e Graphics Cards can run some of the most incredible video games, but how many calculations do they perform every single second? Well, some of the most advanced graphics perform 36 Trillion calculations or more every single second. But how can a single device manage these tens of trillions of calculations? In this video, we explore the architecture inside the 3090 graphics card and the GA102 GPU chip architecture. Note: We chose to feature the 30 series of GPUs because, to create accurate 3D models, we had to tear down a 3090 GPU rather destructively. We typically select a slightly older model because we're able to find broken components on eBay. If you're wondering, the 4090 can perform 82.58 trillion calculations a second, and then we're sure the 5090 will be even more. Table of Contents: 00:00 - How many calculations do Graphics Cards Perform? 02:15 - The Difference between GPUs and CPUs? 04:56 - GPU GA102 Architecture 06:59 - GPU GA102 Manufacturing 08:48 - CUDA Core Design 11:09 - Graphics Cards Components 12:04 - Graphics Memory GDDR6X GDDR7 15:11 - All about Micron 16:51 - Single Instruction Multiple Data Architecture 17:49 - Why GPUs run Video Game Graphics, Object Transformations 20:53 - Thread Architecture 23:31 - Help Branch Education Out! 24:29 - Bitcoin Mining 26:50 - Tensor Cores 27:58 - Outro We're working on more ambitious subjects like computer architecture and graphics cards. Any contribution would greatly help make these videos. https://www.patreon.com/brancheducation Branch Education Website: https://www.branch.education Branch Education Facebook: https://www.facebook.com/BranchEducation/ Key Branches from this video are: How do Video Game Graphics Work? https://youtu.be/C8YtdC8mxTU Animation: Mike Radjabov, Sherdil Davronov, Adrei Dulay, Parvesh Khatri Research, Script and Editing: Teddy Tablante Twitter: @teddytablante Modeling: Mike Radjabov, Prakash Kakadiya Voice Over: Phil Lee Sound Design by Drilu: www.drilu.world Sound Design and mix: David Pinete Additional Sound Design: Raúl Núñez Supervising Sound Editor: Luis Huesca Erratum: 04:50 Ubuntu is a type of Linux 08:45 3080 has 10GB, not 12GB. Image Attribution: Williams, George. Jacquard Loom 6/6 https://www.flickr.com/photos/ghwpix/18056523/in/album-72157631870990316/ Eiermann, Georg. A close up of a weaving machine in a room. Jacquard Loom. https://unsplash.com/photos/a-close-up-of-a-weaving-machine-in-a-room--jvBPiva0vc Wikipedia contributors. "Embarrassingly Parallel", "Graphics Processing Unit", "Parallel Computing" , " SIMD", " Single Instruction, Multiple Threads" , "Thread block (CUDA Programming)". Wikipedia, The Free Encyclopedia. Wikipedia, The Free Encyclopedia, Visited October 18th 2024 Textbooks and Papers A TON of information was found in Nvidia's white papers. You can find them here: https://research.nvidia.com/publications We recommend the GA102 architecture white paper and the fermi architecture white paper. #GPU #GraphicsCard #Micron