Nvidia A100 owns impressive parameters such as 80 GB memory, 2 Tb / s bandwidth with a retail price of up to $ 30,000 and is considered the most expensive graphics card today.
The expensive price of Nvidia A100 is due to being manufactured on an advanced process, possessing outstanding parameters and processing power.
The Nvidia A100 is built on the advanced 7nm TSMC fabrication process, possesses 80 GB of memory, provides a maximum bandwidth of 2 Tb/s, nearly 7,000 32-bit CUDA cores, 3,500 64-bit cores, and over 400 Tensor cores. This helps give the Nvidia A100 more processing power while reducing power usage.
Nvidia A100 is considered by Tom’s Hardware as the fastest graphics card that man has ever made.
The Nvidia A100 is part of the DGX 100 system developed for the AI data center. This system is packed with 8 Nvidia A100 cards that are paired together to scale to thousands of GPUs to handle any requirement.
Passing through Nvidia’s NVLink bridges significantly increases the bandwidth and computing power of each Nvidia A100. MIG (Multi-Instance GPU) technology allows the Nvidia A100 to be split into 7 GPU instances to run 7 different workloads at the same time.
The retail price of each Nvidia A100 is up to $ 30,000, while the DGX 100 system costs hundreds of thousands of dollars along with a service fee.