# Architecture
The Cloud AI inference cards contain one or more Cloud AI 100 SoCs per card
and are designed to operate at a specific TDP. The cards interface with
the host using PCIe and to the BMC using SMBus/I^2^C. The following image provides a block diagram of the Cloud AI 100 Ultra card.
The previous image shows the following:
- Cloud AI 100 Ultra Card: This is a single width PCIe form-factor accelerator card that contains one or more SoCs. The Ultra SKU has four SoCs per card.
- SoC: This is the system-on-chip that contains up to 16 AI cores. For the Standard and Pro SKUs, the number of SoCs per card is one instead of four.
- AI Core: This is the smallest compute unit on which a neural network can be executed.
The following table provides the key hardware specifications across the available SKUs.
| Accelerator
SKU | AI 100
Standard | AI 100 Pro | AI 100
Ultra | AI 080
Ultra |
| --- | --- | --- | --- | --- |
| AI SoC
Count | 1 | 1 | 4 | 4 |
| AI cores
per SoC | 14 | 16 | 16 | 8 |
| AI cores
per card | 14 | 16 | 64 | 32 |
| DDR
Capacity | 16 GB | 32 GB | 128 GB | 128 GB |
| DDR BW | 137 GB/s | 137 GB/s | 548 GB/s | 548 GB/s |
| On-chip
SRAM | 126 MB | 144 MB | 576 MB | 576 MB |
| FP16 | 110 TFLOPs | 125 TFLOPs | 290 TFLOPs | 222 TFLOPs |
| Int8 | 325 TOPs | 375 TOPs | 870 TOPs | 618 TOPs |
| Connection
to host via
PCIe | Gen4 x8 | Gen4 x8 | Gen4 x16 | Gen4 x16 |
| TDP | 75 W | 75 W | 150 W | 150 W |
| Formfactor | PCIe HHHL | PCIe HHHL | PCIe FH3/4L | PCIe FH3/4L |
The Cloud AI 100 Ultra SKU has four AI 100 SoCs and a PCIe switch on the
card. The interface to the host is through the PCIe switch using a PCIe
gen4 x16 interface. The PCIe switch connects to the four AI 100 SoCs using a
PCIe Gen4 x 8 interface.
The Cloud AI 100 Standard and Pro SKUs have one AI 100 SoC on the card
interfacing to the host using a PCIe Gen4 x 8 interface.
## Next steps
>
>
> - [Check Cloud AI accelerator card health and functionality](https://docs.qualcomm.com/doc/80-92111-1/topic/check-card-health.html#check-card-health)
Last Published: May 01, 2026
[Previous Topic
Create graphs and dashboards](https://docs.qualcomm.com/bundle/publicresource/80-99100-3/topics/aic-manager-how-to.md) [Next Topic
Python API](https://docs.qualcomm.com/bundle/publicresource/80-99100-3/topics/index_Python-API.md)