Instance types & specifications

Foundry offers several instances of various NVIDIA GPU types fit for your workloads. We will continue to add instance types over time.

Depending on your instance type, Ethernet or InfiniBand interconnect may be available.

Instance name	GPU type	GPU memory (GB)	GPU quantity	# CPU cores	RAM (GB)	Ephemeral Storage (GB)
1x A100 80GB SXM	A100 SXM	80	1	24	250	1,750
2x A100 80GB SXM	A100 SXM	80	2	48	500	3,500
4x A100 80GB SXM	A100 SXM	80	4	96	1,000	7,000
8x A100 80GB SXM	A100 SXM	80	8	192	2,000	14,000
8x H100 80GB SXM	H100 SXM	80	8	192	2,048	15,202
1x A40 48GB PCIe	A40 PCIe	48	1	12	62	862
2x A40 48GB PCIe	A40 PCIe	48	2	24	124	1,725
4x A40 48GB PCIe	A40 PCIe	48	4	48	248	3,450
8x A40 48GB PCIe	A40 PCIe	48	8	96	496	6,900
1x A5000 24GB PCIe	A5000 PCIe	24	1	12	62	862
2x A5000 24GB PCIe	A5000 PCIe	24	2	24	124	1,725
4x A5000 24GB PCIe	A5000 PCIe	24	4	48	248	3,450
8x A5000 24GB PCIe	A5000 PCIe	24	8	96	496	6,900