Instance types & specifications

Foundry offers several instances of various NVIDIA GPU types fit for your workloads. We will continue to add instance types over time.

Depending on your instance type, Ethernet or InfiniBand interconnect may be available.

Base image

All Foundry instances are provisioned with the following by default:

• Ubuntu 22.04

• NVIDIA driver version: 535

• Cuda version: 12.2

You can use startup scripts to customize your environment during the startup process of your instances.

Hardware specifications

Instance name	GPU type	GPU memory (GB)	GPU quantity	# CPU cores	RAM (GB)	Ephemeral Storage (GB)
1x A100 80GB SXM	A100 SXM	80	1	24	250	1,750
2x A100 80GB SXM	A100 SXM	80	2	48	500	3,500
4x A100 80GB SXM	A100 SXM	80	4	96	1,000	7,000
8x A100 80GB SXM	A100 SXM	80	8	192	2,000	14,000
8x H100 80GB SXM	H100 SXM	80	8	192	2,048	15,202
1x A40 48GB PCIe	A40 PCIe	48	1	12	62	862
2x A40 48GB PCIe	A40 PCIe	48	2	24	124	1,725
4x A40 48GB PCIe	A40 PCIe	48	4	48	248	3,450
8x A40 48GB PCIe	A40 PCIe	48	8	96	496	6,900
1x A5000 24GB PCIe	A5000 PCIe	24	1	12	62	862
2x A5000 24GB PCIe	A5000 PCIe	24	2	24	124	1,725
4x A5000 24GB PCIe	A5000 PCIe	24	4	48	248	3,450
8x A5000 24GB PCIe	A5000 PCIe	24	8	96	496	6,900