Instance types & specifications
Last updated
Last updated
Foundry offers several instances of various NVIDIA GPU types fit for your workloads. We will continue to add instance types over time.
Depending on your instance type, Ethernet or InfiniBand interconnect may be available.
All Foundry instances are provisioned with the following by default:
Ubuntu 22.04
NVIDIA driver version: 535
Cuda version: 12.2
You can use startup scripts to customize your environment during the startup process of your instances.
Instance name | GPU type | GPU memory (GB) | GPU quantity | # CPU cores | RAM (GB) | Ephemeral Storage (GB) |
---|---|---|---|---|---|---|
1x A100 80GB SXM
A100 SXM
1
24
250
1,750
2x A100 80GB SXM
A100 SXM
2
48
500
3,500
4x A100 80GB SXM
A100 SXM
4
96
1,000
7,000
8x A100 80GB SXM
A100 SXM
8
192
2,000
14,000
8x H100 80GB SXM
H100 SXM
8
192
2,048
15,202
1x A40 48GB PCIe
A40 PCIe
1
12
62
862
2x A40 48GB PCIe
A40 PCIe
2
24
124
1,725
4x A40 48GB PCIe
A40 PCIe
4
48
248
3,450
8x A40 48GB PCIe
A40 PCIe
8
96
496
6,900
1x A5000 24GB PCIe
A5000 PCIe
1
12
62
862
2x A5000 24GB PCIe
A5000 PCIe
2
24
124
1,725
4x A5000 24GB PCIe
A5000 PCIe
4
48
248
3,450
8x A5000 24GB PCIe
A5000 PCIe
8
96
496
6,900