Instance types & specifications
Foundry offers several instances of various NVIDIA GPU types fit for your workloads. We will continue to add instance types over time.
Depending on your instance type, Ethernet or InfiniBand interconnect may be available.
Base image
All Foundry instances are provisioned with the following by default:
Ubuntu 22.04
NVIDIA driver version: 535
Cuda version: 12.2
You can use startup scripts to customize your environment during the startup process of your instances.
Hardware specifications
Each instance comes with its own ephemeral storage (outlined below), usually with NVMe SSD. This storage will exist until the instance has been terminated or pre-empted. There is no cost to use the ephemeral storage. Ephemeral storage is automatically mounted for you (and re-mounted after preemptions) at /mnt/local
.
1x A100 80GB SXM
A100 SXM
1
24
250
1,750
2x A100 80GB SXM
A100 SXM
2
48
500
3,500
4x A100 80GB SXM
A100 SXM
4
96
1,000
7,000
8x A100 80GB SXM
A100 SXM
8
192
2,000
14,000
8x H100 80GB SXM
H100 SXM
8
168
2,048
12,500
Last updated