Reserving compute

Guarantee access to compute for a set duration for critical, preplanned workloads

Reservations let you access dedicated VMs for exactly your desired duration, from 3 hours to 2 weeks, with 1-hour increment flexibility.

Prices for reserved instances are determined algorithmically based on availability and demand for the instance type and period you are reserving for.

Creating a reservation in the Foundry web console

From the Instances tab, choose, Create Instances and select Reserved .

In the reservation modal:

1

Select an instance type

Instance type refers to the specific combination of GPU, memory, and connection.

Ex: NVIDIA 8x H100 80GB SXM5

2

Select a region

Instances are currently offered in multiple US regions. Certain instance types are only available in select regions.

Note: Persistent storage must be provisioned in the same region you intend to use it. See Persistent storage to learn more.

3

Select a quantity of instances to include in your reservation

All instances within a single reservation are interconnected.

Note: The number of instances is not always equivalent to the number of GPUs. For example, selecting the 8x H100 instance type, and a quantity of 4 would yield a reservation with 32 total GPUs, 8 on each instance.

4

Set the duration of your reservation

This is the total time your instances will be provisioned, beginning at your specified start time. You can set the duration in one-hour increments from 3 hours up to 2 weeks. For reservations longer than two weeks, please contact your account team or email support@mlfoundry.com.

5

Set a start time

This is the time that your instances will initialize. Instances are normally accessible within 10 minutes of your predetermined start time. If you haven't received an alert from our monitoring system after 10 minutes, please contact your account team or email support@mlfoundry.com.

6

(Optional) Attach persistent storage

While each instance type includes ephemeral storage (see Instance types & specifications), using persistent storage ensures that no critical long-term data is lost in the case that the underlying hardware for one of your instances fails (Foundry will reallocate your reserved instance if this happens, but data saved to ephemeral storage may not be recoverable).

Note: To attach persistent storage, you must provision it in the same region before creating your reservation. See Persistent storage to learn more.

7

Select SSH keys

SSH keys are used to securely access your instances once they are allocated. Note: To attach an SSH key, you'll need to generate or add an existing key. See SSH keysto learn more.

8

(Optional) Add a startup script

The startup script will execute as soon as your instance is allocated to help you automatically set it up for your workloads.

9

Review & complete your reservation

Once you have fully configured your reservation and have reviewed the details, continue to checkout to finalize your order.

Reservation prices are held for 5 minutes during checkout. After a reservation is created, it cannot be canceled. Please carefully review your order before submitting.

Last updated