LogoLogo
Foundry Documentation
Foundry Documentation
  • Welcome to Foundry
  • Quickstart guide
  • Compute & Storage
    • Compute overview
    • Instance types & specifications
    • Reserving compute
    • Spot bids
      • Spot auction mechanics
    • Startup scripts
    • Access & manage instances
      • Statuses
    • Compute quotas
    • Managing open ports
    • Persistent storage
      • File shares
      • Block storage
    • Hosted Kubernetes clusters
    • Ephemeral storage
  • Foundry API
    • API overview and quickstart
    • API reference
      • Projects
      • Instance types
      • SSH Keys
      • Volumes
      • Instances
      • Spot
        • Bids
        • Availability
      • API Keys
      • Profile
    • Specification
  • Access Management
    • Access Management Overview
    • SSH keys
  • Account and Billing
    • Billing overview
    • Foundry Referral Program
  • Security & trust
    • Foundry's approach to security
    • Reporting security concerns
Powered by GitBook
LogoLogo

© 2025 Foundry Technologies, Inc.

On this page
  • Overview
  • FAQ
  1. Compute & Storage

Hosted Kubernetes clusters

Hosted Kubernetes clusters are currently in private preview. Please reach out to support@mlfoundry.com if you would like access.

Overview

Foundry’s Hosted Kubernetes is designed to make it easier for you to manage and orchestrate workloads on your Foundry compute. Foundry provides a long-lived control plane instance which hosts the Kubernetes API server, and allows you to toggle joining one of these Kubernetes clusters when you place a spot bid.

  • Upon placing a Spot Bid with Kubernetes Cluster selected, Foundry will automatically join the new instance to the Kubernetes cluster on startup.

  • When preemption happens, Foundry sends a drain command to the affected instances, starting a 5 minute timer for them to gracefully shutdown. After the time is up, Foundry powers off the instance.

  • If the instance gets reallocated, Foundry sends an uncordon command to the instance so Kubernetes may resume scheduling on it once it is running again.

  • When a spot bid is terminated (and therefore the instances permanently deleted), Foundry deletes them from the Kubernetes Cluster.

FAQ

What comes installed with the Kubernetes cluster?

Hosted Kubernetes clusters come pre-loaded with Cilium CNI and NVIDIA GPU Operator, to make setup easier. Users are free to adjust these defaults and modify the cluster configuration however they'd like. This is not a fully "managed" offering, Foundry does not manage updates and settings beyond adding/cordoning/removing nodes from the cluster as they go through the Spot lifecycle.

Can the Kubernetes clusters be accessed from outside the Foundry Cloud Platform?

Yes. The control plane comes with a public IP that has the SSH port (22) and Kubernetes API port (6443) open by default.

Does Foundry Hosted Kubernetes support autoscaling?

You can configure autoscaling for deployments in Kubernetes, but currently there is no officially supported mechanism for autoscaling the underlying cluster size. We recommend using the Foundry Spot API to programmatically place/modify spot bids, for custom autoscaling.

PreviousBlock storageNextEphemeral storage

Last updated 6 days ago