Why Menlo Cloud?

Menlo’s original “GPU cloud” in May 2023

Menlo has always run its own infrastructure. We started out small:

• Started with two 4090s run in our founder’s spare bedroom
• Multiple machines running in our Infra Lead’s spare bedroom

Over time, Menlo Cloud has become a internal cloud running in a datacenter, with strong uptime and reliability guarantees.

Use-cases

Internal Use

Menlo Cloud currently supports several open source projects, including:

• Jan’s cross-platform GPU CI/CD
• llama.cpp’s Intel GPU CI/CD
• (soon) Jan’s Cloud LLM APIs

If you are an open source project or contributor and would like to use Menlo Cloud, please reach out to us on Discord.

GPU Workstations

• GPU workstations with persistent volumes for storage
• Currently provides GPU workstations for Menlo’s remote team and affiliated developers

Design

Architecture

• OpenStack-based infrastructure
• Nvidia, AMD and Intel GPUs
• Colocated in Datacenter in Ubi, Singapore

GPU Server

Menlo Cloud uses custom-built GPU Servers that use commodity workstation motherboards and GPUs, that are optimized for cost efficiency and easy maintenance.

We designed the GPU for easy maintainability and upgradeability in datacenter environments.

GPU Workstations

We currently build GPU Workstations based on Nvidia’s RTX Pro series for our team. We may offer it for sale to the public in the future.