gpu

Explore GPUs available on Modal

GPUEntry


def GPUEntry(
    tag:str, # GPU tag, e.g. 'H100'
    price:float, # Price per hour (USD)
    vram:int, # VRAM in GB
)->None:

Initialize self. See help(type(self)) for accurate signature.

GPUEntry('T4', 0.59, 16)
T4 · $0.59/hr · 16GB

GPU


def GPU(
    args:VAR_POSITIONAL, kwargs:VAR_KEYWORD
):

Initialize self. See help(type(self)) for accurate signature.

gpu = GPU(); gpu
T4 · $0.59/hr · 16GB
L4 · $0.80/hr · 24GB
A10 · $1.10/hr · 24GB
L40S · $1.95/hr · 48GB
A100-40GB · $2.10/hr · 40GB
A100-80GB · $2.50/hr · 80GB
RTX-PRO-6000 · $3.03/hr · 96GB
H100 · $3.95/hr · 80GB
H200 · $4.54/hr · 141GB
B200 · $6.25/hr · 180GB

GPU.cheapest


def cheapest(
    
)->GPUEntry:

Return the cheapest GPUEntry.

gpu.cheapest()
T4 · $0.59/hr · 16GB

GPU.by_budget


def by_budget(
    max_phr:float, # Maximum price per hour
)->HTML:

Return GPU cards costing ≤ max_phr per hour as HTML.

gpu.by_budget(.8)
T4 · $0.59/hr · 16GB
L4 · $0.80/hr · 24GB

GPU.price_of


def price_of(
    tag:str, # GPU tag, e.g. 'H100'
)->GPUEntry:

Return the GPUEntry matching tag.

gpu.price_of('T4')
T4 · $0.59/hr · 16GB

GPU.tags


def tags(
    
)->list:

Lists all available GPU tags

gpu.tags()
['T4',
 'L4',
 'A10',
 'L40S',
 'A100-40GB',
 'A100-80GB',
 'RTX-PRO-6000',
 'H100',
 'H200',
 'B200']

GPU.most_expensive


def most_expensive(
    
)->GPUEntry:

Return the most expensive GPUEntry.

gpu.most_expensive()
B200 · $6.25/hr · 180GB

GPU.by_vram


def by_vram(
    min_gb:int, # Minimum VRAM in GB
)->HTML:

Return GPU cards with ≥ min_gb VRAM as HTML.

gpu.by_vram(24)
L4 · $0.80/hr · 24GB
A10 · $1.10/hr · 24GB
L40S · $1.95/hr · 48GB
A100-40GB · $2.10/hr · 40GB
A100-80GB · $2.50/hr · 80GB
RTX-PRO-6000 · $3.03/hr · 96GB
H100 · $3.95/hr · 80GB
H200 · $4.54/hr · 141GB
B200 · $6.25/hr · 180GB