Geoscience

Xarray on the Cloud
Delightfully easy

Scale up in about a minute

Mirror your laptop, including packages, code, and credentials

Process TBs of data for fractions of a dollar

import xarray as xr
import coiled
  
cluster = coiled.Cluster(
    n_workers=500,
    region="us-west-2",
    worker_memory="64 GiB",
    spot_policy="spot",
)
client = cluster.get_client()

ds = xr.open_mfdataset(
    "s3://mybucket/all-data.zarr",
    engine="zarr", parallel=True,
)

Coiled sets up Dask clusters to your specification.
The right hardware for the right job, configured automatically.

Churn through S3 files with parallel for loops

Easy: Minimal code changes to run on the cloud.

Fast: Skip downloading and run on VMs close to your data.

Cheap: Process TBs of data for fractions of a dollar.

Learn more

import coiled

# Step 1: Get a list of all our files.
files = ["s3://bucket/data.nc", ..., ...]

# Step 2: Create a function to process each file.
@coiled.function(region="us-west-2")
def process(file):
    result = ...
    return result

# Step 3: Process all of the files.
results = process.map(files)

# Step 4: Analyze results locally.
plot(results)

Execute any Python function in parallel in the cloud with Coiled.

Cloud infrastructure, but easy

Deploy infrastructure like you're a pro, even if you have no experience. Set up Coiled in two lines:

$ pip install coiled

$ coiled setup

Grant cloud access? (Y/n): Y
... Configuring ...

🎉 You're ready to go.

coiled.io/start

10,000 CPU-hours free each month*

More than enough for most applications

$0.05/CPU-hour thereafter

Large computations often cost just pennies

* You'll still have to pay AWS or GCP

Q: How does this work?

Coiled manages EC2 VMs in your cloud account.
Dask runs your Python code on those VMs.
Coiled tracks everything so it's safe and cheap.

Q: How easy is it to set up?

Anyone familiar with a terminal can set up Coiled.
Nothing to maintain. Coiled manages everything

Connect your cloud account

Easy: Setup takes three minutes and anyone can do it.
‍Free: No credit card required. Generous free tier.

$ pip install coiled

$ coiled login

$ coiled setup aws

Grant cloud access? (Y/n): Y
... Configuring ...

🎉 You're ready to go.

coiled.io/start

Join with NASA Openscapes

No AWS account needed. Available for groups working with NASA Earthdata. Learn more about NASA Openscapes.

Science, but big.

Xarray on the Cloud
Delightfully easy

Churn through S3 files with parallel for loops

Cloud infrastructure, but easy

Trusted by both government and industry

Connect your cloud account

Join with NASA Openscapes

Science, but big.

Xarray on the CloudDelightfully easy

Churn through S3 files with parallel for loops

Cloud infrastructure, but easy

Trusted by both government and industry

Connect your cloud account

Join with NASA Openscapes

Xarray on the Cloud
Delightfully easy