Skip to content

Burla-Cloud/user-docs

Repository files navigation

layout
width title description tableOfContents outline pagination metadata tags actions
default
visible
visible
visible
true
visible
visible
visible
visible
true
visible
true

Home

Scale Python to 1,000 VMs in your cloud in 1 second.

Burla is the fastest, simplest, and most efficient distributed compute framework for Python.
Scale ML pipelines, vector embeddings, AI Inference, and more with a dev cycle that feels local.

Burla only has one function:

from burla import remote_parallel_map

my_inputs = list(range(1000))

def my_function(x):
    print(f"[#{x}] running on separate computer")

remote_parallel_map(my_function, my_inputs)

This example runs my_function on 1,000 VMs in less than one second:

Scalable & efficient pipelines are not straightforward.

Slow deployments, VM reboots, or container rebuilds mean waiting 5-10 minutes with every change.
Errors are vague, and configs are full of secret tradeoffs. 90% resource utilization is a pipe dream.

Burla can scale any workload using a single function.

Easily fan Python in/out across thousands of machines with varying sizes, types, and environments.
Quickly develop pipelines that handle 100+ TB datasets, using simple code anyone can understand.

This code:

remote_parallel_map(process, [...], image="rocker/geospatial:latest")
remote_parallel_map(aggregate, [...], func_cpu=64)
remote_parallel_map(predict, [...], func_gpu="A100")

Creates a pipeline like:

Your same workload requires 20-50% less compute.

Compared to software like Ray, Dask, Airflow, or AWS Batch workloads running on Burla require less total compute, and automatically achieve close to 90% resource utilization for the duration of the job.

This is achieved with adaptive concurrency and horizontal autoscaling. By automatically packing more tasks onto VM's experiencing low utilization, Burla get's more work done using less compute.

This system frequently more than doubles efficiency, and eliminates out of memory errors.
Read our blog to learn how it works.

How it works: Remote development, local feel.

Running code in the cloud shouldn't feel any different from running code locally.

return_values = remote_parallel_map(my_function, my_inputs)

When a Python function is run using remote_parallel_map, it runs in the cloud but:

  • Anything it prints appears locally (and inside the dashboard).
  • Any exceptions are thrown locally.
  • Any packages or local modules are (very quickly) cloned on all remote machines.
  • Code starts running in under one second! Even with millions of inputs, or thousands of VMs.

Burla automatically manages it's own pool of VMs underneath to maximize speed and efficiency.
You can manually add & remove machines from the pool, or let the platform react live to requests.

Everything you need to manage Python at scale.

Monitor your analysis, pipeline, or background job from your phone.
Burla has all the features you need to closely manage logs, output files, and available compute.

Pricing:

Zero markup on compute.
Burla is free for any personal, academic, or research use.

How we partner:

We only get paid if agreed-upon improvements in runtime and efficiency are actually achieved.
Have peace of mind with on-call support from engineers experienced in ML at scale.

To learn how Burla can boost velocity, efficiency, and developer happiness.


Questions?
Email jake@burla.dev, we're always happy to talk.

About

No description, website, or topics provided.

Resources

Security policy

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors