Looking for the latest Prefect 2 release? Prefect 2 and Prefect Cloud 2 have been released for General Availability. See https://docs.prefect.io/ for details.

# Orchestration

When you want to run and monitor many flows, maintaining their state and inspecting their progress can be difficult without some extra tooling.

Prefect Cloud and the Prefect Server are two ready-to-use state database and UI backends that automatically extend the Prefect Core engine with a rich GraphQL API to make orchestration of your flows easy.

Prefect Core's server is an open source, lightweight version of our highly-available, production-ready product Prefect Cloud.

Most users get the greatest benefit from signing up for the free Prefect Cloud Starter tier.

If your team needs support for additional users, automations, multi-tenant permissions, SSO, and other features, scale up to a bigger Prefect Cloud license.

Prefect Core also includes an open source, locally hosted server.

All of your Prefect flows will work seamlessly on any of these backends, so you won't need to change any of your flow code to change between them.

# Prefect Cloud

Prefect Cloud is a fully hosted, production-ready backend for Prefect Core that provides enhanced features for flow orchestration and visibility, including:

  • A hosted web UI for running and monitoring flows and jobs
  • Automatic and asynchronous scheduling and alerting
  • Permissions and authorization management
  • Performance enhancements that allow you to scale
  • Agent monitoring
  • Secure runtime secrets and parameters
  • Team management
  • SLAs
  • A full GraphQL API
  • Many more features...

In the Prefect documentation, the Cloud badge indicates features supported only in Prefect Cloud.

To start monitoring and managing your flows in Prefect Cloud, log in or sign up today.

# Prefect Server

Prefect Core ships with an open-source backend and UI that automatically extends the Prefect Core engine with a subset of the features provided by Prefect Cloud, including:

  • A local web UI for running and monitoring flows and jobs
  • A full GraphQL API
  • Automatic and asynchronous scheduling and alerting

We recommend Prefect Server for local testing and environments with restricted access to cloud services.

To use Prefect Server as the backend, run the following command to configure Prefect for local orchestration:

$ prefect backend server

Please note the server requires Docker and Docker Compose to be running.

To start the server, UI, and all required infrastructure, run:

$ prefect server start

When server is running, navigate to http://localhost:8080.

# Architecture Overview

Prefect's unique hybrid execution model keeps your code and data completely private while taking full advantage of our managed orchestration service.

When you register a Flow, your code is securely stored on your infrastructure — your code never leaves your execution environment and is never sent to Prefect Cloud. Instead, Flow metadata is sent to Prefect Cloud for scheduling and orchestration.

Prefect Agents run inside a user's architecture, and are responsible for starting and monitoring flow runs. Agents send requests to the Prefect Cloud API to update flow run metadata.

Prefect Cloud's live updating UI allows you to monitor flow execution in real time and leverage Prefect Cloud's extensive integration functionality.

We know one of these solutions will minimize your negative engineering burden and get you back to the code you really want to write.

Happy engineering!

- The Prefect Team