Prefect is an open-source orchestration engine that turns your Python functions into production-grade data pipelines with minimal friction. You can build and schedule workflows in pure Python—no DSLs or complex config files—and run them anywhere you can run Python. Prefect handles the heavy lifting for you out of the box: automatic state tracking, failure handling, real-time monitoring, and more.

​
Essential features

FeatureDescription
PythonicWrite workflows in native Python—no DSLs, YAML, or special syntax. Full support for type hints, async/await, and modern Python patterns. Use your existing IDE, debugger, and testing tools.
State & RecoveryRobust state management that tracks success, failure, and retry states. Resume interrupted runs from the last successful point, and cache expensive computations to avoid unnecessary rework.
Flexible & Portable ExecutionStart flows locally for easy development, then deploy them anywhere—from a single process to containers, Kubernetes, or cloud services—without locking into a vendor. Infrastructure is defined by code (not just configuration), making it simple to scale or change environments.
Event-DrivenTrigger flows on schedules, external events, or via API. Pause flows for human intervention or approval. Chain flows together based on states, conditions, or any custom logic.
Dynamic RuntimeCreate tasks dynamically at runtime based on actual data or conditions. Easily spawn new tasks and branches during execution for truly data-driven workflows.
Modern UIReal-time flow run monitoring, logging, and state tracking through an intuitive interface. View dependency graphs and DAGs automatically—just run your flow and open the UI.
CI/CD FirstTest and simulate flows like normal Python code, giving you fast feedback during development. Integrate seamlessly into your existing CI/CD pipeline for automated testing and deployment.

​
Quickstart

Quickstart

Quickly create your first deployable workflow tracked by Prefect.

Install Prefect

Install Prefect and get connected to Prefect Cloud or a self-hosted server.

Upgrade to Prefect 3

Upgrade from Prefect 2 to Prefect 3 to get the latest features and performance enhancements.

​
How-to guides

Build workflows

Learn how to write and customize your Prefect workflows with tasks and flows.

Deploy workflows

Deploy and manage your workflows as Prefect deployments.

Configure infrastructure

Deploy your workflows to specific infrastructure platforms.

Set up automations

Work with events, triggers, and automations to build reactive workflows.

Configure Prefect

Configure your Prefect environment, secrets, and variables.

Use Prefect Cloud

Set up and manage your Prefect Cloud account.

​
Advanced

Interactive workflows

Build interactive workflows that can pause and receive input.

Platform engineering

Use Prefect as a platform for your teams’ data pipelines.

Extend Prefect

Extend Prefect with custom blocks and API integrations.

​
Examples

Check out the gallery of examples to see Prefect in action.

​
Mini-history of Prefect

2018-2021: Our story begins in 2018, when we introduced the idea that workflow orchestration should be Pythonic. Inspired by distributed tools like Dask, and building on the experience of our founder, Jeremiah Lowin (a PMC member of Apache Airflow), we created a system based on simple Python decorators for tasks and flows. But what made Prefect truly special was our introduction of task mapping—a feature that would later become foundational to our dynamic execution capabilities (and eventually imitated by other orchestration SDKs). 2022: Prefect’s 2.0 release became inevitable once we recognized that real-world workflows don’t always fit into neat, pre-planned DAG structures: sometimes you need to update a job definition based on runtime information, for example by skipping a branch of your workflow. So we removed a key constraint that workflows be written explicitly as DAGs, fully embracing native Python control flow—if/else conditionals, while loops-everything that makes Python…Python. 2023-present: With our release of Prefect 3.0 in 2024, we fully embraced these dynamic patterns by open-sourcing our events and automations backend, allowing users to natively represent event-driven workflows and gain additional observability into their execution. Prefect 3.0 also unlocked a leap forward in performance, improving the runtime overhead of Prefect by up to 90%.

​
Join our community

Join Prefect’s vibrant community of nearly 30,000 engineers to learn with others and share your knowledge!