Blog

Welcome to The Scalable Way Blog — your source for insights, strategies, and best practices in data platform engineering, analytics, and data science.

Blog posts

Breaking Down Prefect Deployments To Improve The Data Ops Efficiency

prefect dataops elt pipelines

Discover how breaking down monolithic ETL flows into modular deployments enhances observability, streamlines troubleshooting, and boosts scalability. Learn to design data pipelines that evolve with your needs while maintaining performance and reliability.

dlt and Prefect, a Great Combo for Streamlined Data Ingestion Pipelines

dlt prefect data ingestion data orchestration data pipelines

Streamline your data ingestion pipelines with dlt and Prefect. This article explores how combining these powerful open-source tools enables scalable, efficient, and production-ready data workflows. Learn best practices, key features, and real-world insights to simplify data engineering.

Deploying Prefect on any Cloud Using a Single Virtual Machine

prefect data platform architecture orchestration productized data platform

A pattern to improve observability, monitoring and, ultimately, data operations with Prefect. We show how to find the right trade off between number of deployments and improved operations.