Product Articles

Databricks

21 min read

Data Engineering•2026-03-12

The Evolution of Data Engineering: How Serverless Compute is Transforming Notebooks, Lakeflow Jobs, and Spark Declarative Pipelines

This article covers how Databricks serverless compute is transforming data engineering by removing infrastructure management burdens across Notebooks, Lakeflow Jobs, and Spark Declarative Pipelines.

Platform

Product

Product Articles

Related Tags

How Addepar Scales Investment Workflows with Databricks AI Agents

Protect Performance and Reduce Surprise Costs with Default Warehouse

Zero-Downtime Patching in Lakebase Part 1: Prewarming

Powering product discovery in ChatGPT

How to move from Apache Airflow® to Databricks Lakeflow Jobs

How Delta Sharing Supports ABAC Sharing for Providers and Recipients

Ship quality enterprise AI agents to business users with Agent Bricks and Databricks Apps

Develop and deploy Serverless JARs

Why Codex Security Doesn’t Include a SAST Report

The Evolution of Data Engineering: How Serverless Compute is Transforming Notebooks, Lakeflow Jobs, and Spark Declarative Pipelines

Introducing Genie Code

Beyond Provisioning: The Developer’s Guide to Databricks Lakebase Autoscaling

New ways to learn math and science in ChatGPT

New in Migrations: Faster and More Predictable

Unified data discovery with business context in Unity Catalog

Tutorial: How to ship AI/BI Dashboard changes safely at scale with Databricks Asset Bundles

Real-Time Mode: Ultra-low latency streaming on Spark APIs without a second engine

An AI-First Approach to Data Engineering with Lakeflow and Agent Bricks

Announcing General Availability of Zerobus Ingest

Use Genie Everywhere with Enterprise OAuth