Data Engineering Articles

4 articles

Related Tags

Product(2)

Announcements(2)

Customers(2)

Databricks

61 min read

Data Engineering•2026-03-19

Announcing General Availability of Real-Time Mode for Apache Spark Structured Streaming on Databricks

Databricks announces General Availability of Real-Time Mode (RTM) for Apache Spark Structured Streaming, enabling millisecond-level latency without leaving the Spark ecosystem.

Data Engineering•2026-03-16

Breaking the Microbatch Barrier: The Architecture of Apache Spark Real-Time Mode

Apache Spark 4.1 introduces Real-Time Mode (RTM) for Structured Streaming, enabling millisecond-level latency without abandoning the microbatch architecture.

Data Engineering

Databricks

41 min read

Data Engineering•2026-03-02

Real-Time Mode: Ultra-low latency streaming on Spark APIs without a second engine

Apache Spark introduces Real-Time Mode (RTM) for Structured Streaming, enabling sub-second latency without requiring a second engine like Apache Flink.

Data Engineering•2026-02-23

Announcing General Availability of Zerobus Ingest

This post announces the general availability of Zerobus Ingest, a real-time data ingestion product targeting organizations at scale.