Receive daily AI-curated summaries of engineering articles from top tech companies worldwide.
Endigest AI Core Summary
MakeMyTrip, India's largest online travel agency, achieved millisecond-level personalization latency using Databricks' Real-Time Mode (RTM) in Apache Spark Structured Streaming.
•P50 latency dropped from ~1.23 seconds to 44ms and P99 from over 1 minute to ~500ms, yielding a 7% CTR uplift
•The team rejected a dual-engine Spark + Flink approach to avoid architectural fragmentation and duplicated business logic, waiting instead for Spark RTM
•RTM eliminates micro-batch latency through three innovations: continuous data flow, concurrent pipeline scheduling, and streaming shuffle
•MakeMyTrip co-developed Stream Union (merging B2C/B2B Kafka streams), Task Multiplexing via MaxPartitions (reducing core costs), and production hardening features with Databricks engineering
•
Enabling RTM requires only a single-line trigger change (RealTimeTrigger) with no rewrite of existing business logic
This summary was automatically generated by AI based on the original article and may not be fully accurate.
Databricks
Google Cloud
Netflix