Piqama: Pinterest Quota Management Ecosystem

Pinterest's Piqama is a generic quota management ecosystem that handles the full lifecycle of resource quotas across Big Data Processing and Online Services.

• •Piqama manages physical resources (memory, CPU), service resources (QPS, network bandwidth), and application-specific quota units via a centralized portal accessible through REST and Thrift
• •The platform provides a pluggable validation framework, ownership-based authorization for quota updates, and flexible dispatching mechanisms including PinConf or custom dispatchers
• •Piqama clients collect enforcement and usage statistics stored in Apache Iceberg on Amazon S3, enabling auto-rightsizing driven by historical data from Presto and Iceberg
• •For Big Data Processing, Piqama integrates with Apache Yunikorn to manage guaranteed resources, maximum resources, and max concurrent applications per project
• •Rate-limiting quota integration is used for Online Storage Systems, demonstrating the platform's flexibility across both capacity-b