Data Strategie

Embarrassing 90% cost reduction fix

Reddit r/dataengineering

Summary

An uptime monitoring service faced a significant cost increase with BigQuery. By implementing DATE partitioning and clustering by user_id and website_id, along with a 90-day partition expiration, costs were reduced by 90%. This highlights the importance of effectively utilizing available tools and methods.

Read the full article