The data space has grown rapidly in last few years. To put this progress in context Mahdi has divided it into three waves. First being of ETL, OLAP, and relational data warehouses. The second being the era of scalability and now we have entered the third wave - the Modern Data Stack wave. Join us in this interesting conversation where Mahdi talks about various aspects of Modern data stack like ETL, CDC, data obvervability and much more.
Mahdi is a senior data engineer at Zendesk who enjoys working with data and building scalable data platforms. Zendesk is a leading customer service software that was founded in Copenhagen, Denmark in 2007. At Zendesk, Mahdi is responsible for building data products and enhancing the existing data stack to help internal teams access product data at scale. He loves to contribute to open source, and recently Mahdi also authored a live project series on 'Building end-to-end batch data pipelines with Spark' with Manning Publications.