Senior Data Engineer/ Databricks, PySpark, Python

EPAM Systems LLC is seeking a Senior Data Engineer with expertise in Databricks, PySpark, and Python to work on a project that involves the collection, processing, and analysis of vehicle telemetry data for a prominent European automotive manufacturer. The role entails managing a large-scale platform that processes tens of terabytes of data in Azure Databricks, overseeing around 200 Databricks jobs. The current focus is on maintaining and evolving the solution, which is already deployed in multiple regions, including Europe, North America, and China, with plans for further expansion in China. A critical aspect of this position is ensuring the system's scalability while maintaining predictable infrastructure and operational costs. The role is full-time and is based in Georgia. This opportunity is ideal for candidates with substantial experience in data engineering and a strong background in the specified technologies.