Our client is seeking an experienced Apache Spark Optimization Expert to join our data engineering team, working in the Finance InfoTech area of a leading reinsurance company.Their Azure based data solution processes billions of records within challenging deadlines. Your primary focus will be on optimizing and tuning Spark workloads to enhance performance, stability, and efficiency. Their platform is based on Azure Databricks, with heavy usage of Delta Lak
Our client is seeking an experienced Apache Spark Optimization Expert to join our data engineering team, working in the Finance InfoTech area of a leading reinsurance company.Their Azure based data solution processes billions of records within challenging deadlines. Your primary focus will be on optimizing and tuning Spark workloads to enhance performance, stability, and efficiency. Their platform is based on Azure Databricks, with heavy usage of Delta Lak