lead data engineer

Job Description As Lead Data Engineer, you will help architect, build and run the data platform that supports reporting, analytics, and self-service BI across the GAC Group. A key part of the role is ensuring that our data pipelines are reliable, monitored, tested, and easy to support. We use Databricks, DBT, and Airflow through Astronomer, and need someone...

My client is looking for a Lead Data Engineer to design and build scalable data pipelines that deliver trusted, analytics‑ready datasets for BI, AI, and operational use cases across a hybrid environment.Key ResponsibilitiesBuild pipelines across bronze, silver & gold layers (Databricks, Spark, dbt)Implement data quality checks, contracts & schema...

As Lead Data Engineer, you will help architect, build and run the data platform that supports reporting, analytics, and self‑service BI across the GAC Group. A key part of the role is ensuring that our data pipelines are reliable, monitored, tested, and easy to support. We use Databricks, DBT, and Airflow through Astronomer, and need someone who can help...

ResponsibilitiesDesign and architect scalable, high-performance data solutionsLead and mentor a team of data engineersBuild and optimize large-scale data pipelinesDrive architectural decisions and technical strategyEnsure data quality, governance, and security best practicesCollaborate with cross-functional teams for end-to-end deliveryRequirementsStrong...

Overall 5-7 years of experience in data engineering and transformation on Cloud - 3+ Years of Very Strong Experience in Azure Data Engineering, Databricks - Expertise in supporting/developing Data warehouse workloads at enterprise level - Experience in pyspark is required - developing and deploying the workloads to run on the Spark distributed computing -...

Design and develop streaming ingestion pipelines using Apache Spark (Structured Streaming) and Databricks Auto Loader to consume files from cloud storage or messages from Kafka/RabbitMQ/Confluent Cloud and ingest them into Delta Lake, ensuring schema evolution and exactly once semantics. Implement CDC and deduplication logic by capturing change events from...

Lead Data Engineering – Platform OpsLead Data Engineering – Platform Ops in Dubai, United Arab Emirates is a senior Financial Services technology opportunity for an experienced data engineering leader with strong hands‑on expertise in Databricks, Azure Data Factory, Kafka, Confluent, dbt, DataOps, Unity Catalog, and enterprise data platform operations....

As Lead Data Engineer, you will help architect, build and run the data platform that supports reporting, analytics, and self‐service BI across the GAC Group. A key part of the role is ensuring that our data pipelines are reliable, monitored, tested, and easy to support. We use Databricks, DBT, and Airflow through Astronomer, and need someone who can help...

My client is looking for a Lead Data Engineer to design and build scalable data pipelines that deliver trusted, analytics‐ready datasets for BI, AI, and operational use cases across a hybrid environment. Key Responsibilities Build pipelines across bronze, silver & gold layers (Databricks, Spark, dbt) Implement data quality checks, contracts & schema...

Social Discovery Group (SDG) seeks a data engineering professional to develop Python services for marketing partner integration and data acquisition. You will work remotely with a global team to deliver scalable data tooling.You will manage a small team, optimize SQL queries, and contribute to data warehouse migration from MS SQL to Google Cloud, building...

ResponsibilitiesArchitect and implement robust scalable data pipelines on Azure using Databricks ensuring efficient data ingestion transformation and loadingDesign and manage real-time data streaming solutions with Kafka enabling low-latency data processing and event-driven architecturesLead the development of data models and schemas optimized for...

# Lead Data Engineer, Group 42 (G42)United Arab Emirates, Abu DhabiMay 13, 2026Full TimeApply Now### Job DescriptionThe Lead Data Engineer at Inception builds scalable data pipelines which support both AI and LLM and RAG system activities. The role focuses on building reliable data infrastructure which enables vector search and retrieval systems while...

NucleusTeq in Dubai seeks a Senior Data Platform Engineer to design scalable data solutions, lead a team of data engineers, and drive end-to-end data delivery with cross-functional partners.Requirements include strong Java and SQL, GCP expertise, Airflow, data warehousing, CI/CD, and a solid grasp of distributed systems, data governance, and security. This...

Analytics Insight is seeking a Lead Data Engineer in Abu Dhabi to build scalable data pipelines for AI applications. This role involves collaboration with AI engineers to develop reliable data infrastructure for vector search and RAG systems. Candidates should possess a bachelor's degree in computer science or engineering, with eight years of experience in...

Salt Digital Recruitment is seeking a Lead Data Engineer in Dubai to design and build scalable data pipelines that deliver trusted datasets for BI, AI, and operational use. The ideal candidate will have over 5 years of experience and a solid understanding of Azure data services.Responsibilities include building pipelines, implementing data quality checks,...

Edenred Finland Oy. etsii Data Engineer Leadia, joka johtaa modernin dataplatformin kehittämistä hybridityöskentely-ympäristössä. Tehtävässä menestyminen edellyttää yli 7 vuoden kokemusta data engineeringista ja vahvaa asiantuntemusta Azure- ja Databricks-ympäristöistä.Roolissa työskentelet tiiviisti eri tiimien kanssa ja varmistat, että...

Edenred Italia S.r.l. is seeking a Data Engineer Lead in Dubai, UAE, to architect and scale their next-generation data platform. This role requires a strong background in Azure and Databricks, along with leadership qualities to guide technical teams and innovate data solutions.With over 7 years in data engineering, including experience in building platforms...

ATAIN in Abu Dhabi is looking for a Senior Data Engineer to lead the development of scalable data pipelines while mentoring junior engineers. This role demands hands-on experience with Databricks, Azure Databricks, Delta Lake, and Apache Spark.Key responsibilities include optimizing data workflows, enforcing engineering best practices, and ensuring data...

Responsibilities Design and architect scalable, high-performance data solutions Lead and mentor a team of data engineers Build and optimize large-scale data pipelines Drive architectural decisions and technical strategy Ensure data quality, governance, and security best practices Collaborate with cross-functional teams for end-to-end delivery Requirements...

Virtusa Middle East FZ-LLC is seeking a senior data engineer to architect and implement robust, scalable data pipelines on Azure using Databricks, enabling efficient data ingestion, transformation and loading across large will design and manage real-time streaming solutions with Kafka, lead the development of data models and schemas for optimal performance,...