data engineer - databricks

EPAM Systems in Abu Dhabi, UAE, is seeking a Senior Data Engineer to join onsite. You will lead production-grade data pipelines on Databricks using PySpark and SQL, migrating transformation logic from a legacy platform, and ensuring data quality across the data will optimize performance through partitioning and Delta Lake, design validation processes,...

We are building a fast-growing Databricks practice delivering enterprise data and AI solutions across APAC. As Lead Solution Architect - Data Engineering, you will be the technical anchor of the practice: leading solution design on client engagements, owning and defending enterprise architectures in presales, and driving large-scale migration and cloud...

We are building a fast-growing Databricks practice delivering enterprise data and AI solutions across APAC. As Lead Solution Architect - Data Engineering, you will be the technical anchor of the practice: leading solution design on client engagements, owning and defending enterprise architectures in presales, and driving large-scale migration and cloud...

Geisinger is seeking a senior data engineer to stream data from Epic SDE, ADT feeds, and clinical sources into Databricks, and curate shared clinical feature tables for AI model training and monitoring.You will own RAG infrastructure, including ingestion, chunking, and embedding pipelines, administer vector databases, and build retrieval pipelines with...

Geisinger is seeking a senior data engineer to stream data from Epic SDE, ADT feeds, and clinical sources into Databricks, and curate shared clinical feature tables for AI model training and monitoring.You will own RAG infrastructure, including ingestion, chunking, and embedding pipelines, administer vector databases, and build retrieval pipelines with...

Title: Senior Data Engineer (Databricks, Lakehouse & AI-BI) Location: ABU DHABI Exp: 6+ Years Job Description: Key Responsibilities 1. Pipeline Orchestration: Design and build robust data ingestion and orchestration pipelines, with Databricks (Lakeflow Jobs/Workflows) as the primary platform and Azure Data Factory supporting legacy/external...

OverviewDevelop Delta Lake metric aggregation structures supporting enterprise quality reporting. Calculate and publish: Data Quality Index (DQI) scores; dimension-level quality metrics; rule pass/fail rates; dataset compliance scores; SLA adherence indicators. Provide curated outputs to support Power BI quality dashboards and executive reporting.Monitoring,...

Overview Develop Delta Lake metric aggregation structures supporting enterprise quality reporting. Calculate and publish: Data Quality Index (DQI) scores; dimension-level quality metrics; rule pass/fail rates; dataset compliance scores; SLA adherence indicators. Provide curated outputs to support Power BI quality dashboards and executive reporting....

EPAM Systems in Abu Dhabi, United Arab Emirates, is seeking a Senior Data Engineer to join an on-site team. You will work on a large-scale data platform migration, building production-ready pipelines using Databricks, PySpark and SQL in a dynamic delivery environment.The ideal candidate has 7+ years of data engineering experience, strong Databricks/Delta...

Unison Group in Dubai is building a fast-growing Databricks practice. We are seeking a Lead Solution Architect - Data Engineering to be the technical anchor of the practice, guiding solution design on client engagements, owning enterprise architectures in presales, and driving large migrations to the cloud.You will mentor engineers, create accelerators, and...

Unison Group in Dubai is building a fast-growing Databricks practice. We are seeking a Lead Solution Architect - Data Engineering to be the technical anchor of the practice, guiding solution design on client engagements, owning enterprise architectures in presales, and driving large migrations to the cloud.You will mentor engineers, create accelerators, and...

OverviewDevelop Delta Lake metric aggregation structures supporting enterprise quality reporting. Calculate and publish: Data Quality Index (DQI) scores; dimension-level quality metrics; rule pass/fail rates; dataset compliance scores; SLA adherence indicators. Provide curated outputs to support Power BI quality dashboards and executive reporting....

EPAM Systems in Abu Dhabi, United Arab Emirates, is seeking a Senior Data Engineer to join an on-site team. You will work on a large-scale data platform migration, building production-ready pipelines using Databricks, PySpark and SQL in a dynamic delivery environment. The ideal candidate has 7+ years of data engineering experience, strong Databricks/Delta...

Acesoft Labs (India) Pvt Ltd in Dubai invites a skilled Data Engineer to design, develop and maintain scalable data pipelines using PySpark, Spark, Python and SQL. You will build ETL/ELT processes on cloud data platforms and Databricks, with exposure to data lakes and lakehouses.The role requires hands-on data engineering experience, strong problem solving,...

Acesoft Labs (India) Pvt Ltd in Dubai invites a skilled Data Engineer to design, develop and maintain scalable data pipelines using PySpark, Spark, Python and SQL. You will build ETL/ELT processes on cloud data platforms and Databricks, with exposure to data lakes and lakehouses.The role requires hands-on data engineering experience, strong problem solving,...

Confidential Jobs in the United Arab Emirates is seeking a senior data platform engineer to design, develop, and optimize data platforms that support our analytics goals. You will implement scalable architectures using Databricks and drive automation across ingestion, storage, and processing.You will lead data engineering pipelines, collaborate with data...

Confidential Jobs in the United Arab Emirates is seeking a senior data platform engineer to design, develop, and optimize data platforms that support our analytics goals. You will implement scalable architectures using Databricks and drive automation across ingestion, storage, and processing.You will lead data engineering pipelines, collaborate with data...

Confidential Jobs in the United Arab Emirates is seeking a senior data platform engineer to design, develop, and optimize data platforms that support our analytics goals. You will implement scalable architectures using Databricks and drive automation across ingestion, storage, and processing.You will lead data engineering pipelines, collaborate with data...

Salt Digital Recruitment is seeking an expert in Data Quality Management based in Dubai, UAE. The role involves developing Delta Lake metrics, setting up automated quality monitoring systems, and performing root cause analysis to enhance data quality.The ideal candidate should have strong Databricks engineering skills, proficiency in PySpark, and experience...

Responsibilities:Design, develop, and maintain scalable data pipelines using Databricks, SQL, and Python. Build and optimize ETL/ELT processes to ingest, transform, and integrate data from multiple source systems. Develop and maintain data models, Lakehouse/Data Warehouse solutions, and semantic layers for analytics. Create, enhance, and support Power BI...