Current jobs related to Lead Data Engineer - Abu Dhabi, Abu Dhabi - Inception

  • Azure Data Engineer

    6 days ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates Mind Stream Full time

    We are seeking a highly skilled Azure Data Engineer with extensive experience in building, optimizing, and managing scalable data solutions on Microsoft Azure. The ideal candidate will have hands-on expertise in Azure Databricks, Data Factory, Data Lake Storage, and Event Hub, along with strong programming and data engineering skills.Required Skills and...

  • Data Engineer

    5 days ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates GlobalXperts Technology Full time

    Job Title: Data EngineerLocation: UAE (Onsite)Experience : 5+ yearsNotice Period : Immediate Joiners preferredRole SummaryResponsible for building scalable data pipelines, ensuring data quality and governance, and delivering reliable Power BI analytics solutions to support business decision-making.Key ResponsibilitiesDesign, build, and maintain ETL/ELT...

  • Azure Data Engineer

    5 days ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates NLB SERVICE PVT LTD Full time

    Design and implement scalable data pipelines using Azure Data Factory, ensuring efficient data ingestion, transformation, and loading processes.Develop and maintain data lake solutions leveraging Azure Data Lake Storage (ADLS) Gen2, optimizing for performance, cost, and security.Build and manage data warehouses using Azure Synapse Analytics, including schema...

  • Senior Data Engineer

    4 days ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates GlobalXperts Technology Full time

    Job Title: Senior Data EngineerLocation: UAE (Onsite)Experience : 4+ yearsNotice Period : Immediate Joiners preferredRole SummaryResponsible for building scalable data pipelines, ensuring data quality and governance, and delivering reliable Power BI analytics solutions to support business decision-making.Key ResponsibilitiesDesign, build, and maintain...

  • Data Processor

    4 days ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates NMDC Dredging & Marine Full time

    Key ResponsibilitiesCollect, organize, and process field and laboratory data related to ground improvement works.Verify data accuracy and consistency, flag anomalies, and coordinate with field engineers for clarifications.Input, maintain, and update databases, spreadsheets, and project documentation.Assist in preparing technical reports, charts, and...

  • Lead Propulsion Engineer

    6 days ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates TALENTMATE Full time

    Job DescriptionSynopsisThe Lead Propulsion Engineer reports to the Manager, Engine Management is responsible for providing engineering support to the operation and maintenance of the Etihad engine fleet and ensuring compliance with all mandatory requirements from the OEM, Airworthiness Authorities and Etihad Aircraft Maintenance Program to meet the GCAA CAR...

  • Senior Data Scientist

    4 days ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates AMS International UAE Full time

    Length of Contract: 12 MonthsUpto AED 28,000 per month + VISA + Medical InsuranceResponsibilities:Integrate pre-trained AI/ML models into applicationsBuild APIs and services around AI capabilities (e.g., OpenAI, Hugging Face, AWS AI)Fine-tune existing models for specific business needsPreprocess and manage input/output data pipelinesMonitor AI model...

  • Head of Engineering

    6 days ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates Tarjama& Full time

    Job PurposeThe Head of Engineering provides strategic and operational leadership across all engineering disciplines—including software engineering, AI/ML, data infrastructure, architecture, and DevOps—to build secure, scalable, and high-performing government-grade AI systems.Key ResponsibilitiesLeadership & Strategy·       Define and execute the...

  • Data & Power BI Developer

    4 days ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates GlobalXperts Technology Full time

    Job Title: Data & Power BI DeveloperLocation: UAE (Onsite)Experience : 7+ yearsNotice Period : Immediate Joiners preferredRole SummaryResponsible for building scalable data pipelines, ensuring data quality and governance, and delivering reliable Power BI analytics solutions to support business decision-making.Key ResponsibilitiesDesign, build, and maintain...

  • Lead Engineer

    6 days ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates Group 42 Full time

    Integrate security practices into the DevOps lifecycle, ensuring that security is a core component of the development, deployment, and operational processes.Design, implement, and maintain CI/CD pipelines that incorporate automated security testing and compliance checks.Collaborate with development, operations, and security teams to identify and address...

Lead Data Engineer

1 hour ago

Abu Dhabi, Abu Dhabi, United Arab Emirates Inception Full time

We are seeking a highly skilled Lead Data Engineer to architect and build scalable, cloud-native data and AI pipelines that power enterprise LLM, RAG, and retrieval systems.

Key Responsibilities


• Design, build, and optimize scalable data pipelines for AI/LLM workloads, including vectorization and embedding processing.


• Develop and maintain ETL/ELT workflows for structured, unstructured, and streaming data.


• Create and manage vector database indexing and similarity search pipelines using tools like FAISS, Pinecone, Weaviate, Qdrant, Chroma.


• Build retrieval systems for RAG, semantic search, and enterprise knowledge retrieval.


• Develop robust, reusable data orchestration pipelines using Airflow, Spark, or similar tools.


• Architect and manage data pipelines across Azure (primary), AWS, and GCP environments.


• Integrate and optimize storage and processing across SQL, NoSQL, and vector databases.


• Contribute to the design and implementation of event-driven architectures.


• Collaborate with AI teams to enable embedding generation, LLM integration, and model-serving pipelines.


• Ensure end-to-end data quality, monitoring, reliability, and observability.


• Lead or participate in system design for large-scale, distributed data and AI systems.

Required Skills

Programming & Data


• Strong expertise in Python for data processing, APIs, automation, or distributed workloads.


• Strong proficiency in SQL and knowledge of NoSQL databases (MongoDB, DynamoDB, Cosmos DB, etc.).


• Experience with vector databases, such as: FAISS, Pinecone, Weaviate, Qdrant, Chroma.


• Strong knowledge of data modeling, pipeline development, and ETL/ELT frameworks.

AI/LLM Infrastructure


• Solid understanding of vectorization, embeddings, and similarity search techniques.


• Familiarity with LLMs, embedding models, and RAG pipeline concepts.


• Experience integrating embedding-generation pipelines via Hugging Face, OpenAI, or other model providers.

Cloud & Distributed Systems


• Proficiency with Azure (primary), and familiarity with AWS and GCP.


• Experience with Docker and containerized development.


• Understanding of Kubernetes is a strong plus.

Orchestration & Big Data


• Expertise in Apache Airflow for scheduling and orchestration.


• Experience with Apache Spark or equivalent distributed processing frameworks.

Architecture & Engineering Fundamentals


• Strong system design fundamentals for scalable and distributed systems.


• Knowledge of event-driven architecture and modern data platforms.


• Strong understanding of DevOps, CI/CD, version control, and observability best practices.

Qualifications

  • 8+ years of progressive experience in data engineering, distributed systems, or AI/ML data infrastructure
  • Experience building RAG pipelines in production.
  • Knowledge of graph databases or hybrid search systems.
  • Understanding of model deployment, inference optimization, and caching techniques for LLM workloads.
  • Familiarity with data governance, IAM, and security patterns across cloud ecosystems