Lead Data Engineer

6 days ago


Abu Dhabi, Abu Dhabi, United Arab Emirates Dicetek LLC Full time
Roles and responsibilities
  • Overall 5-7 years ofexperience in data engineering and transformation onCloud
  • 3+ Years of Very Strong Experience inAzure Data Engineering, Databricks
  • Expertise insupporting/developing lakehouse workloads at enterpriselevel
  • Experience in pyspark is required– developing and deploying the workloads to run on theSpark distributed computing
  • Candidate mustpossess at least a Graduate or bachelor's degree inComputer Science/Information Technology, Engineering(Computer/Telecommunication) orequivalent.
  • Cloud deployment: PreferablyMicrosoft azure
  • Experience in implementing theplatform and application monitoring using Cloud nativetools
  • 1. DataArchitecture &Design

  • Strongunderstanding of database architectures, including relational,NoSQL, and data warehousing.
  • Ability to designand implement data pipelines, data lakes, and datawarehouses.
  • Knowledge of ETL (Extract,Transform, Load) processes.
  • 2.Programming &Scripting

  • Languages: Expertise in Python, Java, Scala, andSQL.
  • Familiarity with datamanipulation libraries like Pandas, Dask, and NumPy(for Python).
  • Ability to write efficientqueries and scripts for data processing andanalysis.
  • 3. Big DataTechnologies

  • Proficiencyin big data frameworks like Hadoop ,Spark , andFlink .
  • Experiencewith distributed computing systems and handling largedatasets.
  • 4. CloudPlatforms

  • Knowledge ofcloud platforms such as AWS ,Google Cloud Platform (GCP) , andMicrosoftAzure .
  • Experience withcloud-based data solutions like AmazonRedshift , GoogleBigQuery , or Azure DataLake .
  • 5.DataModeling

  • Expertise indata modeling techniques, such as dimensionalmodeling , ER modeling ,and star/snowflakeschemas .
  • Ability to designschema structures that support business intelligence and analyticalneeds.
  • 6. Data PipelineManagement

  • Experiencein creating and maintaining data pipelines for large-scale dataprocessing.
  • Familiarity with tools likeApache Airflow ,Luigi , ordbt for orchestratingworkflows.
  • 7. DataWarehousing & SQLOptimization

  • Expertisein designing and optimizing data warehousingsolutions.
  • Strong skills in SQLtuning , optimization, and performance improvementfor handling large datasets.
  • 8.Data Governance &Security

  • Understandingof data governance practices, such as data privacy, metadatamanagement, and ensuring data quality.
  • Abilityto enforce data security standards andpractices for data protection.
  • 9.Team Leadership & ProjectManagement

  • Ability tolead a team of data engineers, collaborate with cross-functionalteams, and manage data engineeringprojects.
  • Familiarity with project managementframeworks like Agile andScrum .
  • 10.Automation &CI/CD

  • Experience inautomating data workflows and deploymentpipelines.
  • Knowledge ofCI/CD tools (e.g., Jenkins, GitLab)for version control andautomation.
  • 11. MachineLearning Integration(Optional)

  • While notstrictly necessary for all data engineering roles, experienceintegrating data pipelines with machine learning models orsupporting the deployment of models can bevaluable.
Desired candidate profile

1.Data Architecture &Design

  • Strongunderstanding of database architectures, including relational,NoSQL, and data warehousing.
  • Ability to designand implement data pipelines, data lakes, and datawarehouses.
  • Knowledge of ETL (Extract,Transform, Load) processes.

2.Programming &Scripting

  • Languages: Expertise in Python, Java, Scala, andSQL.
  • Familiarity with datamanipulation libraries like Pandas, Dask, and NumPy(for Python).
  • Ability to write efficientqueries and scripts for data processing andanalysis.

3. Big DataTechnologies

  • Proficiencyin big data frameworks like Hadoop ,Spark , andFlink .
  • Experiencewith distributed computing systems and handling largedatasets.

4. CloudPlatforms

  • Knowledge ofcloud platforms such as AWS ,Google Cloud Platform (GCP) , andMicrosoftAzure .
  • Experience withcloud-based data solutions like AmazonRedshift , GoogleBigQuery , or Azure DataLake .

5.DataModeling

  • Expertise indata modeling techniques, such as dimensionalmodeling , ER modeling ,and star/snowflakeschemas .
  • Ability to designschema structures that support business intelligence and analyticalneeds.

6. Data PipelineManagement

  • Experiencein creating and maintaining data pipelines for large-scale dataprocessing.
  • Familiarity with tools likeApache Airflow ,Luigi , ordbt for orchestratingworkflows.

7. DataWarehousing & SQLOptimization

  • Expertisein designing and optimizing data warehousingsolutions.
  • Strong skills in SQLtuning , optimization, and performance improvementfor handling large datasets.

8.Data Governance &Security

  • Understandingof data governance practices, such as data privacy, metadatamanagement, and ensuring data quality.
  • Abilityto enforce data security standards andpractices for data protection.

9.Team Leadership & ProjectManagement

  • Ability tolead a team of data engineers, collaborate with cross-functionalteams, and manage data engineeringprojects.
  • Familiarity with project managementframeworks like Agile andScrum .

10.Automation &CI/CD

  • Experience inautomating data workflows and deploymentpipelines.
  • Knowledge ofCI/CD tools (e.g., Jenkins, GitLab)for version control andautomation.

11. MachineLearning Integration(Optional)

  • While notstrictly necessary for all data engineering roles, experienceintegrating data pipelines with machine learning models orsupporting the deployment of models can bevaluable.
Key Skills
Engineering,EngineeringMathematics,Data Reporting
Employment Type: Part-time
Department / FunctionalArea: Data Engineering
Experience: years
Gender: Male
Vacancy: 1

  • Abu Dhabi, Abu Dhabi, United Arab Emirates Alpha Data Full time

    Job OverviewWe are seeking a skilled Data Protection Engineer to join our team at Alpha Data. In this role, you will be responsible for administering and managing Veeam Backup as a service platform, including vCloud Connect, Kasten, and VBR.Key ResponsibilitiesDevelop customized plans to maximize value from Veeam products and services.Identify pain points...

  • Lead Data Engineer

    4 weeks ago


    Abu Dhabi, Abu Dhabi, United Arab Emirates Dicetek LLC Full time

    Roles and ResponsibilitiesOverall 5-7 years of experience in data engineering and transformation on Cloud3+ Years of Very Strong Experience in Azure Data Engineering, DatabricksExpertise in supporting/developing lakehouse workloads at enterprise levelExperience in pyspark is required – developing and deploying the workloads to run on the Spark distributed...


  • Abu Dhabi, Abu Dhabi, United Arab Emirates Big Data Technology Solutions Full time

    Job RequirementsWe are seeking a highly skilled Data-Centric Solutions Engineer to join our team at Big Data Technology Solutions. As an expert in data-centric solutions, you will be responsible for designing and implementing scalable solutions that meet the needs of our clients.Main Responsibilities:Design and deploy HPC systems using Dell PowerEdge...

  • Lead Data Engineer

    5 days ago


    Abu Dhabi, Abu Dhabi, United Arab Emirates Dicetek LLC Full time

    Roles and responsibilities Overall 5-7 years of experience in data engineering and transformation on Cloud3+ Years of Very Strong Experience in Azure Data Engineering, DatabricksExpertise in supporting/developing lakehouse workloads at enterprise levelExperience in pyspark is required – developing and deploying the workloads to run on the Spark...

  • Data Engineer Lead

    2 days ago


    Abu Dhabi, Abu Dhabi, United Arab Emirates Synvert Full time

    OverviewSynvert is seeking a highly skilled Data Engineer Lead to join our team. As a key member of our organization, you will play a crucial role in designing and implementing data platforms on Microsoft Fabric.Key ResponsibilitiesPresenting proof of concepts and demonstrating products to clients.Coordinating with client teams to ensure successful...


  • Abu Dhabi, Abu Dhabi, United Arab Emirates G42 Full time

    About the RoleThis is an exciting opportunity for a motivated and experienced Data Engineer to join our team at G42. As a Senior Data Engineer, you will play a key role in developing and maintaining our data infrastructure, ensuring that it is reliable, scalable, and secure.You will be responsible for designing and implementing data pipelines, ensuring data...


  • Abu Dhabi, Abu Dhabi, United Arab Emirates G42 Full time

    G42 is the UAE's national-scale enabler in AI Research and Development. Partnering with Microsoft's AI SaaS, we offer domain-specific Agentic AI Orchestrator platforms utilizing reasoning agents for precise and cost-effective services.Our Technology StackHadoopSparkFlinkWe are looking for a Senior Data Engineer to develop and maintain data systems that...

  • Lead Data Engineer

    4 weeks ago


    Abu Dhabi, Abu Dhabi, United Arab Emirates Dicetek LLC Full time

    Roles and responsibilitiesOverall 5-7 years ofexperience in data engineering and transformation onCloud3+ Years of Very Strong Experience inAzure Data Engineering, DatabricksExpertise insupporting/developing lakehouse workloads at enterpriselevelExperience in pyspark is required– developing and deploying the workloads to run on theSpark distributed...


  • Abu Dhabi, Abu Dhabi, United Arab Emirates Caliberly Full time

    Calmberly is seeking a talented Healthcare Data Engineering Lead to spearhead the development of our healthcare data infrastructure on Azure Cloud and Databricks.The ideal candidate will have expertise in designing data architectures optimized for healthcare workloads and a strong understanding of ELT processes, data modeling, and data pipeline...


  • Abu Dhabi, Abu Dhabi, United Arab Emirates Gulf Data International Full time

    How to apply: Data & Integration SpecialistGDI takes pride in creating opportunities for personal growth and achievement. To apply for a job opening, please email your latest CV in MS Word or PDF format to careers@gdi.ae, with the job title applied for in the subject line.Job DescriptionWe are actively seeking a Data & Integration Specialist with expertise...


  • Abu Dhabi, Abu Dhabi, United Arab Emirates Gulf Data International Full time

    About the PositionGulf Data International is looking for a talented Data & Integration Specialist to join our team. As a key member of our team, you will be responsible for creating and implementing data models that support business operations.In this role, you will work closely with business stakeholders, data analysts, and IT teams to understand data...


  • Abu Dhabi, Abu Dhabi, United Arab Emirates Alpha Data Full time

    Job OverviewAlpha Data is seeking a seasoned Veeam Backup Engineer to lead our efforts in delivering high-quality IT services to clients. As a key member of our team, you will be responsible for the administration and management of Veeam Backup as a service platform (vCloud Connect), Kasten, and VBR.Responsibilities and DeliverablesPlatform Administration:...


  • Abu Dhabi, Abu Dhabi, United Arab Emirates The Chemical Engineer Full time

    JOB DESCRIPTION Remarkable people, trusted by clients to design and advance the world. The Role This is an exciting opportunity for an experienced PMC Senior Process Safety Engineer with a proven track record in implementation and management of process safety systems, mitigating risks and ensuring compliance with safety standards in oil and gas projects...


  • Abu Dhabi, Abu Dhabi, United Arab Emirates Gulf Data International Full time

    How to apply: Data & Integration Specialist GDI takes pride in creating opportunities for personal growth and achievement. To apply for a job opening, please email your latest CV in MS Word or PDF format to , with the job title applied for in the subject line. Job Description We are actively seeking a Data & Integration Specialist with expertise in...


  • Abu Dhabi, Abu Dhabi, United Arab Emirates Alpha Data Full time

    Job SummaryWe are looking for a Veeam expert consultant to join our team at Alpha Data. As a Veeam expert consultant, you will be responsible for administrating and managing Veeam Backup as a service platform (vCloud Connect), Kasten, and VBR.Your primary objective will be to develop a customized plan to maximize value from Veeam products and services,...


  • Abu Dhabi, Abu Dhabi, United Arab Emirates The Chemical Engineer Full time

    Salary:£75,000 - £115,000 (max) + housing allowanceLocation:UAECompany:The company is a leading player in the International high hazard Insurance sector, involved in cover associated with various sectors including oil and gas, refining, petrochemicals, LNG, metals, mining, and maritime. The organisation's Gulf hub is enjoying significant client support and...

  • Help Desk Engineer

    3 days ago


    Abu Dhabi, Abu Dhabi, United Arab Emirates Alpha Data Full time

    Job SummaryWe are seeking a highly experienced Help Desk Engineer to join our team at Alpha Data.In this role, you will be responsible for providing technical support to our clients, troubleshooting complex issues, and collaborating with senior engineers to resolve escalated problems.The ideal candidate will have a strong background in IT, excellent...


  • Abu Dhabi, Abu Dhabi, United Arab Emirates Alpha Data Full time

    About the PositionWe are looking for an experienced Veeam Backup Engineer to join our team at Alpha Data. As a key member of our IT services delivery team, you will be responsible for the administration and management of Veeam Backup as a service platform (vCloud Connect), Kasten, and VBR.Main ResponsibilitiesService Platform Administration: Ensure the...

  • Lead Data Scientist

    3 weeks ago


    Abu Dhabi, Abu Dhabi, United Arab Emirates 10Pearls Full time

    Lead Data Scientist Company Overview 10Pearls is an end-to-end digital technology services partner helping businesses utilize technology as a competitive advantage. We help our customers digitalize their existing business, build innovative new products, and augment their existing teams with high-performance team members. Our broad expertise in product...


  • Abu Dhabi, Abu Dhabi, United Arab Emirates Surge Group Full time

    Job DescriptionSurge Group is seeking an experienced Artificial Intelligence Engineer to lead our data science and engineering efforts.Responsibilities will include developing and implementing AI solutions, working with cross-functional teams, and collaborating with stakeholders to drive business outcomes.Key SkillsLeadership and management skillsExpertise...