Lead Data Engineer

2 days ago


Abu Dhabi, Abu Dhabi, United Arab Emirates Dicetek LLC Full time
Roles and responsibilities
  • Overall 5-7 years ofexperience in data engineering and transformation onCloud
  • 3+ Years of Very Strong Experience inAzure Data Engineering, Databricks
  • Expertise insupporting/developing lakehouse workloads at enterpriselevel
  • Experience in pyspark is required– developing and deploying the workloads to run on theSpark distributed computing
  • Candidate mustpossess at least a Graduate or bachelor's degree inComputer Science/Information Technology, Engineering(Computer/Telecommunication) orequivalent.
  • Cloud deployment: PreferablyMicrosoft azure
  • Experience in implementing theplatform and application monitoring using Cloud nativetools
  • 1. DataArchitecture &Design

  • Strongunderstanding of database architectures, including relational,NoSQL, and data warehousing.
  • Ability to designand implement data pipelines, data lakes, and datawarehouses.
  • Knowledge of ETL (Extract,Transform, Load) processes.
  • 2.Programming &Scripting

  • Languages:Expertise in Python, Java, Scala, andSQL.
  • Familiarity with datamanipulation libraries like Pandas, Dask, and NumPy(for Python).
  • Ability to write efficientqueries and scripts for data processing andanalysis.
  • 3. Big DataTechnologies

  • Proficiencyin big data frameworks like Hadoop,Spark, andFlink.
  • Experiencewith distributed computing systems and handling largedatasets.
  • 4. CloudPlatforms

  • Knowledge ofcloud platforms such as AWS,Google Cloud Platform (GCP), andMicrosoftAzure.
  • Experience withcloud-based data solutions like AmazonRedshift, GoogleBigQuery, or Azure DataLake.
  • 5.DataModeling

  • Expertise indata modeling techniques, such as dimensionalmodeling, ER modeling,and star/snowflakeschemas.
  • Ability to designschema structures that support business intelligence and analyticalneeds.
  • 6. Data PipelineManagement

  • Experiencein creating and maintaining data pipelines for large-scale dataprocessing.
  • Familiarity with tools likeApache Airflow,Luigi, ordbt for orchestratingworkflows.
  • 7. DataWarehousing & SQLOptimization

  • Expertisein designing and optimizing data warehousingsolutions.
  • Strong skills in SQLtuning, optimization, and performance improvementfor handling large datasets.
  • 8.Data Governance &Security

  • Understandingof data governance practices, such as data privacy, metadatamanagement, and ensuring data quality.
  • Abilityto enforce data security standards andpractices for data protection.
  • 9.Team Leadership & ProjectManagement

  • Ability tolead a team of data engineers, collaborate with cross-functionalteams, and manage data engineeringprojects.
  • Familiarity with project managementframeworks like Agile andScrum.
  • 10.Automation &CI/CD

  • Experience inautomating data workflows and deploymentpipelines.
  • Knowledge ofCI/CD tools (e.g., Jenkins, GitLab)for version control andautomation.
  • 11. MachineLearning Integration(Optional)

  • While notstrictly necessary for all data engineering roles, experienceintegrating data pipelines with machine learning models orsupporting the deployment of models can bevaluable.
Desired candidate profile

1.Data Architecture &Design

  • Strongunderstanding of database architectures, including relational,NoSQL, and data warehousing.
  • Ability to designand implement data pipelines, data lakes, and datawarehouses.
  • Knowledge of ETL (Extract,Transform, Load) processes.

2.Programming &Scripting

  • Languages:Expertise in Python, Java, Scala, andSQL.
  • Familiarity with datamanipulation libraries like Pandas, Dask, and NumPy(for Python).
  • Ability to write efficientqueries and scripts for data processing andanalysis.

3. Big DataTechnologies

  • Proficiencyin big data frameworks like Hadoop,Spark, andFlink.
  • Experiencewith distributed computing systems and handling largedatasets.

4. CloudPlatforms

  • Knowledge ofcloud platforms such as AWS,Google Cloud Platform (GCP), andMicrosoftAzure.
  • Experience withcloud-based data solutions like AmazonRedshift, GoogleBigQuery, or Azure DataLake.

5.DataModeling

  • Expertise indata modeling techniques, such as dimensionalmodeling, ER modeling,and star/snowflakeschemas.
  • Ability to designschema structures that support business intelligence and analyticalneeds.

6. Data PipelineManagement

  • Experiencein creating and maintaining data pipelines for large-scale dataprocessing.
  • Familiarity with tools likeApache Airflow,Luigi, ordbt for orchestratingworkflows.

7. DataWarehousing & SQLOptimization

  • Expertisein designing and optimizing data warehousingsolutions.
  • Strong skills in SQLtuning, optimization, and performance improvementfor handling large datasets.

8.Data Governance &Security

  • Understandingof data governance practices, such as data privacy, metadatamanagement, and ensuring data quality.
  • Abilityto enforce data security standards andpractices for data protection.

9.Team Leadership & ProjectManagement

  • Ability tolead a team of data engineers, collaborate with cross-functionalteams, and manage data engineeringprojects.
  • Familiarity with project managementframeworks like Agile andScrum.

10.Automation &CI/CD

  • Experience inautomating data workflows and deploymentpipelines.
  • Knowledge ofCI/CD tools (e.g., Jenkins, GitLab)for version control andautomation.

11. MachineLearning Integration(Optional)

  • While notstrictly necessary for all data engineering roles, experienceintegrating data pipelines with machine learning models orsupporting the deployment of models can bevaluable.
Key Skills
Engineering,EngineeringMathematics,Data Reporting
Employment Type: Part-time
Department / FunctionalArea: Data Engineering
Experience: years
Gender: Male
Vacancy: 1
  • Lead Data Engineer

    2 weeks ago


    Abu Dhabi, Abu Dhabi, United Arab Emirates Dicetek LLC Full time

    Roles and ResponsibilitiesOverall 5-7 years of experience in data engineering and transformation on Cloud3+ Years of Very Strong Experience in Azure Data Engineering, DatabricksExpertise in supporting/developing lakehouse workloads at enterprise levelExperience in pyspark is required – developing and deploying the workloads to run on the Spark distributed...

  • Lead Data Engineer

    6 days ago


    Abu Dhabi, Abu Dhabi, United Arab Emirates Dicetek LLC Full time

    Roles and responsibilities Overall 5-7 years of experience in data engineering and transformation on Cloud 3+ Years of Very Strong Experience in Azure Data Engineering, Databricks Expertise in supporting/developing lakehouse workloads at enterprise level Experience in pyspark is required – developing and deploying the workloads to run on the Spark...

  • Lead Data Engineer

    3 weeks ago


    Abu Dhabi, Abu Dhabi, United Arab Emirates Dicetek LLC Full time

    Roles and responsibilitiesOverall 5-7 years ofexperience in data engineering and transformation onCloud3+ Years of Very Strong Experience inAzure Data Engineering, DatabricksExpertise insupporting/developing lakehouse workloads at enterpriselevelExperience in pyspark is required– developing and deploying the workloads to run on theSpark distributed...


  • Abu Dhabi, Abu Dhabi, United Arab Emirates Gulf Data International Full time

    How to apply: Data & Integration SpecialistGDI takes pride in creating opportunities for personal growth and achievement. To apply for a job opening, please email your latest CV in MS Word or PDF format to careers@gdi.ae, with the job title applied for in the subject line.Job DescriptionWe are actively seeking a Data & Integration Specialist with expertise...


  • Abu Dhabi, Abu Dhabi, United Arab Emirates Elevon Core Full time

    Elevon Core is looking for a talented Data Transformation Lead to lead our data and AI transformation efforts. This is an exciting opportunity for an experienced professional to join our team and contribute to shaping the future of our business.As Data Transformation Lead, you will be responsible for developing and implementing data and AI strategies that...

  • Lead Data Scientist

    2 weeks ago


    Abu Dhabi, Abu Dhabi, United Arab Emirates 10Pearls Full time

    Lead Data Scientist Company Overview 10Pearls is an end-to-end digital technology services partner helping businesses utilize technology as a competitive advantage. We help our customers digitalize their existing business, build innovative new products, and augment their existing teams with high-performance team members. Our broad expertise in product...


  • Abu Dhabi, Abu Dhabi, United Arab Emirates Sense7ai Data Solution Pvt Ltd Full time

    This is a remoteposition.ProjectPartners has a passion for delivering projects. Not justsuccessfully, but on-time and to budget We started thisjourney on a mission to empower people to deliver projectssuccessfully. Being project professionals ourselves we know whatworks.Our insider knowledge means we know exactly whatgreat project delivery needs. We went on...

  • Data Engineer

    2 days ago


    Abu Dhabi, Abu Dhabi, United Arab Emirates Presight Full time

    Overview Role: Data Engineer Location: Abu Dhabi About Presight Presight is an ADX-listed public company with Abu Dhabi based G42 as its majority shareholder and is the region's leading big data analytics company powered by GenAI. It combines big data, analytics, and AI expertise to serve every sector, of every scale, to create business and positive...

  • Data Engagement Lead

    2 weeks ago


    Abu Dhabi, Abu Dhabi, United Arab Emirates Contango Full time

    Position Overview:We are seeking an exceptionalData Engagement Lead (Associate Director)to lead high-impact data consulting engagements for clients across diverse industries. This role combines strategic leadership, client engagement, and technical expertise to deliver innovative, data-driven solutions that create measurable value. You will oversee...


  • Abu Dhabi, Abu Dhabi, United Arab Emirates Deeplight AI Full time

    About DeepLight:DeepLight is a pioneering AI company that pushes the boundaries of innovation in artificial intelligence. Our mission is to harness the power of data and machine learning to revolutionize industries and create a brighter future.We are seeking an experienced project manager with a proven track record in leading Data and AI initiatives to join...


  • Abu Dhabi, Abu Dhabi, United Arab Emirates Amazon Data Services Emirates LLC DWC-Branch [Dubai South FZ Branch] Full time

    About the JobWe are seeking a highly motivated Data Center Operations Manager to join our team. As a key member of our operations team, you will be responsible for ensuring the smooth operation of our data centers, including maintenance, repairs, and upgrades.Key ResponsibilitiesOversee the day-to-day operations of our data centers.Ensure compliance with all...

  • Data Engineer

    3 weeks ago


    Abu Dhabi, Abu Dhabi, United Arab Emirates Talent Pal Full time

    How you can make yourmarkAre you currently searching for adata engineering job that offers the opportunity to work onglobally impactful operations all while being part of a dynamic andenthusiastic teamImagine automating the realtimesensor data from our fleet and supporting on NOx reduction forsustainability reporting. In this role you will have the chance...

  • Senior Data Engineer

    2 weeks ago


    Abu Dhabi, Abu Dhabi, United Arab Emirates Deeplight AI Full time

    About DeepLight: DeepLight is a pioneering AI company committed to pushing the boundaries of innovation in artificial intelligence. Our mission is to harness the power of data and machine learning to revolutionize industries and create a brighter future. With a dynamic team of experts and a culture of relentless innovation, we are at the forefront of AI...


  • Abu Dhabi, Abu Dhabi, United Arab Emirates LTIMindtree Full time

    Data Center Operations and ManagementWe are seeking an experienced Data Center Operations Specialist to join our team at LTIMindtree.The ideal candidate will have a strong background in computer science, engineering, or information technology with a minimum of 8-10 years of relevant experience.Key ResponsibilitiesMonitor and escalate data center...


  • Abu Dhabi, Abu Dhabi, United Arab Emirates Alpha Data LLC. Full time

    Job DescriptionWe are seeking an experienced Audiovisual Systems Engineer to join our team at Alpha Data LLC. As a key member of our technical staff, you will be responsible for the design, installation, and commissioning of complex audiovisual systems.Your primary focus will be on ensuring that all systems meet the required specifications and are properly...

  • Data Delivery Lead

    3 weeks ago


    Abu Dhabi, Abu Dhabi, United Arab Emirates Mark Williams Recruitment Full time

    Key Responsibilities:Act as the primary point ofcontact for clients in the UAE, understanding their datarequirements and ensuring the successful delivery of tailoredsolutions.Build and nurture strong client relationships,anticipating their needs, and providing expert guidance on datadelivery strategies.Lead and mentor a high-performing data deliveryteam...

  • Data Engineer

    6 days ago


    Abu Dhabi, Abu Dhabi, United Arab Emirates ParamInfo Full time

    Roles and responsibilities Data Engineer Location : Dubai We are looking for Experience upto: 5-8 Years Summary: Experienced Informatica PC and IDMC Developer with 5+ years in data engineering. Skilled in designing end-to-end data pipelines using PC/IDMC for effective migration and transformation across cloud platforms. The ideal candidate will have...


  • Abu Dhabi, Abu Dhabi, United Arab Emirates CAREEM Full time

    Roles and responsibilitiesWe are seeking a highly skilled andmotivated Data Warehouse Engineer to join our team. As a DataWarehouse Engineer, you will play a critical role in designing,developing, and maintaining our data infrastructure, ensuring theavailability, scalability, and reliability of our data systems. Youwill collaborate closely with...


  • Abu Dhabi, Abu Dhabi, United Arab Emirates CAREEM Full time

    Roles and responsibilitiesWe are seeking a highly skilled andmotivated Data Warehouse Engineer to join our team. As a DataWarehouse Engineer, you will play a critical role in designing,developing, and maintaining our data infrastructure, ensuring theavailability, scalability, and reliability of our data systems. Youwill collaborate closely with...


  • Abu Dhabi, Abu Dhabi, United Arab Emirates Global Projects Services Full time

    **Engineering Shift Lead Job Description**We are seeking an experienced Engineering Shift Lead to join our Engineering team at Global Projects Services.The successful candidate will be responsible for supervising shift activities, implementing maintenance activities on a daily, weekly, and monthly basis, and maintaining/updating accurate documentation.Key...