Senior Data Engineer

1 week ago

Abu Dhabi, Abu Dhabi, United Arab Emirates Elevon Core Full time

OurTeam

Our team comprises highlyskilled professionals who bring a wealth of internationalexperience in technology entrepreneurship. We thrive on ambitionand recognize that fun and performance go hand inhand. Together we create a dynamic environment whereexcellence is the currency of success.

Position Overview

As a Data Engineeryou will play a crucial role in designing building and maintainingour data infrastructure. You will be responsible for ensuring theavailability integrity and efficiency of our data pipelinesenabling our organization to make informed datadriven decisions.The value you bring will be instrumental in delivering measurablevalue to Contango and beyond using data andAI.

Responsibilities

  • Leadershipand ownership: own overall data lake and data warehousearchitecture with the responsibilities to design architect andmaintain the data warehouse infrastructure to support datamanagement data governance analytics ML & AI needs andaddress future challenges.
  • Datapipeline development: Design build and maintain scalabledata pipelines for ingesting processing and transforming data fromvarious sources ensuring data quality scalability andreliability.
  • Data modelling:Develop and maintain data models architecture patternsschemas and structures that support the needs of data analysts datascientists and other stakeholders.
  • ETL(Extract Transform Load): Create and optimize ETLprocesses to extract data from diverse sources transform it intousable formats and load it into data warehouses or other storagesolutions.
  • Data governance quality andvalidation: Establish and enforce data governancepolicies standards procedures and best practices and implement dataquality checks validation processes and error handling to ensurethe accuracy and consistency ofdata.
  • Performance tuning:Continuously monitor and optimize the performance of data pipelinesto meet business requirements and scalabilityneeds.
  • Data security:Implement and maintain data security measures to protectsensitive information and ensure compliance with data privacyregulations.
  • Collaboration:Work closely with data analysts data scientists and otherstakeholders to understand their data requirements and providesupport in data access andavailability.
  • Documentation:Maintain thorough documentation of data engineeringprocesses data models and datadictionaries.
  • Stay informed:Keep up to date with emerging trends and technologies indata engineering to ensure our data infrastructure remainscuttingedge.

Qualifications

  • Bachelorsdegree in computer science information technology or a relatedfield (masters degree is a plus)
  • Demonstrableexperience of minimum 8 years with at least 5 years in a leadershipposition as a Senior Data Engineer or similar with a portfolio ofprojects 10 years of experience in data engineering with a focus ondesigning and implementing data lakes data warehouses datamodelling ETL processes and data transformationpipelines
  • Experience in cloudbased dataplatforms (e.g. Spark Azure Synapse Analyticsetc.)
  • Proficiency in programming languages suchas Python Java or Scala
  • Strong knowledge ofdatabase systems (SQL and NoSQL) data warehousing and big datatechnologies
  • Knowledge of data governanceprinciples data quality management and regulatorycompliance
  • Experience with orchestrationservices (i.e. Azure Data Factory (ADF) Azure Logic Apps AzureFunctions Databricks Jobs Airflowetc.)
  • Familiarity with data engineeringintegration tools and frameworks and ETLprocesses
  • Experience with cloud platforms likeAWS GCP or Azure
  • Experience with APIdevelopment and integration with dataservices
  • Excellent communications leadershipand collaboration skills
  • Ability to work in afastpaced dynamic environment and lead multiple projects and teamsto deliver highqualityresults
  • Technical Expertise:
    • Programminglanguages: Python Java Scala andR.
    • Data management &databases: Oracle SAP SQL NoSQL DataWarehousing
    • Big datatechnologies: Apache Hadoop Spark Kafkaetc.
    • Cloud platforms:Experience with Microsoft Fabric Azure (Synapse AnalyticsDatabricks Machine Learning AI Search Functions etc.) Databricks onAzure AWS (S3 Redshift SageMaker etc.) Google Cloud Platform(BigQuery Dataflow etc.).
    • Datagovernance: Experience with Ab Initio InformaticaCollibra Purview IBM InfoSphere Great Expectations DeepchecksDatabricks Unity Catalog Databricks Delta Sharing DatabricksCatalog Explorer Databricks Audit Logging and Databricks IdentifyManagement.
    • Datavisualization: Familiarity with Matplotlib SeabornTableau Power BI
    • DevOps &MLOps: CI/CD principles Docker MLFlowKubernetes

Benefits

  • Competitivesalary and benefits package.
  • Opportunity towork on cuttingedge technologyprojects.
  • Collaborative and innovative workenvironment.
  • Professional growth and trainingopportunities.

If you possess therequisite experience qualifications and leadership acumen to driveour success and shape the future of Data and AI innovation withinthe UAE we invite you to submit yourapplication.


This job has beensourced from an external job board.
More jobs on
Key Skills
ApacheHive,S3,Hadoop,Redshift,Spark,AWS,Apache Pig,NoSQL,Big Data,DataWarehouse,Kafka,Scala
Employment Type: Full Time
Experience: years
Vacancy: 1

  • Data Protection Engineer

    3 days ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates Alpha Data Full time

    Job OverviewWe are seeking a skilled Data Protection Engineer to join our team at Alpha Data. In this role, you will be responsible for administering and managing Veeam Backup as a service platform, including vCloud Connect, Kasten, and VBR.Key ResponsibilitiesDevelop customized plans to maximize value from Veeam products and services.Identify pain points...

  • Senior Technical Safety Engineer

    7 days ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates The Chemical Engineer Full time

    About the RoleWe are looking for a talented PMC Senior Process Safety Engineer to join our team. As a key member of our EPC company, you will be responsible for ensuring the implementation of process safety systems that meet or exceed regulatory requirements.The role involves executing assigned scopes of work, providing technical advice and solutions to...

  • Senior Big Data Engineer

    8 hours ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates G42 Full time

    About the RoleWe are looking for a skilled Senior Data Engineer to develop and maintain data systems that support our company's strategic goals. Your role will encompass a range of activities focused on data pipeline development, data quality, and cross-functional collaboration.As a Senior Data Engineer, you will be responsible for building and maintaining...

  • Data Protection Specialist

    1 day ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates Alpha Data Full time

    About the PositionWe are looking for an experienced Veeam Backup Engineer to join our team at Alpha Data. As a key member of our IT services delivery team, you will be responsible for the administration and management of Veeam Backup as a service platform (vCloud Connect), Kasten, and VBR.Main ResponsibilitiesService Platform Administration: Ensure the...

  • Senior Data Engineer

    3 weeks ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates Deeplight AI Full time

    About DeepLight: DeepLight is a pioneering AI company committed to pushing the boundaries of innovation in artificial intelligence. Our mission is to harness the power of data and machine learning to revolutionize industries and create a brighter future. With a dynamic team of experts and a culture of relentless innovation, we are at the forefront of AI...

  • PMC Senior Process Safety Engineer

    6 days ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates The Chemical Engineer Full time

    JOB DESCRIPTION Remarkable people, trusted by clients to design and advance the world. The Role This is an exciting opportunity for an experienced PMC Senior Process Safety Engineer with a proven track record in implementation and management of process safety systems, mitigating risks and ensuring compliance with safety standards in oil and gas...

  • Senior Engineer, Piping

    3 weeks ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates Tampa Gardens Senior Living Full time

    Provide Engineering support and technical expertise to operating plants & pipeline, projects related to Pipeline discipline through all phases of project.. Acts as subject matter expert for Pipeline (Offshore & Onshore), participating in project implementation, peer reviews for other business units/areas, modifications, upgrading, capacity improvement...

  • Senior Data Engineer

    27 minutes ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates G42 Full time

    OverviewAs a Senior Data Engineer at Inception, you will be responsible for building and maintaining the infrastructure that supports data collection, processing, and storage. Reporting to the Lead Data Engineer or Principal Data Engineering, you will work closely with data scientists, analysts, and other stakeholders to ensure that data systems are...

  • Senior Data Engineer

    10 hours ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates G42 Full time

    OverviewAs a Senior Data Engineer at Inception, you will be responsible for building and maintaining the infrastructure that supports data collection, processing, and storage. Reporting to the Lead Data Engineer or Principal Data Engineering, you will work closely with data scientists, analysts, and other stakeholders to ensure that data systems are...

  • Senior HSE Engineer

    3 weeks ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates Tampa Gardens Senior Living Full time

    A bachelor's degree in relevant engineering (i.e Mechanical, Electrical, Civil, Environmental, Chemical, IT, Computer, Software, Electronic, etc.) or equivalent from an accredited university with a minimum of fifteen (15+) years of relevant experience(with design experience) in the Oil & Gas or Petrochemical industry, including minimum (5) years in in GCC...

  • Senior HSE Engineer

    1 week ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates Tampa Gardens Senior Living Full time

    A bachelor's degree in relevant engineering (i.e Mechanical, Electrical, Civil, Environmental, Chemical, IT, Computer, Software, Electronic, etc.) or equivalent from an accredited university with a minimum of fifteen (15+) years of relevant experience(with design experience) in the Oil & Gas or Petrochemical industry, including minimum (5) years in in GCC...

  • Senior Data Systems Engineer

    5 days ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates G42 Group Full time

    G42 Group is seeking a Senior Data Systems Engineer to join our team.About the roleYou will be responsible for designing and implementing large-scale data systems, ensuring high performance, scalability and reliability. You will also collaborate with data scientists, ML engineers and stakeholders to ensure data accessibility, consistency and reliability.Key...

  • Process Safety Engineering Specialist

    7 days ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates The Chemical Engineer Full time

    Job DescriptionWe are seeking a highly experienced PMMC Senior Process Safety Engineer to join our team at Wood, a global leader in consulting and engineering. This is an exciting opportunity for a professional with a proven track record in implementing and managing process safety systems.The successful candidate will be responsible for executing assigned...

  • Senior Data Engineer

    3 days ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates Presight Full time

    Overview Job Description: Senior Data Engineer (12 months contract) Location: Abu Dhabi About Presight Presight is an ADX-listed public company with Abu Dhabi based G42 as its majority shareholder and is the region's leading big data analytics company powered by GenAI. It combines big data, analytics, and AI expertise to serve every sector, of...

  • Senior Data Engineer

    29 minutes ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates Presight Full time

    OverviewJob Description: Senior Data Engineer (12 months contract)Location: Abu DhabiAbout PresightPresight is an ADX-listed public company with Abu Dhabi based G42 as its majority shareholder and is the region's leading big data analytics company powered by GenAI. It combines big data, analytics, and AI expertise to serve every sector, of every scale, to...

  • Data-Centric Solutions Engineer

    1 day ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates Big Data Technology Solutions Full time

    Job RequirementsWe are seeking a highly skilled Data-Centric Solutions Engineer to join our team at Big Data Technology Solutions. As an expert in data-centric solutions, you will be responsible for designing and implementing scalable solutions that meet the needs of our clients.Main Responsibilities:Design and deploy HPC systems using Dell PowerEdge...

  • Senior Data Center Engineer

    6 days ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates Datatime Full time

    In this critical role, you will be responsible for leading the technical design and engineering aspects of data center projects at Datatime. This includes ensuring that data center designs meet the required functionality, scalability, and efficiency standards.ResponsibilitiesCollaborate with clients, contractors, and vendors to define operational...

  • Senior Data Engineer

    4 weeks ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates Elevon Core Full time

    OurTeamOur team comprises highlyskilled professionals who bring a wealth of internationalexperience in technology entrepreneurship. We thrive on ambitionand recognize that fun and performance go hand inhand. Together we create a dynamic environment whereexcellence is the currency of success.Position OverviewAs a Data Engineeryou will play a crucial role in...

  • Senior Data Architect

    2 days ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates G42 Group Full time

    Job DescriptionThe Senior Data Architect will lead the design and implementation of our data engineering and AI workflows, ensuring scalability, security, and compliance. Key responsibilities include developing data flow, ontology, schemas, storage strategies, and component-level design for structured, unstructured, and ML output data.Required Skills and...

  • Data & Integration Specialist

    2 weeks ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates Gulf Data International Full time

    How to apply: Data & Integration SpecialistGDI takes pride in creating opportunities for personal growth and achievement. To apply for a job opening, please email your latest CV in MS Word or PDF format to careers@gdi.ae, with the job title applied for in the subject line.Job DescriptionWe are actively seeking a Data & Integration Specialist with expertise...