Senior Data Engineer

2 weeks ago

Abu Dhabi, Abu Dhabi, United Arab Emirates Elevon Core Full time

OurTeam

Our team comprises highlyskilled professionals who bring a wealth of internationalexperience in technology entrepreneurship. We thrive on ambitionand recognize that fun and performance go hand inhand. Together we create a dynamic environment whereexcellence is the currency of success.

Position Overview

As a Data Engineeryou will play a crucial role in designing building and maintainingour data infrastructure. You will be responsible for ensuring theavailability integrity and efficiency of our data pipelinesenabling our organization to make informed datadriven decisions.The value you bring will be instrumental in delivering measurablevalue to Contango and beyond using data andAI.

Responsibilities

  • Leadershipand ownership: own overall data lake and data warehousearchitecture with the responsibilities to design architect andmaintain the data warehouse infrastructure to support datamanagement data governance analytics ML & AI needs andaddress future challenges.
  • Datapipeline development: Design build and maintain scalabledata pipelines for ingesting processing and transforming data fromvarious sources ensuring data quality scalability andreliability.
  • Data modelling:Develop and maintain data models architecture patternsschemas and structures that support the needs of data analysts datascientists and other stakeholders.
  • ETL(Extract Transform Load): Create and optimize ETLprocesses to extract data from diverse sources transform it intousable formats and load it into data warehouses or other storagesolutions.
  • Data governance quality andvalidation: Establish and enforce data governancepolicies standards procedures and best practices and implement dataquality checks validation processes and error handling to ensurethe accuracy and consistency ofdata.
  • Performance tuning:Continuously monitor and optimize the performance of data pipelinesto meet business requirements and scalabilityneeds.
  • Data security:Implement and maintain data security measures to protectsensitive information and ensure compliance with data privacyregulations.
  • Collaboration:Work closely with data analysts data scientists and otherstakeholders to understand their data requirements and providesupport in data access andavailability.
  • Documentation:Maintain thorough documentation of data engineeringprocesses data models and datadictionaries.
  • Stay informed:Keep up to date with emerging trends and technologies indata engineering to ensure our data infrastructure remainscuttingedge.

Qualifications

  • Bachelorsdegree in computer science information technology or a relatedfield (masters degree is a plus)
  • Demonstrableexperience of minimum 8 years with at least 5 years in a leadershipposition as a Senior Data Engineer or similar with a portfolio ofprojects 10 years of experience in data engineering with a focus ondesigning and implementing data lakes data warehouses datamodelling ETL processes and data transformationpipelines
  • Experience in cloudbased dataplatforms (e.g. Spark Azure Synapse Analyticsetc.)
  • Proficiency in programming languages suchas Python Java or Scala
  • Strong knowledge ofdatabase systems (SQL and NoSQL) data warehousing and big datatechnologies
  • Knowledge of data governanceprinciples data quality management and regulatorycompliance
  • Experience with orchestrationservices (i.e. Azure Data Factory (ADF) Azure Logic Apps AzureFunctions Databricks Jobs Airflowetc.)
  • Familiarity with data engineeringintegration tools and frameworks and ETLprocesses
  • Experience with cloud platforms likeAWS GCP or Azure
  • Experience with APIdevelopment and integration with dataservices
  • Excellent communications leadershipand collaboration skills
  • Ability to work in afastpaced dynamic environment and lead multiple projects and teamsto deliver highqualityresults
  • Technical Expertise:
    • Programminglanguages: Python Java Scala andR.
    • Data management &databases: Oracle SAP SQL NoSQL DataWarehousing
    • Big datatechnologies: Apache Hadoop Spark Kafkaetc.
    • Cloud platforms:Experience with Microsoft Fabric Azure (Synapse AnalyticsDatabricks Machine Learning AI Search Functions etc.) Databricks onAzure AWS (S3 Redshift SageMaker etc.) Google Cloud Platform(BigQuery Dataflow etc.).
    • Datagovernance: Experience with Ab Initio InformaticaCollibra Purview IBM InfoSphere Great Expectations DeepchecksDatabricks Unity Catalog Databricks Delta Sharing DatabricksCatalog Explorer Databricks Audit Logging and Databricks IdentifyManagement.
    • Datavisualization: Familiarity with Matplotlib SeabornTableau Power BI
    • DevOps &MLOps: CI/CD principles Docker MLFlowKubernetes

Benefits

  • Competitivesalary and benefits package.
  • Opportunity towork on cuttingedge technologyprojects.
  • Collaborative and innovative workenvironment.
  • Professional growth and trainingopportunities.

If you possess therequisite experience qualifications and leadership acumen to driveour success and shape the future of Data and AI innovation withinthe UAE we invite you to submit yourapplication.


This job has beensourced from an external job board.
More jobs on
Key Skills
ApacheHive,S3,Hadoop,Redshift,Spark,AWS,Apache Pig,NoSQL,Big Data,DataWarehouse,Kafka,Scala
Employment Type: Full Time
Experience: years
Vacancy: 1

  • Data Protection Engineer

    6 days ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates Alpha Data Full time

    Job OverviewWe are seeking a skilled Data Protection Engineer to join our team at Alpha Data. In this role, you will be responsible for administering and managing Veeam Backup as a service platform, including vCloud Connect, Kasten, and VBR.Key ResponsibilitiesDevelop customized plans to maximize value from Veeam products and services.Identify pain points...

  • Senior Engineer, Piping

    3 weeks ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates Tampa Gardens Senior Living Full time

    Provide Engineering support and technical expertise to operating plants & pipeline, projects related to Pipeline discipline through all phases of project.. Acts as subject matter expert for Pipeline (Offshore & Onshore), participating in project implementation, peer reviews for other business units/areas, modifications, upgrading, capacity improvement...

  • Help Desk Engineer

    3 days ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates Alpha Data Full time

    Job SummaryWe are seeking a highly experienced Help Desk Engineer to join our team at Alpha Data.In this role, you will be responsible for providing technical support to our clients, troubleshooting complex issues, and collaborating with senior engineers to resolve escalated problems.The ideal candidate will have a strong background in IT, excellent...

  • Senior Big Data Engineer

    4 days ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates G42 Full time

    About the RoleWe are looking for a skilled Senior Data Engineer to develop and maintain data systems that support our company's strategic goals. Your role will encompass a range of activities focused on data pipeline development, data quality, and cross-functional collaboration.As a Senior Data Engineer, you will be responsible for building and maintaining...

  • Data Protection Specialist

    4 days ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates Alpha Data Full time

    About the PositionWe are looking for an experienced Veeam Backup Engineer to join our team at Alpha Data. As a key member of our IT services delivery team, you will be responsible for the administration and management of Veeam Backup as a service platform (vCloud Connect), Kasten, and VBR.Main ResponsibilitiesService Platform Administration: Ensure the...

  • Senior Data Engineer

    3 weeks ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates Deeplight AI Full time

    About DeepLight: DeepLight is a pioneering AI company committed to pushing the boundaries of innovation in artificial intelligence. Our mission is to harness the power of data and machine learning to revolutionize industries and create a brighter future. With a dynamic team of experts and a culture of relentless innovation, we are at the forefront of AI...

  • Senior Data Engineer

    3 days ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates G42 Full time

    OverviewAs a Senior Data Engineer at Inception, you will be responsible for building and maintaining the infrastructure that supports data collection, processing, and storage. Reporting to the Lead Data Engineer or Principal Data Engineering, you will work closely with data scientists, analysts, and other stakeholders to ensure that data systems are...

  • Senior Data Engineer

    4 days ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates G42 Full time

    OverviewAs a Senior Data Engineer at Inception, you will be responsible for building and maintaining the infrastructure that supports data collection, processing, and storage. Reporting to the Lead Data Engineer or Principal Data Engineering, you will work closely with data scientists, analysts, and other stakeholders to ensure that data systems are...

  • PMC Senior Process Safety Engineer

    4 hours ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates The Chemical Engineer Full time

    JOB DESCRIPTION Remarkable people, trusted by clients to design and advance the world. The Role This is an exciting opportunity for an experienced PMC Senior Process Safety Engineer with a proven track record in implementation and management of process safety systems, mitigating risks and ensuring compliance with safety standards in oil and gas projects...

  • Senior HSE Engineer

    3 weeks ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates Tampa Gardens Senior Living Full time

    A bachelor's degree in relevant engineering (i.e Mechanical, Electrical, Civil, Environmental, Chemical, IT, Computer, Software, Electronic, etc.) or equivalent from an accredited university with a minimum of fifteen (15+) years of relevant experience(with design experience) in the Oil & Gas or Petrochemical industry, including minimum (5) years in in GCC...

  • Senior HSE Engineer

    2 weeks ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates Tampa Gardens Senior Living Full time

    A bachelor's degree in relevant engineering (i.e Mechanical, Electrical, Civil, Environmental, Chemical, IT, Computer, Software, Electronic, etc.) or equivalent from an accredited university with a minimum of fifteen (15+) years of relevant experience(with design experience) in the Oil & Gas or Petrochemical industry, including minimum (5) years in in GCC...

  • Senior Data Engineer

    6 hours ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates AI71 Full time

    Get AI-powered advice on this job and more exclusive features.AI71, a pioneering AI company launched by Abu Dhabi's Advanced Technology Research Council (ATRC) and VentureOne, stands as a pivotal movement in the realm of AI innovation. Leveraging the globally top-ranked Falcon AI models from the Technology Innovation Institute, AI71's focus spans across...

  • Senior Data Engineer

    4 hours ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates AI71 Full time

    Get AI-powered advice on this job and more exclusive features. AI71, a pioneering AI company launched by Abu Dhabi's Advanced Technology Research Council (ATRC) and VentureOne, stands as a pivotal movement in the realm of AI innovation. Leveraging the globally top-ranked Falcon AI models from the Technology Innovation Institute, AI71's focus spans across...

  • Senior Data Engineer

    11 hours ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates AI71 Full time

    Job DescriptionRole: Senior Data EngineerLocation: Abu Dhabi, UAECompany: AI71About Us:AI71, a pioneering AI company launched by Abu Dhabi&aposs Advanced Technology Research Council (ATRC) and VentureOne, stands as a pivotal movement in the realm of AI innovation. Leveraging the globally top-ranked Falcon AI models from the Technology Innovation Institute,...

  • Senior Data Engineer

    6 days ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates Presight Full time

    Overview Job Description: Senior Data Engineer (12 months contract) Location: Abu Dhabi About Presight Presight is an ADX-listed public company with Abu Dhabi based G42 as its majority shareholder and is the region's leading big data analytics company powered by GenAI. It combines big data, analytics, and AI expertise to serve every sector, of...

  • Senior Data Engineer

    3 days ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates Presight Full time

    OverviewJob Description: Senior Data Engineer (12 months contract)Location: Abu DhabiAbout PresightPresight is an ADX-listed public company with Abu Dhabi based G42 as its majority shareholder and is the region's leading big data analytics company powered by GenAI. It combines big data, analytics, and AI expertise to serve every sector, of every scale, to...

  • Data-Centric Solutions Engineer

    5 days ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates Big Data Technology Solutions Full time

    Job RequirementsWe are seeking a highly skilled Data-Centric Solutions Engineer to join our team at Big Data Technology Solutions. As an expert in data-centric solutions, you will be responsible for designing and implementing scalable solutions that meet the needs of our clients.Main Responsibilities:Design and deploy HPC systems using Dell PowerEdge...

  • Senior Data Systems Engineer

    3 days ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates Presight Full time

    Job DescriptionAs a Senior Data Engineer at Presight, you'll play a critical role in shaping our data strategy and driving business growth through data-driven insights. You'll work closely with our expert teams to design, develop, and implement cutting-edge data solutions that meet our clients' needs.Key ResponsibilitiesDesigning and developing data...

  • Senior IT Services Specialist

    1 day ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates Alpha Data Full time

    Job DescriptionWe are looking for a Senior IT Services Specialist to join our team at Alpha Data. As a Senior IT Services Specialist, you will be responsible for providing expert-level support for Veeam Backup as a service platform (vCloud Connect), Kasten, and VBR.Your primary objective will be to identify and address pain points and gaps in the Veeam setup...

  • Senior Data Engineer

    4 weeks ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates Elevon Core Full time

    OurTeamOur team comprises highlyskilled professionals who bring a wealth of internationalexperience in technology entrepreneurship. We thrive on ambitionand recognize that fun and performance go hand inhand. Together we create a dynamic environment whereexcellence is the currency of success.Position OverviewAs a Data Engineeryou will play a crucial role in...