Senior Data Engineer

3 weeks ago

Abu Dhabi, Abu Dhabi, United Arab Emirates Elevon Core Full time

OurTeam

Our team comprises highlyskilled professionals who bring a wealth of internationalexperience in technology entrepreneurship. We thrive on ambitionand recognize that fun and performance go hand inhand. Together we create a dynamic environment whereexcellence is the currency of success.

Position Overview

As a Data Engineeryou will play a crucial role in designing building and maintainingour data infrastructure. You will be responsible for ensuring theavailability integrity and efficiency of our data pipelinesenabling our organization to make informed datadriven decisions.The value you bring will be instrumental in delivering measurablevalue to Contango and beyond using data andAI.

Responsibilities

  • Leadershipand ownership: own overall data lake and data warehousearchitecture with the responsibilities to design architect andmaintain the data warehouse infrastructure to support datamanagement data governance analytics ML & AI needs andaddress future challenges.
  • Datapipeline development: Design build and maintain scalabledata pipelines for ingesting processing and transforming data fromvarious sources ensuring data quality scalability andreliability.
  • Data modelling:Develop and maintain data models architecture patternsschemas and structures that support the needs of data analysts datascientists and other stakeholders.
  • ETL(Extract Transform Load): Create and optimize ETLprocesses to extract data from diverse sources transform it intousable formats and load it into data warehouses or other storagesolutions.
  • Data governance quality andvalidation: Establish and enforce data governancepolicies standards procedures and best practices and implement dataquality checks validation processes and error handling to ensurethe accuracy and consistency ofdata.
  • Performance tuning:Continuously monitor and optimize the performance of data pipelinesto meet business requirements and scalabilityneeds.
  • Data security:Implement and maintain data security measures to protectsensitive information and ensure compliance with data privacyregulations.
  • Collaboration:Work closely with data analysts data scientists and otherstakeholders to understand their data requirements and providesupport in data access andavailability.
  • Documentation:Maintain thorough documentation of data engineeringprocesses data models and datadictionaries.
  • Stay informed:Keep up to date with emerging trends and technologies indata engineering to ensure our data infrastructure remainscuttingedge.

Qualifications

  • Bachelorsdegree in computer science information technology or a relatedfield (masters degree is a plus)
  • Demonstrableexperience of minimum 8 years with at least 5 years in a leadershipposition as a Senior Data Engineer or similar with a portfolio ofprojects 10 years of experience in data engineering with a focus ondesigning and implementing data lakes data warehouses datamodelling ETL processes and data transformationpipelines
  • Experience in cloudbased dataplatforms (e.g. Spark Azure Synapse Analyticsetc.)
  • Proficiency in programming languages suchas Python Java or Scala
  • Strong knowledge ofdatabase systems (SQL and NoSQL) data warehousing and big datatechnologies
  • Knowledge of data governanceprinciples data quality management and regulatorycompliance
  • Experience with orchestrationservices (i.e. Azure Data Factory (ADF) Azure Logic Apps AzureFunctions Databricks Jobs Airflowetc.)
  • Familiarity with data engineeringintegration tools and frameworks and ETLprocesses
  • Experience with cloud platforms likeAWS GCP or Azure
  • Experience with APIdevelopment and integration with dataservices
  • Excellent communications leadershipand collaboration skills
  • Ability to work in afastpaced dynamic environment and lead multiple projects and teamsto deliver highqualityresults
  • Technical Expertise:
    • Programminglanguages: Python Java Scala andR.
    • Data management &databases: Oracle SAP SQL NoSQL DataWarehousing
    • Big datatechnologies: Apache Hadoop Spark Kafkaetc.
    • Cloud platforms:Experience with Microsoft Fabric Azure (Synapse AnalyticsDatabricks Machine Learning AI Search Functions etc.) Databricks onAzure AWS (S3 Redshift SageMaker etc.) Google Cloud Platform(BigQuery Dataflow etc.).
    • Datagovernance: Experience with Ab Initio InformaticaCollibra Purview IBM InfoSphere Great Expectations DeepchecksDatabricks Unity Catalog Databricks Delta Sharing DatabricksCatalog Explorer Databricks Audit Logging and Databricks IdentifyManagement.
    • Datavisualization: Familiarity with Matplotlib SeabornTableau Power BI
    • DevOps &MLOps: CI/CD principles Docker MLFlowKubernetes

Benefits

  • Competitivesalary and benefits package.
  • Opportunity towork on cuttingedge technologyprojects.
  • Collaborative and innovative workenvironment.
  • Professional growth and trainingopportunities.

If you possess therequisite experience qualifications and leadership acumen to driveour success and shape the future of Data and AI innovation withinthe UAE we invite you to submit yourapplication.


This job has beensourced from an external job board.
More jobs on
Key Skills
ApacheHive,S3,Hadoop,Redshift,Spark,AWS,Apache Pig,NoSQL,Big Data,DataWarehouse,Kafka,Scala
Employment Type: Full Time
Vacancy: 1

  • Senior Engineer, Piping

    2 weeks ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates Tampa Gardens Senior Living Full time

    Provide Engineering support and technical expertise to operating plants & pipeline, projects related to Pipeline discipline through all phases of project.. Acts as subject matter expert for Pipeline (Offshore & Onshore), participating in project implementation, peer reviews for other business units/areas, modifications, upgrading, capacity improvement...

  • Senior Data Engineer

    2 weeks ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates Deeplight AI Full time

    About DeepLight: DeepLight is a pioneering AI company committed to pushing the boundaries of innovation in artificial intelligence. Our mission is to harness the power of data and machine learning to revolutionize industries and create a brighter future. With a dynamic team of experts and a culture of relentless innovation, we are at the forefront of AI...

  • Senior HSE Engineer

    2 weeks ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates Tampa Gardens Senior Living Full time

    A bachelor's degree in relevant engineering (i.e Mechanical, Electrical, Civil, Environmental, Chemical, IT, Computer, Software, Electronic, etc.) or equivalent from an accredited university with a minimum of fifteen (15+) years of relevant experience(with design experience) in the Oil & Gas or Petrochemical industry, including minimum (5) years in in GCC...

  • Senior HSE Engineer

    3 days ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates Tampa Gardens Senior Living Full time

    A bachelor's degree in relevant engineering (i.e Mechanical, Electrical, Civil, Environmental, Chemical, IT, Computer, Software, Electronic, etc.) or equivalent from an accredited university with a minimum of fifteen (15+) years of relevant experience(with design experience) in the Oil & Gas or Petrochemical industry, including minimum (5) years in in GCC...

  • Senior Data Engineer

    3 days ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates Elevon Core Full time

    OurTeamOur team comprises highlyskilled professionals who bring a wealth of internationalexperience in technology entrepreneurship. We thrive on ambitionand recognize that fun and performance go hand inhand. Together we create a dynamic environment whereexcellence is the currency of success.Position OverviewAs a Data Engineeryou will play a crucial role in...

  • Data & Integration Specialist

    1 week ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates Gulf Data International Full time

    How to apply: Data & Integration SpecialistGDI takes pride in creating opportunities for personal growth and achievement. To apply for a job opening, please email your latest CV in MS Word or PDF format to careers@gdi.ae, with the job title applied for in the subject line.Job DescriptionWe are actively seeking a Data & Integration Specialist with expertise...

  • Senior Data Engineer

    3 weeks ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates RecruitMe Plus Full time

    Responsibilities &Requirements: Experiencein:Using data engineering tools(Python SQL ETL) to extract Transform and load thedata.Using data visualization tools like PowerBI Tableau and Cognos Analytics.IBM Productslike (DataStage Db2 Cloud Pak for Data).DataLakehouse and opensource tools like Hive Iceberg Spark Presto andParquet.Data Cataloging Governance...

  • Senior Data Engineer

    3 days ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates RecruitMe Plus Full time

    Responsibilities &Requirements: Experiencein:Using data engineering tools(Python SQL ETL) to extract Transform and load thedata.Using data visualization tools like PowerBI Tableau and Cognos Analytics.IBM Productslike (DataStage Db2 Cloud Pak for Data).DataLakehouse and opensource tools like Hive Iceberg Spark Presto andParquet.Data Cataloging Governance...

  • Senior Data Engineer · Abu Dhabi

    2 weeks ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates Contango Full time

    Our Team Our team comprises highly skilled professionals who bring a wealth of international experience in technology entrepreneurship. We thrive on ambition and recognize that fun and performance go hand in hand. Together, we create a dynamic environment where excellence is the currency of success. Position Overview As a Data Engineer, you will play a...

  • Senior Data Architect

    2 weeks ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates NMDC Group Full time

    Roles and responsibilities Design, architect, and implement a scalable data platform for the business unit's specific needs that supports data-driven decision-making, operations efficiency, and democratization of data Design a data platform architecture that promotes seamless integrations with 3rd party applications, Corporate IT systems including ERP, and...

  • Senior Data Architect

    6 days ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates NMDC Group Full time

    Roles and responsibilities Design, architect, and implement a scalable data platform for the business unit's specific needs that supports data-driven decision-making, operations efficiency, and democratization of data Design a data platform architecture that promotes seamless integrations with 3rd party applications, Corporate IT systems including ERP,...

  • Data Engineer

    3 weeks ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates Talent Pal Full time

    How you can make yourmarkAre you currently searching for adata engineering job that offers the opportunity to work onglobally impactful operations all while being part of a dynamic andenthusiastic teamImagine automating the realtimesensor data from our fleet and supporting on NOx reduction forsustainability reporting. In this role you will have the chance...

  • Senior Engineer Data Management Engineering Support

    3 weeks ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates ادنوك للبترول Full time

    KeyAccountabilitiesDataManagement Coordination:Act as the primary liaison for DataManagement queries for theFunctionCollaborates with Stakeholders toensure successful delivery of digital data andassets.Understands inter & intrafunctional requirements for data collection, conditioning,reporting, and turnover.Engineering DataCompliance: Ensures datacollection...

  • Data Engineer

    2 days ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates Presight Full time

    Overview Role: Data Engineer Location: Abu Dhabi About Presight Presight is an ADX-listed public company with Abu Dhabi based G42 as its majority shareholder and is the region's leading big data analytics company powered by GenAI. It combines big data, analytics, and AI expertise to serve every sector, of every scale, to create business and positive...

  • Business yst Data Quality Issue Management

    3 days ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates Sense7ai Data Solution Pvt Ltd Full time

    This is a remoteposition.ProjectPartners has a passion for delivering projects. Not justsuccessfully, but on-time and to budget We started thisjourney on a mission to empower people to deliver projectssuccessfully. Being project professionals ourselves we know whatworks.Our insider knowledge means we know exactly whatgreat project delivery needs. We went on...

  • AI-Powered Data Engineer

    4 days ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates Teachmecode Full time

    About the RoleWe are seeking a highly skilled Senior Frontend Engineer to join our dynamic team at Presight. As a key member of our development team, you will be responsible for implementing the user experience across the entire lifecycle of diverse structured and unstructured data.You will participate in building collaborative integrated development...

  • Senior Data Architect

    3 weeks ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates NMDC Group Full time

    Roles and responsibilitiesDesign, architect, andimplement a scalable data platform for the businessunit's specific needs that supports data-drivendecision-making, operations efficiency, and democratization ofdataDesign a data platform architecture thatpromotes seamless integrations with 3rd party applications,Corporate IT systems including ERP, and in-house...

  • Senior Data Architect

    3 days ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates NMDC Group Full time

    Roles and responsibilitiesDesign, architect, andimplement a scalable data platform for the businessunit's specific needs that supports data-drivendecision-making, operations efficiency, and democratization ofdataDesign a data platform architecture thatpromotes seamless integrations with 3rd party applications,Corporate IT systems including ERP, and in-house...

  • Audiovisual Systems Engineer

    18 hours ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates Alpha Data LLC. Full time

    Job DescriptionWe are seeking an experienced Audiovisual Systems Engineer to join our team at Alpha Data LLC. As a key member of our technical staff, you will be responsible for the design, installation, and commissioning of complex audiovisual systems.Your primary focus will be on ensuring that all systems meet the required specifications and are properly...

  • Senior Engineer

    2 weeks ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates Petrofac Full time

    Petrofac is a leading international service provider to the energy industry, with a diverse client portfolio including many of the world's leading energy companies. We design, build, manage and maintain infrastructure for our clients. We recruit, reward, and develop our people based on merit regardless of race, nationality, religion, gender, age, sexual...