Senior Data Engineer

1 day ago

Abu Dhabi, Abu Dhabi, United Arab Emirates Elevon Core Full time

OurTeam

Our team comprises highlyskilled professionals who bring a wealth of internationalexperience in technology entrepreneurship. We thrive on ambitionand recognize that fun and performance go hand inhand. Together we create a dynamic environment whereexcellence is the currency of success.

Position Overview

As a Data Engineeryou will play a crucial role in designing building and maintainingour data infrastructure. You will be responsible for ensuring theavailability integrity and efficiency of our data pipelinesenabling our organization to make informed datadriven decisions.The value you bring will be instrumental in delivering measurablevalue to Contango and beyond using data andAI.

Responsibilities

  • Leadershipand ownership: own overall data lake and data warehousearchitecture with the responsibilities to design architect andmaintain the data warehouse infrastructure to support datamanagement data governance analytics ML & AI needs andaddress future challenges.
  • Datapipeline development: Design build and maintain scalabledata pipelines for ingesting processing and transforming data fromvarious sources ensuring data quality scalability andreliability.
  • Data modelling: Develop and maintain data models architecture patternsschemas and structures that support the needs of data analysts datascientists and other stakeholders.
  • ETL(Extract Transform Load): Create and optimize ETLprocesses to extract data from diverse sources transform it intousable formats and load it into data warehouses or other storagesolutions.
  • Data governance quality andvalidation: Establish and enforce data governancepolicies standards procedures and best practices and implement dataquality checks validation processes and error handling to ensurethe accuracy and consistency ofdata.
  • Performance tuning :Continuously monitor and optimize the performance of data pipelinesto meet business requirements and scalabilityneeds.
  • Data security: Implement and maintain data security measures to protectsensitive information and ensure compliance with data privacyregulations.
  • Collaboration: Work closely with data analysts data scientists and otherstakeholders to understand their data requirements and providesupport in data access andavailability.
  • Documentation: Maintain thorough documentation of data engineeringprocesses data models and datadictionaries.
  • Stay informed: Keep up to date with emerging trends and technologies indata engineering to ensure our data infrastructure remainscuttingedge.

Qualifications

  • Bachelorsdegree in computer science information technology or a relatedfield (masters degree is a plus)
  • Demonstrableexperience of minimum 8 years with at least 5 years in a leadershipposition as a Senior Data Engineer or similar with a portfolio ofprojects 10 years of experience in data engineering with a focus ondesigning and implementing data lakes data warehouses datamodelling ETL processes and data transformationpipelines
  • Experience in cloudbased dataplatforms (e.g. Spark Azure Synapse Analyticsetc.)
  • Proficiency in programming languages suchas Python Java or Scala
  • Strong knowledge ofdatabase systems (SQL and NoSQL) data warehousing and big datatechnologies
  • Knowledge of data governanceprinciples data quality management and regulatorycompliance
  • Experience with orchestrationservices (i.e. Azure Data Factory (ADF) Azure Logic Apps AzureFunctions Databricks Jobs Airflowetc.)
  • Familiarity with data engineeringintegration tools and frameworks and ETLprocesses
  • Experience with cloud platforms likeAWS GCP or Azure
  • Experience with APIdevelopment and integration with dataservices
  • Excellent communications leadershipand collaboration skills
  • Ability to work in afastpaced dynamic environment and lead multiple projects and teamsto deliver highqualityresults
  • Technical Expertise:
    • Programminglanguages : Python Java Scala andR.
    • Data management &databases : Oracle SAP SQL NoSQL DataWarehousing
    • Big datatechnologies : Apache Hadoop Spark Kafkaetc.
    • Cloud platforms: Experience with Microsoft Fabric Azure (Synapse AnalyticsDatabricks Machine Learning AI Search Functions etc.) Databricks onAzure AWS (S3 Redshift SageMaker etc.) Google Cloud Platform(BigQuery Dataflow etc.).
    • Datagovernance: Experience with Ab Initio InformaticaCollibra Purview IBM InfoSphere Great Expectations DeepchecksDatabricks Unity Catalog Databricks Delta Sharing DatabricksCatalog Explorer Databricks Audit Logging and Databricks IdentifyManagement.
    • Datavisualization : Familiarity with Matplotlib SeabornTableau Power BI
    • DevOps &MLOps : CI/CD principles Docker MLFlowKubernetes

Benefits

  • Competitivesalary and benefits package.
  • Opportunity towork on cuttingedge technologyprojects.
  • Collaborative and innovative workenvironment.
  • Professional growth and trainingopportunities.

If you possess therequisite experience qualifications and leadership acumen to driveour success and shape the future of Data and AI innovation withinthe UAE we invite you to submit yourapplication.

This job has beensourced from an external job board.
More jobs on
Key Skills
ApacheHive,S3,Hadoop,Redshift,Spark,AWS,Apache Pig,NoSQL,Big Data,DataWarehouse,Kafka,Scala
Employment Type: Full Time
Experience: years
Vacancy: 1

  • Senior Technical Safety Engineer

    1 day ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates The Chemical Engineer Full time

    About the RoleWe are looking for a talented PMC Senior Process Safety Engineer to join our team. As a key member of our EPC company, you will be responsible for ensuring the implementation of process safety systems that meet or exceed regulatory requirements.The role involves executing assigned scopes of work, providing technical advice and solutions to...

  • Senior Engineer, Piping

    2 weeks ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates Tampa Gardens Senior Living Full time

    Provide Engineering support and technical expertise to operating plants & pipeline, projects related to Pipeline discipline through all phases of project.. Acts as subject matter expert for Pipeline (Offshore & Onshore), participating in project implementation, peer reviews for other business units/areas, modifications, upgrading, capacity improvement...

  • Senior Data Engineer

    2 weeks ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates Deeplight AI Full time

    About DeepLight: DeepLight is a pioneering AI company committed to pushing the boundaries of innovation in artificial intelligence. Our mission is to harness the power of data and machine learning to revolutionize industries and create a brighter future. With a dynamic team of experts and a culture of relentless innovation, we are at the forefront of AI...

  • PMC Senior Process Safety Engineer

    2 hours ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates The Chemical Engineer Full time

    JOB DESCRIPTION Remarkable people, trusted by clients to design and advance the world. The Role This is an exciting opportunity for an experienced PMC Senior Process Safety Engineer with a proven track record in implementation and management of process safety systems, mitigating risks and ensuring compliance with safety standards in oil and gas...

  • Senior HSE Engineer

    2 weeks ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates Tampa Gardens Senior Living Full time

    A bachelor's degree in relevant engineering (i.e Mechanical, Electrical, Civil, Environmental, Chemical, IT, Computer, Software, Electronic, etc.) or equivalent from an accredited university with a minimum of fifteen (15+) years of relevant experience(with design experience) in the Oil & Gas or Petrochemical industry, including minimum (5) years in in GCC...

  • Senior HSE Engineer

    4 days ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates Tampa Gardens Senior Living Full time

    A bachelor's degree in relevant engineering (i.e Mechanical, Electrical, Civil, Environmental, Chemical, IT, Computer, Software, Electronic, etc.) or equivalent from an accredited university with a minimum of fifteen (15+) years of relevant experience(with design experience) in the Oil & Gas or Petrochemical industry, including minimum (5) years in in GCC...

  • Process Safety Engineering Specialist

    1 day ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates The Chemical Engineer Full time

    Job DescriptionWe are seeking a highly experienced PMMC Senior Process Safety Engineer to join our team at Wood, a global leader in consulting and engineering. This is an exciting opportunity for a professional with a proven track record in implementing and managing process safety systems.The successful candidate will be responsible for executing assigned...

  • Senior Data Center Engineer

    6 hours ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates Datatime Full time

    In this critical role, you will be responsible for leading the technical design and engineering aspects of data center projects at Datatime. This includes ensuring that data center designs meet the required functionality, scalability, and efficiency standards.ResponsibilitiesCollaborate with clients, contractors, and vendors to define operational...

  • Senior Data Engineer

    3 weeks ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates Elevon Core Full time

    OurTeamOur team comprises highlyskilled professionals who bring a wealth of internationalexperience in technology entrepreneurship. We thrive on ambitionand recognize that fun and performance go hand inhand. Together we create a dynamic environment whereexcellence is the currency of success.Position OverviewAs a Data Engineeryou will play a crucial role in...

  • Data & Integration Specialist

    2 weeks ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates Gulf Data International Full time

    How to apply: Data & Integration SpecialistGDI takes pride in creating opportunities for personal growth and achievement. To apply for a job opening, please email your latest CV in MS Word or PDF format to careers@gdi.ae, with the job title applied for in the subject line.Job DescriptionWe are actively seeking a Data & Integration Specialist with expertise...

  • Senior Data Engineer

    3 weeks ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates RecruitMe Plus Full time

    Responsibilities &Requirements: Experiencein:Using data engineering tools(Python SQL ETL) to extract Transform and load thedata.Using data visualization tools like PowerBI Tableau and Cognos Analytics.IBM Productslike (DataStage Db2 Cloud Pak for Data).DataLakehouse and opensource tools like Hive Iceberg Spark Presto andParquet.Data Cataloging Governance...

  • Senior Data Engineer

    4 days ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates RecruitMe Plus Full time

    Responsibilities &Requirements: Experiencein:Using data engineering tools(Python SQL ETL) to extract Transform and load thedata.Using data visualization tools like PowerBI Tableau and Cognos Analytics.IBM Productslike (DataStage Db2 Cloud Pak for Data).DataLakehouse and opensource tools like Hive Iceberg Spark Presto andParquet.Data Cataloging Governance...

  • Senior Data Engineer

    1 day ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates RecruitMe Plus Full time

    Responsibilities &Requirements: Experiencein: Using data engineering tools(Python SQL ETL) to extract Transform and load thedata. Using data visualization tools like PowerBI Tableau and Cognos Analytics. IBM Productslike (DataStage Db2 Cloud Pak for Data). DataLakehouse and opensource tools like Hive Iceberg Spark Presto andParquet. Data Cataloging...

  • Senior Data Engineer · Abu Dhabi

    2 weeks ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates Contango Full time

    Our Team Our team comprises highly skilled professionals who bring a wealth of international experience in technology entrepreneurship. We thrive on ambition and recognize that fun and performance go hand in hand. Together, we create a dynamic environment where excellence is the currency of success. Position Overview As a Data Engineer, you will play a...

  • Senior Accountant

    1 day ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates Gulf Data International Full time

    We are hiring an experienced Senior Accountant for an immediate vacancy in Abu Dhabi. The role requires managing daily accounting operations, overseeing financial reporting, improving systems, and coordinating audits. Candidates must have at least 10 years of experience, preferably in EPC Contracting, Marine, or IT industries, and proven expertise as an...

  • Engineering Project Lead for Data Centers

    6 hours ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates Datatime Full time

    The Senior Data Center Engineer will lead the technical design and engineering aspects of data center projects at Datatime. Key responsibilities include ensuring data center functionality, scalability, and efficiency, while adhering to industry standards.Key TasksTranslate operational needs into technical specifications with clients and vendors.Cordinate...

  • Senior Data Architect

    2 weeks ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates NMDC Group Full time

    Roles and responsibilities Design, architect, and implement a scalable data platform for the business unit's specific needs that supports data-driven decision-making, operations efficiency, and democratization of data Design a data platform architecture that promotes seamless integrations with 3rd party applications, Corporate IT systems including ERP, and...

  • Senior Data Architect

    1 week ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates NMDC Group Full time

    Roles and responsibilities Design, architect, and implement a scalable data platform for the business unit's specific needs that supports data-driven decision-making, operations efficiency, and democratization of data Design a data platform architecture that promotes seamless integrations with 3rd party applications, Corporate IT systems including ERP,...

  • Data Engineer

    3 weeks ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates Talent Pal Full time

    How you can make yourmarkAre you currently searching for adata engineering job that offers the opportunity to work onglobally impactful operations all while being part of a dynamic andenthusiastic teamImagine automating the realtimesensor data from our fleet and supporting on NOx reduction forsustainability reporting. In this role you will have the chance...

  • Senior Engineer Data Management Engineering Support

    3 weeks ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates ادنوك للبترول Full time

    KeyAccountabilitiesDataManagement Coordination:Act as the primary liaison for DataManagement queries for theFunctionCollaborates with Stakeholders toensure successful delivery of digital data andassets.Understands inter & intrafunctional requirements for data collection, conditioning,reporting, and turnover.Engineering DataCompliance: Ensures datacollection...