SENIOR DATA ENGINEER

3 weeks ago

Dubai, Dubai, United Arab Emirates Elevon Core Full time

Job Purpose:The Senior Data Quality & Automation Engineer is afullyparticipating member of a crossfunctional team workingautonomously on technology development and problem resolution inthe Enterprise Data & Analytics space. The role involveshands on contributing to quality practices along with designing andimplementing data quality and automation platforms. They will alsoprovide support to technical analytics solutions and products thatsupport Emirates Airlines and the Emirates Groupbusinesses.

As aSENIOR DATA ENGINEER QUALITY & AUTOMATION you will:

  • Work closely with productowners analysts software engineers and architects to understand thetechnical landscape and context of deliveries to refine complexfunctional and nonfunctional requirements and translate it into fitfor purpose acceptance tests.
  • Work on problemsof diverse scope where analysis of data requires evaluation ofidentifiable factors and select methods to validate and automatethe solution.
  • Build test strategies and testplans validating the core business problem and translating theminto tests around code functionality data quality performance andsecurity.
  • Build and support generating ormocking of test data for exploratory analysis and runningtests.
  • Design and build automated tests / jobsof moderate to high scope and complexity across all stages of thedata pipeline while demonstrating good coding & designpractices and adhering to published coding standards andguidelines.
  • Build and enhance data qualityrules and platforms for observability across the datapipeline
  • Debug complex issues resolve blockersand follow design documents with minimal or nosupervision.
  • Conduct data analysis activitiessuch as source system analysis data modelling data dictionarycollection data profiling and sourcetotarget mapping ensuringdelivery on business needs.
  • Support in updatingdata inventories and registries as required to keep metadata anddata lineage uptodate following agreed Data Governance standardsguidelines and principles.

Qualifications& Experience: To be considered for the role you must meetthe belowrequirements:

  • In arelevant field such as Computer Science Computational MathematicsComputer Engineering or SoftwareEngineering.
  • Specialization or electives in aData & Analytics field (e.g. Data Warehousing Data ScienceBusiness Intelligence) a nicetohave
  • 2 yearsData Engineering experience with focus on quality &automation
  • Extensive handson experience withdeveloping API automation frameworks.
  • Minimum 2years of testing automation and support experience in analyticsapplications such as Data Lake and Data Warehouse (preferably usingthe Big Data stack and Microsoft Azure cloudinfrastructure)
  • Seasoned in identifying qualityissues across complex data pipelines running on big datatechnologies and defining rules for validating health of thedata
  • Experienced in a wide variety of testingmethods and tools covering functional performance security testsacross individual jobs pipelines and end to end acrossenterprise.
  • Well versed in building automatedchecks running in a CI pipeline to validate the ETL / ELT jobs areperforming as expected
  • Experience with batchand realtime data ingestion/integration tools and technologieshandling massive quantities of data (structured andunstructured)
  • Exposed to data architectureconcepts such as data modelling Big Data storage and dimensionalmodelling
  • Exposed to working with jobs in datapipelines and define metrics / measures to ensure correctness ofthe data
  • Programming (Python or Scala) and SQLquerying skills is required
  • Exposure to Spark& airline industry experience isnicetohave
  • Ability to drive quality of dataassets independently and Able to deliver solutions (and associatedvalue) collaboratively
  • Strong expertise withcontextdriven and exploratory testing with practical experience inusing a number of testingheuristics.
  • Experience working with VMs andcontainers both onprem and cloud offerings like Amazon and GoogleCloud.
  • Operates with a You Code It You Own Itmindset (i.e. supports the products theybuild)
  • Team player; able to collaborate withothers to remove blockers solve complex design problems anddebug/resolve issues
  • Is accountable anddisplays positive attitude
  • Selfstarter and haspassion for exploring and learning new technologies especiallythose in the Enterprise Data & Analyticsspace
Salary & Benefits: Join us in Dubai and enjoy anattractive taxfree salary and travel benefits that are exclusive toour industry including discounts on flights and hotels stays aroundthe world.
This job has been sourced from an external jobboard.
More jobs on
Key Skills
ApacheHive,S3,Hadoop,Redshift,Spark,AWS,Apache Pig,NoSQL,Big Data,DataWarehouse,Kafka,Scala
Employment Type: Full Time
Vacancy: 1

  • Senior Pipeline Professional

    7 days ago

    Dubai, Dubai, United Arab Emirates Tampa Gardens Senior Living Full time

    Pipeline Engineering Role OverviewTampa Gardens Senior Living is seeking a highly skilled Senior Pipeline Engineer to join our operations team.This role requires providing technical guidance and expertise to ensure the efficient execution of pipeline engineering projects.Key Accountabilities:Coordinate with cross-functional teams to develop and implement...

  • Senior Data Engineer

    2 weeks ago

    Dubai, Dubai, United Arab Emirates VML South Africa Full time

    Position Name: Senior Data EngineerPosition Location: Dubai & Abu Dhabi, UAE THE ROLE We are seeking an experienced Senior Data Engineer (ideally with experience in consumer retail banking and marketing) to lead the development of a new data integration for a key agency client. In this role, you will work closely with the Data Architect and lead the...

  • Senior Surveyor Position

    7 days ago

    Dubai, Dubai, United Arab Emirates Tampa Gardens Senior Living Full time

    Job OverviewTampa Gardens Senior Living is looking for a highly skilled Senior Surveyor to join our team. As a senior leader, you will be responsible for leading site operations and driving business growth through effective project management.The ideal candidate will have a strong background in surveying, project management, and leadership, with a proven...

  • Pipeline Engineer Expert

    7 days ago

    Dubai, Dubai, United Arab Emirates Tampa Gardens Senior Living Full time

    Senior Pipeline Engineer Job DescriptionWe are seeking an experienced Senior Pipeline Engineer to provide technical support and expertise to operating plants and pipeline projects related to the Pipeline discipline.This position involves ensuring the efficient progression of pipeline engineering work while maintaining schedule and quality in accordance with...

  • Senior Mechanical Engineer for Edgnex Project Management

    7 hours ago

    Dubai, Dubai, United Arab Emirates Edgnex Data Centers by DAMAC Full time

    We are looking for a Senior Mechanical Engineer to join our project management team at Edgnex Data Centers by DAMAC. As a senior engineer, you will be responsible for overseeing the mechanical design and implementation of our data center projects.This role requires a strong background in mechanical engineering, with experience in designing and delivering...

  • Engineering Manager

    7 days ago

    Dubai, Dubai, United Arab Emirates Tampa Gardens Senior Living Full time

    Pipeline Engineering Job SummaryWe are seeking a highly skilled Senior Pipeline Engineer to join our team at Tampa Gardens Senior Living.This role involves providing technical support and expertise to operating plants and pipeline projects related to the Pipeline discipline.Main Responsibilities:Collaborate with cross-functional teams to develop and...

  • Senior Data Engineer

    2 weeks ago

    Dubai, Dubai, United Arab Emirates TPConnects Full time

    TPConnects is seeking a highly skilled Senior Data Engineer to join our team in Dubai. As a Senior Data Engineer, you will play a critical role in advancing best practices for data engineering within our organization. Your main responsibilities will include designing, building, and maintaining robust data architecture, ensuring it is stable, scalable, and...

  • Senior Data Engineer and Analyst

    16 hours ago

    Dubai, Dubai, United Arab Emirates Elevon Core Full time

    Elevon Core is a leading provider of innovative insurance solutions. We are seeking an experienced Senior Data Engineer and Analyst to lead our data engineering efforts and provide strategic guidance on data analysis.About the Role:Design and develop scalable data infrastructure to support business intelligence and analytics needsLeverage ETL tools and...

  • Senior Data Engineer

    3 days ago

    Dubai, Dubai, United Arab Emirates Teachmecode Full time

    About the Role: We are looking for a talented Senior Data Engineer to join our team in Dubai. As a Senior Data Engineer, you will be responsible for designing, building, and maintaining scalable and robust backend services using Python. You will also work on data pipelines, transforming large datasets into meaningful insights, and collaborate with data...

  • Oil and Gas Project Engineer

    15 hours ago

    Dubai, Dubai, United Arab Emirates The Chemical Engineer Full time

    Key ResponsibilitiesThe Senior Process Design Engineer will be responsible for delivering challenging project and client targets using sound technical knowledge and decision-making skills. This includes:Carrying out process engineering design activities, following client and company standards and procedures to schedule and budget as advised by the Process...

  • Process Design Engineering Specialist

    15 hours ago

    Dubai, Dubai, United Arab Emirates The Chemical Engineer Full time

    Job OverviewThis role is an exciting opportunity for a Senior Process Design Engineer to join The Chemical Engineer's team in Dubai, UAE. The successful candidate will be responsible for strengthening our team's capabilities in FEED and Detail Engineering for a Major Onshore Brownfield Project.About the RoleCandidate shall have strong analytical skills in...

  • Project Manager Senior Role

    7 days ago

    Dubai, Dubai, United Arab Emirates Tampa Gardens Senior Living Full time

    About the RoleWe are seeking a seasoned professional to lead our site operations team as a Senior Surveyor. As a key member of our team, you will be responsible for briefing the team on project scope and ensuring everyone understands their roles and responsibilities.Key tasks include feasibility estimates, cost plans, procurement & tendering, and contract...

  • Senior Data Engineer- Microsoft Fabric Data Platform

    2 weeks ago

    Dubai, Dubai, United Arab Emirates Flatgigs Full time

    FlatGigs is pleased to announce an excellent career opportunity with one of our distinguished clients. We are seeking a highly experiencedSenior Data Engineerto join a fast-paced and innovative team. This role offers the chance to design and implement cutting-edge data solutions that support advanced analytics and machine learning initiatives.Role...

  • Senior Project Surveyor

    2 weeks ago

    Dubai, Dubai, United Arab Emirates Tampa Gardens Senior Living Full time

    This role as a Senior Project Surveyor within the AECOM Dubai Aviation team will provide the right individual an environment which they can thrive and develop into a leader for the future. Working across a wide range of projects and end markets, will give the candidate exposure to many asset types, procurement routes and major aviation schemes in the region....

  • Senior Pipeline Operations Leader

    1 week ago

    Dubai, Dubai, United Arab Emirates Tampa Gardens Senior Living Full time

    About the RoleThis challenging role requires an experienced engineer to lead the Senior Pipeline Operations Team at Tampa Gardens Senior Living. The successful candidate will be responsible for managing and coordinating complex pipeline engineering projects.In this role, you will ensure that all pipeline engineering work is completed to the highest standard,...

  • Edgnex Data Center Mechanical Engineering Director

    7 hours ago

    Dubai, Dubai, United Arab Emirates Edgnex Data Centers by DAMAC Full time

    We are seeking a highly experienced Edgnex Data Center Mechanical Engineering Director to lead our data center project teams. As a director, you will be responsible for overseeing the mechanical design and implementation of our data center projects.This role requires a strong background in mechanical engineering, with experience in designing and delivering...

  • Data Engineer

    2 weeks ago

    Dubai, Dubai, United Arab Emirates VML South Africa Full time

    Position Name: Data EngineerPosition Location: Dubai & Abu Dhabi, UAE THE ROLE We are seeking a skilled Data Engineer to join our team. The successful candidate will work closely with the Senior Data Engineer and be responsible for designing and managing the data structure and ETL processes of our retail bank client. They will handle data from various...

  • Senior HSE Specialist

    7 days ago

    Dubai, Dubai, United Arab Emirates Tampa Gardens Senior Living Full time

    Job DescriptionWe are seeking a Senior HSE Specialist to join our team at Tampa Gardens Senior Living. As a key member of our organization, you will play a critical role in ensuring the health and safety of our employees and clients.The successful candidate will have a degree in a relevant engineering field and at least fifteen years of experience in the Oil...

  • Professional Lead

    7 days ago

    Dubai, Dubai, United Arab Emirates Tampa Gardens Senior Living Full time

    Senior Surveyor Job DescriptionWe are seeking a highly motivated and experienced Senior Surveyor to join our team at Tampa Gardens Senior Living. As a key member of our site operations team, you will be responsible for leading projects from inception to completion.Your key responsibilities will include briefing the team on project scope, developing value...

  • Master Data Architect

    16 hours ago

    Dubai, Dubai, United Arab Emirates Elevon Core Full time

    About the RoleElevon Core is seeking an experienced Senior Data Engineer to lead the development of a new data integration for one of our key agency clients. As a Senior Data Engineer, you will work closely with the Data Architect and lead the implementation/development phase while working with the data scientist/analyst to incorporate analytics and...