Lead Data Engineer-Big Data Technology

4 weeks ago


Dubai, United Arab Emirates Precision Hire Solution Full time

Job Purpose: At Emirates webelieve in connecting the world to and through our global hub inDubai; and in constantly innovating to ensure our customers FlyBetter. Join the Emirates Group IT Team in Dubai. Emirates Group ITthrives on the dynamic nature of technology. Being pioneers inaviation innovation were always at the forefront pushingboundaries. Were on the lookout for exceptional IT professionals tofortify our position as leaders in the industry. Embark on ajourney with the worlds largest international airline and become avital part of our cuttingedge information and technology team asLead Data Engineer.

The Lead DataEngineerBig Data Technology is a fully participatingmember of a crossfunctional team working autonomously on technologydevelopment and problem resolution in the Enterprise Data &Analytics space. The role involves the design development testingimplementation support and maintenance of technical data andanalytic solutions and products that support Emirates Airlines andthe Emirates Group businesses with a focus on technical solutiondesign and endtoend fit within the data architecture. The positiondemands indepth expertise in the respective technology profiles andinvolves collaboration with business stakeholders product ownersdelivery leads architects and site reliability engineers to deliverhighquality product features successfully and in a timely fashion.

In this role you will be responsiblefor:

  • Lead technical designdevelopment and deployment for solutions within a team. Carry outeffective technical design reviews to ensure that the rightarchitecture patterns are used by the team. Conduct required sourcesystem analysis data profiling sourcetotarget mapping activitiesand data modeling (both logical and physical) to ensure delivery ofbusiness needs.
  • Complete data engineeringcoding and design tasks on problems of high scope and complexity.Demonstrate good coding principles and exercise good judgment indesigning and building solutions. Conduct code review for peers.Ensure solutions adhere to published data privacy and cybersecurityprinciples.
  • Implement and practicefitforpurpose estimation techniques to promote iterative delivery.Help the team in refining estimates during sprint planning withoptimal assumptions and interdependency understanding.
  • Operate with a datadriven mindset. Helptranslate data and analytics requirements into data solutions basedon the approved technical designs. Assist with data analysisactivities such as source system analysis and data modeling toensure solutions deliver on business needs. Work with team membersto envision solutions as a set of data products and data pipelines.
  • Ensure solutions being built are stablescalable and maintainable. Enable test automation and ensure CI/CDpipelines are in good health. Implement monitoring of dataapplications and track product quality performance and stability.Drive corrective adaptive preventative and perfective actions tomaintain solution reliability and quality.
  • Collaborate with members of thecrossfunctional team to identify areas of inefficiency and proposesolutions. Identify activities resulting in optimal resourceutilization cost reduction technical debt remediation serviceimprovement and reuse value. Partner with architects and productowners to prioritize and implement such activities.
  • Update data inventories and registries asrequired to keep metadata and data lineage uptodate followingagreed Data Governance standards guidelines and principles.
  • Partner with fellow team members PrincipalData Engineers and Architects for developing and implementing dataengineering best practices and modernization techniques promotingsolution reusability process automation builtinquality testdrivendevelopment agile delivery timely root cause analysis and blamelessincident postmortems. Key contributor in building and adopting dataengineering playbooks for the relevant technologies and ensuringadherence to said playbooks as well as other published codingstandards data technology blueprints.
  • Workeffectively on incident resolution conducting root cause analysisand handling business escalations. Engage other technical expertsand vendor partners in the timely resolution of incidents. Maintainregular and transparent communication during incident management.Conduct postmortem and lessonslearned discussions.
  • Key contributor and catalyst in attracting andretaining data engineering talent. Handhold new joiners to ensuresuccessful onboarding. Support engineering leadership for venturinginto different working models for scaling up the data engineeringteam in line with deliverycommitments.

Qualifications& Experience: Qualifications:

  • Degree or Honours (123 orequivalent) In a relevant field such as Computer ScienceComputational Mathematics Computer Engineering or SoftwareEngineering.
  • Specialization or electives in aData & Analytics field (e.g. Data Warehousing Data ScienceBusiness Intelligence) a nicetohave

Experience:

  • 5 years experience in DataEngineering (Fewer years experience will be considered for mastersdegree holders)
  • Minimum 5 years of developmenttesting and support experience in analytic applications such asData Lake and Data Warehouse (using the Big Data stack andMicrosoft Azure cloud infrastructure)
  • Experience with batch and realtime dataingestion; experience with designing and coding pipelines thathandle massive quantities of data (structured and unstructured)securely and in a timely fashion
  • Deepunderstanding of data architecture concepts such as data modelingBig Data storage and Lambda architecture.
  • Deepunderstanding of system integration architecture and demonstratedexperience building integration with various types of sourcesystems; able to design and develop loads of operational systemsdata into a single data platform using a variety of dataintegration tools
  • Experience in buildingreusable components
  • Experience designingmonitoring and alerting solutions for data pipelines and datarepositories
  • Experience and knowledge of awide variety of testing methods and tools covering functionalperformance regression system integration smoke testing of Big DataETL (ExtractTransformLoad) Business Intelligence applications andpipelines
  • Operates with efficiency andautomation in mind; experience building reliable reusableautomation frameworks (e.g. CI/CD)
  • Strong SQLquerying skills required
  • The airline industryexperiences a nicetohave

Knowledge/Skills:

  • Strong ability to conductdata analysis (e.g. source system identification datadictionary/metadata collection data profiling sourcetotargetmapping) is preferred
  • Operates with a You CodeIt You Own It mindset (i.e. supports the products they build)
  • Demonstrated problemsolver; able to design anddocument solutions independently
  • Team player;able to collaborate with others to remove blockers solve complexdesign problems and debug/resolve issues
  • Ableto deliver solutions (and associated value) interactively
  • Is accountable and displays a positiveattitude
  • Selfstarter and has a passion forexploring and learning new technologies especially those in theEnterprise Data & Analyticsspace.

Salary &Benefits: Join us in Dubai and enjoy an attractive taxfree salaryand travel benefits that are exclusive to our industry includingdiscounts on flights and hotels stays around the world. You canfind out more information about our employee benefits in theWorking Here section of our website confidential Furtherinformation on whats it like to live and work in our cosmopolitanhome city can be found in the Dubai Lifestyle section.This job hasbeen sourced from an external job board.
More jobson

  • Dubai, Dubai, United Arab Emirates Precision Hire Solution Full time

    Job Purpose: At Emirates we believe in connecting the world to and through our global hub in Dubai; and in constantly innovating to ensure our customers Fly Better. Join the Emirates Group IT Team in Dubai. Emirates Group IT thrives on the dynamic nature of technology. Being pioneers in aviation innovation were always at the forefront pushing boundaries....


  • dubai, United Arab Emirates Precision Hire Solution Full time

    Job Purpose: At Emirates we believe in connecting the world to and through our global hub in Dubai; and in constantly innovating to ensure our customers Fly Better. Join the Emirates Group IT Team in Dubai. Emirates Group IT thrives on the dynamic nature of technology. Being pioneers in aviation innovation were always at the forefront pushing boundaries....


  • Dubai, United Arab Emirates Precision Hire Solution Full time

    Job Purpose: At Emirates we believe in connecting the world to and through our global hub in Dubai; and in constantly innovating to ensure our customers Fly Better. Join the Emirates Group IT Team in Dubai. Emirates Group IT thrives on the dynamic nature of technology. Being pioneers in aviation innovation were always at the forefront pushing boundaries....


  • Dubai, United Arab Emirates Precision Hire Solution Full time

    Job Purpose: At Emirates we believe in connecting the world to and through our global hub in Dubai; and in constantly innovating to ensure our customers Fly Better. Join the Emirates Group IT Team in Dubai. Emirates Group IT thrives on the dynamic nature of technology. Being pioneers in aviation innovation were always at the forefront pushing boundaries....

  • Big Data Engineer

    3 weeks ago


    dubai, United Arab Emirates Big Fish Recruitment Full time

    The job posting is outdated and position may be filledJob Alert You will be updated with latest job alerts via emailValid email field requiredSend jobsJob Alert You will be updated with latest job alerts via emailValid email field requiredSend jobsLiaising with coworkers and clients to elucidate the requirements for each task.Conceptualizing and generating...

  • Big Data Engineer

    1 week ago


    Dubai, Dubai, United Arab Emirates Big Fish Recruitment Full time

    The job posting is outdated and position may be filledJob Alert You will be updated with latest job alerts via emailValid email field requiredSend jobsJob Alert You will be updated with latest job alerts via emailValid email field requiredSend jobsLiaising with coworkers and clients to elucidate the requirements for each task.Conceptualizing and generating...

  • Big Data Engineer

    1 week ago


    Dubai, Dubai, United Arab Emirates Asterix Communications Full time

    About UsErbis is a software development company with offices in the US, UK, Poland, and Ukraine. The majority of our customers come from the EU and the US. We undertake project implementation on our side or augment the clients' in-house teams. Now, our team consists of 100+ IT professionals with expertise across domains. We help enterprises and SMBs create...

  • Data Engineering Lead

    1 month ago


    dubai, United Arab Emirates Datahash Full time

    About the role:We are seeking a highly skilled and experienced Lead Data Engineers with expertise in architecting and building complex solutions using Big Data Technologies, Graph Databases, Streaming/Batch Data Analytics with strong understanding of multiple clouds platforms to join our talented team. The ideal candidate should have strong leadership skills...

  • Data Engineering Lead

    4 weeks ago


    dubai, United Arab Emirates Datahash Full time

    About the role:We are seeking a highly skilled and experienced Lead Data Engineers with expertise in architecting and building complex solutions using Big Data Technologies, Graph Databases, Streaming/Batch Data Analytics with strong understanding of multiple clouds platforms to join our talented team. The ideal candidate should have strong leadership skills...

  • Lead Data Engineer

    1 week ago


    Dubai, Dubai, United Arab Emirates Emirates Full time

    Lead Data Engineer | Emirates DubaiBased in Dubai, the Emirates Group employs over 103,363 staff from more than 160 nationalities. The Emirates Group's extensive and diverse international portfolio includes the world's largest international airline, Emirates, and one of the largest combined air services provider in the world, dnata. Within the Group there...

  • Lead Data Engineer

    1 week ago


    Dubai, Dubai, United Arab Emirates Emirates Full time

    Lead Data Engineer | Emirates DubaiBased in Dubai, the Emirates Group employs over 103,363 staff from more than 160 nationalities. The Emirates Group's extensive and diverse international portfolio includes the world's largest international airline, Emirates, and one of the largest combined air services provider in the world, dnata. Within the Group there...


  • Dubai, United Arab Emirates IQ Data Full time

    **The Role**: With a minimum of five years of experience, you will play a critical role in ensuring that our client(s) complies with relevant data privacy standards and practices. **Key Responsibilities** - Lead the development, implementation, and maintenance of organization's data privacy and protection policies in alignment with GDPR, PDPL and other...

  • Data Scientist

    1 month ago


    dubai, United Arab Emirates Open Data Science Full time

    Tabby creates financial freedom in the way people shop, earn and save by reshaping their relationship with money. Over 4,500,000 active users choose Tabby to stay in control of their spending and make the most out of their money.Over 15,000 global brands and small businesses, including H&M, Adidas, IKEA, SHEIN, noon, and Bloomingdale’s use Tabby’s...

  • Data Scientist

    4 weeks ago


    dubai, United Arab Emirates Open Data Science Full time

    Tabby creates financial freedom in the way people shop, earn and save by reshaping their relationship with money. Over 4,500,000 active users choose Tabby to stay in control of their spending and make the most out of their money.Over 15,000 global brands and small businesses, including H&M, Adidas, IKEA, SHEIN, noon, and Bloomingdale’s use Tabby’s...

  • Lead Data Engineer

    3 weeks ago


    dubai, United Arab Emirates G42 Full time

    Qualifications Skills and Attributes for SuccessBachelor’s degree in Computer Science, Engineering, Mathematics, or a related field; or equivalent work experience.3+ years of experience in a Data Engineering role.Proficiency in SQL and programming languages like Python, Java, and Scala.Hands-on experience with big data technologies like Hadoop, Spark, and...


  • Dubai, Dubai, United Arab Emirates IQ Data Full time

    The Role:With a minimum of five years of experience, you will play a critical role in ensuring that our client(s) complies with relevant data privacy standards and practices.Key Responsibilities Lead the development, implementation, and maintenance of organization's data privacy and protection policies in alignment with GDPR, PDPL and other relevant...

  • Lead Data Engineer

    4 weeks ago


    dubai, United Arab Emirates G42 Full time

    QualificationsSkills and attributes for successBachelor’s degree in Computer Science, Engineering, Mathematics, or a related field; or equivalent work experience. 3+ years of experience in a Data Engineering role. Proficiency in SQL and programming languages like Python, Java, and Scala. Hands-on experience with big data technologies like Hadoop, Spark and...

  • Data Scientist

    1 week ago


    Dubai, Dubai, United Arab Emirates Open Data Science Full time

    Tabby creates financial freedom in the way people shop, earn and save by reshaping their relationship with money. Over 4,500,000 active users choose Tabby to stay in control of their spending and make the most out of their money.Over 15,000 global brands and small businesses, including H&M, Adidas, IKEA, SHEIN, noon, and Bloomingdale's use Tabby's technology...

  • Lead Data Engineer

    2 weeks ago


    Dubai, Dubai, United Arab Emirates Precision Hire Solution Full time

    Job Purpose: Connect the world through our hub in Dubai by joining the Emirates Group IT Team. As pioneers in aviation innovation, we are looking for exceptional professionals to strengthen our position in the industry as a Lead Data Engineer.In this role you will be responsible for:Lead technical design, development, and deployment for solutions within a...

  • Lead Data Engineer

    1 week ago


    Dubai, Dubai, United Arab Emirates G42 Full time

    QualificationsSkills and attributes for success Bachelor's degree in Computer Science, Engineering, Mathematics, or a related field; or equivalent work experience.3+ years of experience in a Data Engineering role.Proficiency in SQL and programming languages like Python, Java, and Scala.Hands-on experience with big data technologies like Hadoop, Spark and...