Lead Data Engineer

Job Purpose: At Emirates we believe in connecting the world to and through our global hub in Dubai; and in constantly innovating to ensure our customers Fly Better. Join the Emirates Group IT Team in Dubai. Emirates Group IT thrives on the dynamic nature of technology. Being pioneers in aviation innovation were always at the forefront pushing boundaries. Were on the lookout for exceptional IT professionals to fortify our position as leaders in the industry. Embark on a journey with the worlds largest international airline and become a vital part of our cuttingedge information and technology team as Lead Data Engineer.

The Lead Data Engineer is a fully participating member of a crossfunctional team working autonomously on technology development and problem resolution in the Enterprise Data & Analytics space. The role involves the design development testing implementation support and maintenance of technical data and analytic solutions and products that support Emirates Airlines and the Emirates Group businesses with a focus on technical solution design and endtoend fit within the data architecture. The position demands indepth expertise in the respective technology profiles and involves collaboration with business stakeholders product owners delivery leads architects and site reliability engineers to deliver highquality product features successfully and in a timely fashion.

In this role you will be responsible for below:

• Lead technical design development and deployment for solutions within a team. Carry out effective technical design reviews to ensure that the right architecture patterns are used by the team. Conduct required source system analysis data profiling sourcetotarget mapping activities and data modeling (both logical and physical) to ensure delivery of business needs.
• Complete data engineering coding and design tasks on problems of high scope and complexity. Demonstrate good coding principles and exercise good judgment in designing and building solutions. Conduct code review for peers. Ensure solutions adhere to published data privacy and cybersecurity principles.
• Implement and practice fitforpurpose estimation techniques to promote iterative delivery. Help the team in refining estimates during sprint planning with optimal assumptions and interdependency understanding.
• Operate with a datadriven mindset. Help translate data and analytics requirements into data solutions based on the approved technical designs. Assist with data analysis activities such as source system analysis and data modeling to ensure solutions deliver on business needs. Work with team members to envision solutions as a set of data products and data pipelines.
• Ensure solutions being built are stable scalable and maintainable. Enable test automation and ensure CI/CD pipelines are in good health. Implement monitoring of data applications and track product quality performance and stability. Drive corrective adaptive preventative and perfective actions to maintain solution reliability and quality.
• Collaborate with members of the crossfunctional team to identify areas of inefficiency and propose solutions. Identify activities resulting in optimal resource utilization cost reduction technical debt remediation service improvement and reuse value. Partner with architects and product owners to prioritize and implement such activities.
• Update data inventories and registries as required to keep metadata and data lineage uptodate following agreed Data Governance standards guidelines and principles.
• Partner with fellow team members Principal Data Engineers and Architects for developing and implementing data engineering best practices and modernization techniques promoting solution reusability process automation builtinquality testdriven development agile delivery timely root cause analysis and blameless incident postmortems. Key contributor in building and adopting data engineering playbooks for the relevant technologies and ensuring adherence to said playbooks as well as other published coding standards data technology blueprints.
• Work effectively on incident resolution conducting root cause analysis and handling business escalations. Engage other technical experts and vendor partners in the timely resolution of incidents. Maintain regular and transparent communication during incident management. Conduct postmortem and lessonslearned discussions.
• Key contributor and catalyst in attracting and retaining data engineering talent. Handhold new joiners to ensure successful onboarding. Support engineering leadership for venturing into different working models for scaling up the data engineering team in line with delivery commitments.

Qualifications & Experience: Qualifications:

• Information Technology & Other 5 Years of experience Degree or Honours (123 or equivalent).
• Degree in a relevant field such as Computer Science Computational Mathematics Computer Engineering or Software Engineering.
• Specialization or electives in a Data & Analytics field (e.g. Data Warehousing Data Science Business Intelligence) a nicetohave
• 5 years of experience in Data Engineering (Fewer years experience will be considered for Masters degree holders)

Experience:

• Expertise in Data Warehouse engineering including extraction transformation and data processing by developing/managing corresponding database tables.
• Expertise in database engineering and experience in SQL/PLSQL. A key contributor to the organizational framework that standardizes the process of data collection storage transformation distribution and usage.
• Expertise in proactive performance monitoring conducting data quality testing and troubleshooting performance issues of complex warehouse data tables.
• Experience in assembling data from multiple sources and analyzing and modeling complex datasets.
• Strong expertise in cocreating and refining key measurements for the business KPI(s) dashboard designing implementing the right performance metrics and usage of data visualization for effective implementation of business insights.
• Deep understanding of visual design standards and best practices related to BI & Reporting.
• Experience in building reusable components.
• Experience designing monitoring and alerting solutions for data pipelines and data repositories.
• Operates with efficiency and automation in mind; experience building reliable reusable automation frameworks (e.g. CI/CD)
• Airline industry experience is nice to have.

Knowledge/Skills:

• Strong ability to conduct data analysis (e.g. source system identification data dictionary/metadata collection data profiling sourcetotarget mapping) is preferred.
• Operates with a You Code It You Own It mindset (i.e. supports the products they build)
• Demonstrated problemsolver; able to design and document solutions independently.
• Team player: able to collaborate with others to remove blockers solve complex design problems and debug/resolve issues.
• Able to deliver solutions (and associated value) interactively.
• Is accountable and displays a positive attitude.
• Selfstarter and has a passion for exploring and learning new technologies especially those in the Enterprise Data & Analytics space.

Key Technologies/Tools :

Big Data: Hadoop Spark Scala Hive HBase Sqoop Oozie Apache Nifi Airflow HDFS ADLS (Gen 2) Azure Data Factory (ADF) DataBricks Kafka Elasticsearch AVRO / PARQUET file formats Data Analysis Modelling and Reporting: Snowflake SQL Data Vault 2.0 MicroStrategy Power BI Cloud Technologies: Microsoft Azure and Cloudera technology stacks Integration and Messaging: Streaming (e.g. Spark Streaming) SnapLogic TIBCO Kafka CI/CD: GIT Bitbucket Azure DevOps Jenkins JIRA Confluence Automation: Java Selenium AppDynamics HP Load Runner Jmeter Python Automation Anywhere

Leadership Role: No

Salary & Benefits: Join us in Dubai and enjoy an attractive taxfree salary and travel benefits that are exclusive to our industry including discounts on flights and hotels stays around the world. You can find out more information about our employee benefits in the Working Here section of our website confidential Further information on whats it like to live and work in our cosmopolitan home city can be found in the Dubai Lifestyle section.This job has been sourced from an external job board.
More jobs on

---