Lead Data Engineer Big Data Technology The Emirates Group

Found in: beBee S AE - 1 month ago

United Arab Emirates Talent Pal Full time
Job Purpose: JOB PURPOSE: The Lead Data Engineer is a fully-participating member of a cross-functional team working autonomously on technology development and problem resolution in the Enterprise Data & Analytics space. The role involves the design, development, testing, implementation, support and maintenance of technical data and analytic solutions and products that support Emirates Airlines and the Emirates Group businesses - with a focus on technical solution design and end-to-end fit within the data architecture. The position demands in-depth expertise in the respective technology profiles, and involves collaboration with business stakeholders, product owners, delivery leads, architects and site relaiability engineers to deliver high-quality product features successfully, and in a timely fashion. JOB ACCOUNTABILITIES LINKED TO OBJECTIVE AREAS: -Lead technical design, development and deployment for solutions within a team. Carry out effective technical design reviews to ensure that the right architecture patterns are used by the team. Conduct required source system analysis, data profiling, source-to-target mapping activities and data modelling (both logical and physical) to ensure delivery on business needs. -Complete data engineering coding and design tasks on problems of high scope and complexity. Demonstrate good coding principles and exercise good judgement in designing and building solutions. Conduct code review for peers. Ensure solutions adhere to published data privacy and cybersecurity principles. -Implement and practice fit-for-purpose estimation techniques, to promote iterative delivery. Help the team in refining estimates during sprint planning, with optimal assumptions and inter-dependency understanding. -Operate with a data-driven mindset. Help translate data and analytics requirements into data solutions based on the approved technical designs. Assist with data analysis activities such as source system analysis and data modelling, to ensure solutions deliver on business needs. Work with team members to envision solutions as a set of data products and data pipelines. -Ensure solutions being built are stable, scalable and maintainable. Enable test automation and ensure CI/CD pipelines are in good health. Implement monitoring of data applications and track product quality, performance and stability. Drive corrective, adaptive, preventative and perfective actions to maintain solution reliability and quality. -Collaborate with members of the cross-functional team to identify areas of inefficiency and propose solutions. Identify activities resulting in optimal resource utilization, cost reduction, technical debt remediation, service improvement and reuse value. Partner with architects and product owners to prioritize and implement such activities. -Update data inventories and registries as required to keep metadata and data lineage up-to-date, following agreed Data Governance standards, guidelines and principles. -Partner with fellow team members, Principal Data Engineers and Architects for developing and implementing data engineering best practices and modernization techniques, promoting solution reusability, process automation, built-in-quality, test-driven development, agile delivery, timely root cause analysis and blameless incident post-mortems. Key contributor in building and adopting data engineering playbooks for the relevant technologies, and ensuring adherence to said playbooks, as well as other published coding standards data technology blueprints. -Work effectively on incident resolution, conducting root cause analysis and handling business escalations. Engage other technical experts and vendor partners in the timely resolution of incidents. Maintain regular and transparent communication during incident management. Conduct post-mortem and lessons learned discussions. -Key contributor and catalyst in attracting and retaining data engineering talent. Handhold new joiners to ensure successful onboarding. Support engineering leadership for venturing different working models for scaling up the data engineering team in line with delivery commitments.
Qualifications & Experience: Qualifications: Degree or Honours (12+3 or equivalent) In a relevant field such as Computer Science, Computational Mathematics, Computer Engineering or Software Engineering. Specialization or electives in a Data & Analytics field (e.g. Data Warehousing, Data Science, Business Intelligence) a nice-to-have Experience: - 5+ yrs experience Data Engineering (Fewer years\xe2\x80\x99 experience will be considered for Masters degree holders) - Minimum 5+ years of development, testing and support experience in the analytic applications such as Data Lake and Data Warehouse (using the Big Data stack and Microsoft Azure cloud infrastructure) - Experience with batch and real-time data ingestion; experience with designing and coding pipelines that handle massive quantities of data (structured and unstructured), securely and in a timely fashion - Deep understanding of data architecture concepts such as data modelling, Big Data storage, Lambda architecture. - Deep understanding of system integration architecture, and demonstrated experience building integration with various types of source systems; able to design and develop loads of operational systems\xe2\x80\x99 data into a single data platform using variety of data integration tools - Experience in building resuable components - Experience designing monitoring and alerting solutions for data pipelines and data repositories - Experience and knowledge of a wide variety of testing methods and tools covering functional, performance, regression, system integration, smoke testing of Big Data, ETL (Extract-Transform-Load) Business Intelligence applications and pipelines - Operates with efficiency and automation in mind; experience building reliable, re-usable automation frameworks (e.g. CI/CD) - Strong SQL querying skills required - Airline industry experience a nice-to-have Knowledge/Skills: - Strong ability to conduct data analysis (e.g. source system identification, data dictionary / metadata collection, data profiling, source-to-target mapping) is preferred - Operates with a \xe2\x80\x9cYou Code It, You Own It\xe2\x80\x9d mindset (i.e. supports the products they build) - Demonstrated problem-solver; able to design and document solutions independently - Team player; able to collaborate with others to remove blockers, solve complex design problems and debug/resolve issues - Able to deliver solutions (and associated value) interatively - Is accountable and displays positive attitude - Self-starter and has passion for exploring and learning new technologies, especially those in the Enterprise Data & Analytics space

Talent Pal

  • Data Integration Engineer

    Found in: Whatjobs AE C2 - 2 weeks ago

    united arab emirates Geolog Group Full time

    Information Technology - Dubai / Milan, United Arab Emirates - Full Time GEOLOG is a world leader in geosciences and drilling data management. We specialize in managing large datasets from drilling rigs, fluid samples analyses and cuttings digital repositories in the oil and gas industry. Our mission is to drive innovation and efficiency through...

  • Data Engineer

    Found in: Whatjobs AE C2 - 2 weeks ago

    united arab emirates DuneSoft.ae Full time

    A data engineer is an IT worker whose primary job is to prepare data for analytical or operational uses. These software engineers are typically responsible for building data pipelines to bring together information from different source systems. Overview You will be responsible for: Designing and implementing Big Data systems (e.g. data warehouses, data...

  • Data Scientists

    Found in: Whatjobs AE C2 - 2 weeks ago

    united arab emirates Geolog Group Full time

    Information Technology - Dubai / Milan, United Arab Emirates - Full Time JOB DESCRIPTION Geolog Technologies is looking to add Data Scientists with experience in Machine Learning (“ML”) to their R&D team. Working in a multidisciplinary team, candidates will be involved in development and maintenance of ML models to support automation of critical...

  • Data Engineering Manager

    Found in: Whatjobs AE C2 - 2 weeks ago

    united arab emirates Michael Page International (UAE) Full time

    We have been made aware of a global phishing campaign where employees from companies are being impersonated. We are confident that no PageGroup system has been breached. Find out how to protect yourself Must have extensive experience within the Banking or Financial Services sector. Opportunity to lead and develop a skilled data engineering team About Our...

  • Data Migration Lead 2 Year Contract

    Found in: beBee S AE - 4 weeks ago

    United Arab Emirates Al Tayer Group Full time

    About Us As a leader in luxury retail in the Middle East, Al Tayer Group\'s retail division, Al Tayer Insignia, hosts a portfolio of some of the world\xe2\x80\x99s best luxury brands in the fashion, jewellery, home and department store categories. Complementing its position in luxury retail, Al Tayer Insignia has also built new frontiers in lifestyle retail,...

  • Information Technologies

    Found in: Whatjobs AE C2 - 2 weeks ago

    united arab emirates Dubai Dubizzel Full time

    This is the list of all the latest Information Technologies (IT) job opportunities in the United Arab Emirates (UAE). Here you find all kinds of IT jobs like software developer, IT manager, UNIX administrator, SAP consultant, data center manager, PHP developer, systems engineer, IT auditor, database managers, Oracle specialist, java developer, python...

  • Data Engineer

    Found in: beBee S AE - 4 weeks ago

    United Arab Emirates MM Staffing & Career Consultants Full time

    Please find the details below Position : Data Engineer Location : UAE (Abu Dhabi) / Offshore Experience requirement : 4+ Years Joining Date : Immediate to 15 days Extensive coding experience and knowledge in Event driven and streaming architecture Experience in JVM tuning for performance Knowledge on Containerisation using Docker and Kubernetes. Working...

  • Data Analyst

    Found in: Whatjobs AE C2 - 2 weeks ago

    united arab emirates Prokoders Full time

    We are seeking a talented Data Analyst to join our team and help us leverage the power of data to enhance our products and services. As a Data Analyst, you will play a key role in analyzing, interpreting, and visualizing data to provide valuable insights that inform strategic decision-making. Duties  Collect, clean, and analyze data from various sources to...

  • Data Network Engineer

    Found in: beBee S AE - 4 weeks ago

    United Arab Emirates Al-Futtaim Full time

    Data Network Engineer I Real Estate I Al Futtaim TechnologiesOverview of the role: AFET is a leader in converged systems integration and provides complete business solutions to large, medium, and small customers that include networking solutions, IP telephony, infrastructure, contact centre solutions, business applications, ELV systems, professional...

  • Energy, Refining and Chemicals Insurance Risk Engineer

    Found in: Whatjobs AE C2 - 2 weeks ago

    united arab emirates The Chemical Engineer Full time

    £65 t o £110 K + housing allowance Insurance risk Company Our client is a leading player in the International high hazard Insurance sector where it is involved In cover associated with a variety of sectors including oil and gas, refining, petrochemicals, LNG, metals, and mining, maritime, mass- transport and so on. The organisation’s Gulf hub is...

  • Data Architect/modeler

    Found in: beBee S AE - 4 weeks ago

    Abu Dhabi, United Arab Emirates Sundus Gulf Full time

    Job Title: Data Architect/Modeler Location: Abu Dhabi, UAE Experience: 10+ Years Education: Bachelor's degree in computer science, data science, information technology, or data modeling. Industry: IT Language: Excellent in English JOB DESCRIPTION: Technical Acumen: Proficient in relational and NoSQL databases, with a deep understanding of data...

  • Head of Data Protection

    Found in: Whatjobs AE C2 - 2 weeks ago

    united arab emirates The Global Search Company Full time

    Leading retail company with a strong commitment to providing exceptional products and services to customers looking to appoint a head of data protection. Job Summary: As the Head of Data Protection, you will be responsible for overseeing all aspects of data protection and privacy compliance within organization. Your primary focus will be to establish and...

  • Data Engineer/scientist Abu Dhabi Global Market

    Found in: beBee S AE - 4 weeks ago

    United Arab Emirates Talent Pal Full time

    M Posted by Mungmi Shimray Recruiter The role of the Data Engineer/ science at the forefront of shaping our data landscape, responsible for designing and implementing robust data pipelines and driving impactful solutions.Responsibilities: Collaborate with internal stakeholders to analyse their data requirements, offering improved visibility from different...

  • Data Science Lead

    Found in: beBee S AE - 4 weeks ago

    Abu Dhabi, United Arab Emirates Sundus Gulf Full time

    Job Title: Data Science Lead Location: Abu Dhabi Experience: 6-8 Years Language: English Education: Bachelors Degree(or equivalent) in mathematics, computer science, economics, or statistics General Summary You will take responsibility for managing our master data set, developing reports, and troubleshooting data issues. Experience as a data analyst,...

  • Data Scientist

    Found in: Whatjobs AE C2 - 1 week ago

    united arab emirates تابي Full time

    Data Scientist (Risk) Department: Risk Employment Type: Full Time Location: Remote Description We are seeking a highly skilled and motivated Data Scientist to join our Risk team's Data Science stream. In this role, you will play a pivotal role in supporting advanced machine learning approaches that drive our decision-making processes and risk strategy.Key...

  • Data Architect

    Found in: Whatjobs AE C2 - 2 weeks ago

    united arab emirates Michael Page International (UAE) Full time

    We have been made aware of a global phishing campaign where employees from companies are being impersonated. We are confident that no PageGroup system has been breached. Find out how to protect yourself Must have strong data modeling experience, specifically with unstructured data. An opportunity to grow within a dedicated high-caliber data management team....

  • Senior .NET Platform Software Engineer

    Found in: Whatjobs AE C2 - 2 weeks ago

    united arab emirates Xa Group Full time

    XA Group is looking for a remote .NET Software Engineer to work on automotive software technology stack for enterprise-level clients and lead best-in-class engineering teams. This is an opportunity to work in multidisciplinary teams on global projects that defines the future of automotive technology. You must be a .NET Software Engineer with Azure...

  • Data Scientist

    Found in: Whatjobs AE C2 - 3 weeks ago

    united arab emirates Edge Corporation Full time

    1. Execute processes for extracting and using data in reports and analysis. 2. Develop and maintain required processing codes to manipulate and analyze data. 3. Develop required reports and visualization dashboards based on processed data. 4. Identify data structures required for visualization and reporting and coordinate with data engineer for data...

  • Vinirma Consulting Private Limited Hiring For IT Project Manager for UAE. at United Arab Emirates

    Found in: Whatjobs AE C2 - 1 week ago

    united arab emirates Vinirma Consulting Private Limited Full time

    We, Nair Systems, are a DIFC based, boutique leading edge technology consulting and professional services firm focusing on Digital Banking, Artificial Intelligence, Big Data & Data Analytics, Cyber Security, Blockchain and Cryptocurrency and Robotic Process Automation.Nair Systems, DIFC is currently looking for IT Project Manager for our UAE operations with...

  • Etl Developer Or Data Migration Lead

    Found in: beBee S AE - 4 weeks ago

    United Arab Emirates PureCS Full time

    Responsibilities:Prepare data migration Strategy for migrating data from primitive HIS systems to Cerner EMR system. Perform migration from multiple HIS to a single EMR system. Perform Data Cleansing activity required for migration. Build and complete data migration uploads. Creating data normalization workbooks for clients. Complete data migration testing....