Lead Data Engineer-Big Data Technology
3 weeks ago
with a focus on technical solution design and endtoend fit within the data architecture. The position demands indepth expertise in the respective technology profiles and involves collaboration with business stakeholders product owners delivery leads architects and site reliability engineers to deliver highquality product features successfully and in a timely fashion. In this role you will be responsible for: Lead technical design development and deployment for solutions within a team. Carry out effective technical design reviews to ensure that the right architecture patterns are used by the team. Conduct required source system analysis data profiling sourcetotarget mapping activities and data modeling (both logical and physical) to ensure delivery of business needs. Complete data engineering coding and design tasks on problems of high scope and complexity. Demonstrate good coding principles and exercise good judgment in designing and building solutions. Conduct code review for peers. Ensure solutions adhere to published data privacy and cybersecurity principles. Implement and practice fitforpurpose estimation techniques to promote iterative delivery. Help the team in refining estimates during sprint planning with optimal assumptions and interdependency understanding. Operate with a datadriven mindset. Help translate data and analytics requirements into data solutions based on the approved technical designs. Assist with data analysis activities such as source system analysis and data modeling to ensure solutions deliver on business needs. Work with team members to envision solutions as a set of data products and data pipelines. Ensure solutions being built are stable scalable and maintainable. Enable test automation and ensure CI/CD pipelines are in good health. Implement monitoring of data applications and track product quality performance and stability. Drive corrective adaptive preventative and perfective actions to maintain solution reliability and quality. Collaborate with members of the crossfunctional team to identify areas of inefficiency and propose solutions. Identify activities resulting in optimal resource utilization cost reduction technical debt remediation service improvement and reuse value. Partner with architects and product owners to prioritize and implement such activities. Update data inventories and registries as required to keep metadata and data lineage uptodate following agreed Data Governance standards guidelines and principles. Partner with fellow team members Principal Data Engineers and Architects for developing and implementing data engineering best practices and modernization techniques promoting solution reusability process automation builtinquality testdriven development agile delivery timely root cause analysis and blameless incident postmortems. Key contributor in building and adopting data engineering playbooks for the relevant technologies and ensuring adherence to said playbooks as well as other published coding standards data technology blueprints. Work effectively on incident resolution conducting root cause analysis and handling business escalations. Engage other technical experts and vendor partners in the timely resolution of incidents. Maintain regular and transparent communication during incident management. Conduct postmortem and lessonslearned discussions. Key contributor and catalyst in attracting and retaining data engineering talent. Handhold new joiners to ensure successful onboarding. Support engineering leadership for venturing into different working models for scaling up the data engineering team in line with delivery commitments.Qualifications & Experience: Qualifications: Degree or Honours (123 or equivalent) In a relevant field such as Computer Science Computational Mathematics Computer Engineering or Software Engineering. Specialization or electives in a Data & Analytics field (e.g. Data Warehousing Data Science Business Intelligence) a nicetohave Experience: 5 years experience in Data Engineering (Fewer years experience will be considered for masters degree holders) Minimum 5 years of development testing and support experience in analytic applications such as Data Lake and Data Warehouse (using the Big Data stack and Microsoft Azure cloud infrastructure) Experience with batch and realtime data ingestion; experience with designing and coding pipelines that handle massive quantities of data (structured and unstructured) securely and in a timely fashion Deep understanding of data architecture concepts such as data modeling Big Data storage and Lambda architecture. Deep understanding of system integration architecture and demonstrated experience building integration with various types of source systems; able to design and develop loads of operational systems data into a single data platform using a variety of data integration tools Experience in building reusable components Experience designing monitoring and alerting solutions for data pipelines and data repositories Experience and knowledge of a wide variety of testing methods and tools covering functional performance regression system integration smoke testing of Big Data ETL (ExtractTransformLoad) Business Intelligence applications and pipelines Operates with efficiency and automation in mind; experience building reliable reusable automation frameworks (e.g. CI/CD) Strong SQL querying skills required The airline industry experiences a nicetohave Knowledge/Skills: Strong ability to conduct data analysis (e.g. source system identification data dictionary/metadata collection data profiling sourcetotarget mapping) is preferred Operates with a You Code It You Own It mindset (i.e. supports the products they build) Demonstrated problemsolver; able to design and document solutions independently Team player; able to collaborate with others to remove blockers solve complex design problems and debug/resolve issues Able to deliver solutions (and associated value) interactively Is accountable and displays a positive attitude Selfstarter and has a passion for exploring and learning new technologies especially those in the Enterprise Data & Analytics space.Salary & Benefits: Join us in Dubai and enjoy an attractive taxfree salary and travel benefits that are exclusive to our industry including discounts on flights and hotels stays around the world. You can find out more information about our employee benefits in the Working Here section of our website confidential Further information on whats it like to live and work in our cosmopolitan home city can be found in the Dubai Lifestyle section.This job has been sourced from an external job board. More jobs on#J-18808-Ljbffr
-
Lead Data Engineer-Big Data Technology
1 week ago
Dubai, Dubai, United Arab Emirates Precision Hire Solution Full timeJob Purpose: At Emirates we believe in connecting the world to and through our global hub in Dubai; and in constantly innovating to ensure our customers Fly Better. Join the Emirates Group IT Team in Dubai. Emirates Group IT thrives on the dynamic nature of technology. Being pioneers in aviation innovation were always at the forefront pushing boundaries....
-
Lead Data Engineer-Big Data Technology
1 month ago
Dubai, United Arab Emirates Precision Hire Solution Full timeJob Purpose: At Emirates webelieve in connecting the world to and through our global hub inDubai; and in constantly innovating to ensure our customers FlyBetter. Join the Emirates Group IT Team in Dubai. Emirates Group ITthrives on the dynamic nature of technology. Being pioneers inaviation innovation were always at the forefront pushingboundaries. Were on...
-
Lead Data Engineer-Big Data Technology
3 weeks ago
Dubai, United Arab Emirates Precision Hire Solution Full timeJob Purpose: At Emirates webelieve in connecting the world to and through our global hub inDubai; and in constantly innovating to ensure our customers FlyBetter. Join the Emirates Group IT Team in Dubai. Emirates Group ITthrives on the dynamic nature of technology. Being pioneers inaviation innovation were always at the forefront pushingboundaries. Were on...
-
Lead Data Engineer-Big Data Technology
1 month ago
Dubai, United Arab Emirates Precision Hire Solution Full timeJob Purpose: At Emirates we believe in connecting the world to and through our global hub in Dubai; and in constantly innovating to ensure our customers Fly Better. Join the Emirates Group IT Team in Dubai. Emirates Group IT thrives on the dynamic nature of technology. Being pioneers in aviation innovation were always at the forefront pushing boundaries....
-
Lead Data Engineer-Big Data Technology
3 weeks ago
Dubai, United Arab Emirates Precision Hire Solution Full timeJob Purpose: At Emirates we believe in connecting the world to and through our global hub in Dubai; and in constantly innovating to ensure our customers Fly Better. Join the Emirates Group IT Team in Dubai. Emirates Group IT thrives on the dynamic nature of technology. Being pioneers in aviation innovation were always at the forefront pushing boundaries....
-
Big Data Engineer
3 weeks ago
dubai, United Arab Emirates Big Fish Recruitment Full timeThe job posting is outdated and position may be filledJob Alert You will be updated with latest job alerts via emailValid email field requiredSend jobsJob Alert You will be updated with latest job alerts via emailValid email field requiredSend jobsLiaising with coworkers and clients to elucidate the requirements for each task.Conceptualizing and generating...
-
Big Data Engineer
1 week ago
Dubai, Dubai, United Arab Emirates Big Fish Recruitment Full timeThe job posting is outdated and position may be filledJob Alert You will be updated with latest job alerts via emailValid email field requiredSend jobsJob Alert You will be updated with latest job alerts via emailValid email field requiredSend jobsLiaising with coworkers and clients to elucidate the requirements for each task.Conceptualizing and generating...
-
Big Data Engineer
1 week ago
Dubai, Dubai, United Arab Emirates Asterix Communications Full timeAbout UsErbis is a software development company with offices in the US, UK, Poland, and Ukraine. The majority of our customers come from the EU and the US. We undertake project implementation on our side or augment the clients' in-house teams. Now, our team consists of 100+ IT professionals with expertise across domains. We help enterprises and SMBs create...
-
Data Engineering Lead
1 month ago
dubai, United Arab Emirates Datahash Full timeAbout the role:We are seeking a highly skilled and experienced Lead Data Engineers with expertise in architecting and building complex solutions using Big Data Technologies, Graph Databases, Streaming/Batch Data Analytics with strong understanding of multiple clouds platforms to join our talented team. The ideal candidate should have strong leadership skills...
-
Data Engineering Lead
3 weeks ago
dubai, United Arab Emirates Datahash Full timeAbout the role:We are seeking a highly skilled and experienced Lead Data Engineers with expertise in architecting and building complex solutions using Big Data Technologies, Graph Databases, Streaming/Batch Data Analytics with strong understanding of multiple clouds platforms to join our talented team. The ideal candidate should have strong leadership skills...
-
Lead Data Engineer
1 week ago
Dubai, Dubai, United Arab Emirates Emirates Full timeLead Data Engineer | Emirates DubaiBased in Dubai, the Emirates Group employs over 103,363 staff from more than 160 nationalities. The Emirates Group's extensive and diverse international portfolio includes the world's largest international airline, Emirates, and one of the largest combined air services provider in the world, dnata. Within the Group there...
-
Lead Data Engineer
1 week ago
Dubai, Dubai, United Arab Emirates Emirates Full timeLead Data Engineer | Emirates DubaiBased in Dubai, the Emirates Group employs over 103,363 staff from more than 160 nationalities. The Emirates Group's extensive and diverse international portfolio includes the world's largest international airline, Emirates, and one of the largest combined air services provider in the world, dnata. Within the Group there...
-
Data Privacy and Protection Consultant
3 weeks ago
Dubai, United Arab Emirates IQ Data Full time**The Role**: With a minimum of five years of experience, you will play a critical role in ensuring that our client(s) complies with relevant data privacy standards and practices. **Key Responsibilities** - Lead the development, implementation, and maintenance of organization's data privacy and protection policies in alignment with GDPR, PDPL and other...
-
Data Scientist
1 month ago
dubai, United Arab Emirates Open Data Science Full timeTabby creates financial freedom in the way people shop, earn and save by reshaping their relationship with money. Over 4,500,000 active users choose Tabby to stay in control of their spending and make the most out of their money.Over 15,000 global brands and small businesses, including H&M, Adidas, IKEA, SHEIN, noon, and Bloomingdale’s use Tabby’s...
-
Data Scientist
3 weeks ago
dubai, United Arab Emirates Open Data Science Full timeTabby creates financial freedom in the way people shop, earn and save by reshaping their relationship with money. Over 4,500,000 active users choose Tabby to stay in control of their spending and make the most out of their money.Over 15,000 global brands and small businesses, including H&M, Adidas, IKEA, SHEIN, noon, and Bloomingdale’s use Tabby’s...
-
Lead Data Engineer
3 weeks ago
dubai, United Arab Emirates G42 Full timeQualifications Skills and Attributes for SuccessBachelor’s degree in Computer Science, Engineering, Mathematics, or a related field; or equivalent work experience.3+ years of experience in a Data Engineering role.Proficiency in SQL and programming languages like Python, Java, and Scala.Hands-on experience with big data technologies like Hadoop, Spark, and...
-
Lead Data Engineer
3 weeks ago
dubai, United Arab Emirates G42 Full timeQualificationsSkills and attributes for successBachelor’s degree in Computer Science, Engineering, Mathematics, or a related field; or equivalent work experience. 3+ years of experience in a Data Engineering role. Proficiency in SQL and programming languages like Python, Java, and Scala. Hands-on experience with big data technologies like Hadoop, Spark and...
-
Data Privacy and Protection Consultant
1 week ago
Dubai, Dubai, United Arab Emirates IQ Data Full timeThe Role:With a minimum of five years of experience, you will play a critical role in ensuring that our client(s) complies with relevant data privacy standards and practices.Key Responsibilities Lead the development, implementation, and maintenance of organization's data privacy and protection policies in alignment with GDPR, PDPL and other relevant...
-
Lead Data Engineer
1 week ago
Dubai, Dubai, United Arab Emirates Precision Hire Solution Full timeJob Purpose: Connect the world through our hub in Dubai by joining the Emirates Group IT Team. As pioneers in aviation innovation, we are looking for exceptional professionals to strengthen our position in the industry as a Lead Data Engineer.In this role you will be responsible for:Lead technical design, development, and deployment for solutions within a...
-
Data Scientist
1 week ago
Dubai, Dubai, United Arab Emirates Open Data Science Full timeTabby creates financial freedom in the way people shop, earn and save by reshaping their relationship with money. Over 4,500,000 active users choose Tabby to stay in control of their spending and make the most out of their money.Over 15,000 global brands and small businesses, including H&M, Adidas, IKEA, SHEIN, noon, and Bloomingdale's use Tabby's technology...