Current jobs related to Lead Data Engineer - abu dhabi emirate united arab emirates abu dhabi emirate united arab emirates - Luxoft

  • Lead Data Engineer

    2 weeks ago

    United Arab Emirates Emirates Global Aluminium (EGA) Full time

    A Lead Data Engineer works closely with a multidisciplinary Agile team to build high quality data pipelines driving analytic solutions. These solutions will generate insights allowing to advance data-driven decision-making capabilities. This role requires deep understanding of data architecture, data engineering, data analysis, reporting, and a basic...

  • Lead Data Ops Engineer

    2 weeks ago

    United Arab Emirates Emirates Global Aluminium (EGA) Full time

    The Lead Data Ops Engineer will play a critical role in building, scaling, automating, and maintaining the company's Big Data infrastructure and Machine Learning operations (MLOps). This individual will work in close collaboration with our Data Architect, Data Science, Data Engineering, and IT teams to ensure the development, deployment, and scale of robust,...

  • Data Engineer

    3 weeks ago

    United Arab Emirates Involved Solutions Full time

    Our client, a leading name in the insurance sector, is hiring a Data Engineer to drive their data innovation efforts.About the role:As a Data Engineer, you'll design and optimize data pipelines and systems to power business objectives. Your work will enable smarter decision-making and enhance efficiency across the organization. Build and maintain robust data...

  • Lead Civil Structural Designer

    2 weeks ago

    United Arab Emirates Lead Soluções Ambientais Full time

    Wood has been awarded a major project with ADNOC and, we are looking to hire a Lead Designer (Civil Structural) to be based at our Abu Dhabi Engineering Center. RESPONSIBILITIES Review Designs for O&G processing facilities and their associated infrastructure. Cooperate with other disciplines to ensure the timely realization of competitive, achievable and...

  • Oil and Chemicals Insurance Risk Engineer

    3 days ago

    United Arab Emirates The Chemical Engineer Full time

    Salary: £75,000 - £115,000 (max) + housing allowance Location: UAE Company: The company is a leading player in the International high hazard Insurance sector, involved in cover associated with various sectors including oil and gas, refining, petrochemicals, LNG, metals, mining, and maritime. The organisation's Gulf hub is enjoying significant client...

  • Data Engineer

    3 days ago

    United Arab Emirates ENTERTAINER FZ LLC Full time

    About Us The ENTERTAINER is a leading digital company dedicated to adding value for consumers by bringing them the best incentive offers globally. We are a 100% digital, data-driven tech company providing first-rate offers across renowned dining, leisure, entertainment, and hotel brands worldwide. The ENTERTAINER has grown with the aim of creating...

  • Data Science Lead

    2 weeks ago

    United Arab Emirates Michael Page Full time

    As the leading delivery company in the region, we have a great responsibility and opportunity to impact the lives of millions of customers, restaurant partners, and riders. To realize our potential, we need to advance our platform to become much more intelligent in how it understands and serves our users. As a data scientist on the algorithms track, your...

  • Data Engineer

    2 weeks ago

    United Arab Emirates Lune Full time

    The data engineer is responsible for designing, implementing, and maintaining the systems and processes necessary for efficient data collection, storage, and analysis. They work closely with the product team, data labeling team, and other stakeholders to understand data requirements and ensure that data pipelines are robust, scalable, and optimized for...

  • Senior Data Analyst

    3 days ago

    United Arab Emirates Alpha Data Full time

    Job Responsibilities Patient leads origination – originate patient referral leads from hospitals and referring physicians, establish and demonstrate an active network of referrals. Patient relations – maintain direct contact with the family/patient and engage nursing and rehabilitation operations teams to execute on patient care, catering to all...

  • Data Engineer

    3 days ago

    United Arab Emirates Traverse Technology Services Full time

    Job Title: Data Engineer – Finance SystemsJob Type: Long-term Contract | RemoteJob Location: Remote in EgyptJob Description: We are hiring an experienced Data Engineer to support finance systems, including OFSAA, Financial Consolidation, and Regulatory Reporting . The ideal candidate will have expertise in ETL processes, data modeling, and big data...

  • Data Engineer

    3 weeks ago

    United Arab Emirates HEMOdata Full time

    JOB DESCRIPTION Data Engineer Role - Remote About HEMOdata HEMOdata is a Data Solutions Consultancy helping organisations across the Middle East to elevate their data strategy, ensure compliance and supercharge customer conversions with our expertise in integrating a best-in-breed technology ecosystem. Based in Dubai and established in May 2022, we have...

  • Data Engineer

    3 days ago

    United Arab Emirates RP International Full time

    We're looking for a Data Engineer to design and maintain scalable data pipelines and models that support analytics and business intelligence. You'll play a key role in ensuring seamless data flow, optimizing performance, and maintaining data integrity across various functions for our client in United Arab Emirates. What You'll Do Develop & Manage Pipelines...

  • Data Engineer

    2 weeks ago

    United Arab Emirates DuneSoft Full time

    A data engineer is an IT worker whose primary job is to prepare data for analytical or operational uses. These software engineers are typically responsible for building data pipelines to bring together information from different source systems. Overview You will be responsible for: Designing and implementing Big Data systems (e.g. data warehouses, data...

  • AI Data Engineer

    3 days ago

    United Arab Emirates Austin Werner Full time

    AI Data Engineer - Fintech/Financial Services, Data Analytics, AI, SQL, Python This role can be based in Dubai, Istanbul or Vienna Austin Werner, a reputable Crypto and Fintech recruitment business with a footprint in the UK and UAE, is pleased to present an exclusive opportunity for a number of Data Engineers to join a brand new AI team at an extremely...

  • Data Engineer

    2 weeks ago

    United Arab Emirates ParamInfo Full time

    Roles and responsibilities Data Engineer Location : Dubai We are looking for Experience upto: 5-8 Years Summary: Experienced Informatica PC and IDMC Developer with 5+ years in data engineering. Skilled in designing end-to-end data pipelines using PC/IDMC for effective migration and transformation across cloud platforms. The ideal candidate will have...

  • Lead HSE Engineer

    4 weeks ago

    , abu dhabi emirate, united arab emirates, abu dhabi emirate, united arab emirates Bilfinger Middle East Full time

    Direct message the job poster from Bilfinger Middle East Inhouse Talent Acquisition - Oil & Gas/Infra/PMC/Projects (UAE/Qatar/Bahrain/KSA/Egypt/India/Kuwait) Job Title: HSE Lead Location: Abu Dhabi/ United Arab Emirates Department: Health, Safety, and Environment Job Summary: The HSE lead is responsible for overseeing the health, safety, and...

  • Lead Data Scientist

    2 weeks ago

    United Arab Emirates 10Pearls Full time

    Data Scientist - Advanced Analytics & AI About the Role Location: United Arab Emirates, Abu DhabiCompany: Siemens Energy LLCOrganization: EVP Global FunctionsBusiness Unit: Digital CoreFull / Part time: Full-timeExperience Level: Experienced Professional As a member of our global team for data & artificial intelligence, you will work on challenging projects...

  • Cloud Data Engineer

    3 days ago

    United Arab Emirates Marc Ellis Full time

    Job Title: Cloud Data Engineer Location: OffshoreContract Type: 6 Months Extendable Contract (Marc Ellis Payroll) Are you an experienced Cloud Data Engineer ready to bring your skills to cutting-edge projects? We're looking for a highly motivated professional to implement and support on-prem applications in the cloud, collaborating with a diverse team of...

  • Data Architecture Lead

    3 weeks ago

    United Arab Emirates ENOC Full time

    Job Purpose Establishes and manages the enterprise data architecture practice including framework, standards and guidelines for data. Ensures that the respective data technology elements and components are interlinked, and all aligned with organization strategy objectives and corporate governance principles. Principal Accountabilities Strategy/Governance...

  • Data Engineer Amsterdam, Dubai

    2 weeks ago

    United Arab Emirates Energetech Full time

    Are you passionate about the energy trading industry and interested in a career in engineering? Then join Energetech, a multinational trading company that reinvents the way energy flows through global markets and unleash your potential. We are looking for talented individuals like you eager to create a positive impact in tech trading who value collaboration...

Lead Data Engineer

4 weeks ago

abu dhabi emirate united arab emirates abu dhabi emirate united arab emirates Luxoft Full time

Luxoft Abu Dhabi Emirate, United Arab Emirates

We are hiring for projects in the Middle East. Our team consists of frontend and backend developers, data analysts and data scientists, architects, analysts and project managers, and Databricks Data engineers. As a Lead Data Engineer, you will manage the development, implementation and maintenance of data infrastructure for a modern data platform.

Responsibilities
  1. Platform Design: Collaborate with cross-functional teams to refine and design the architecture of our data platform.
  2. Platform Optimization: Continuously enhance the performance, scalability, and reliability of the data platform to meet evolving business requirements.
  3. Platform Maintenance: Implement monitoring, alerting, and maintenance processes to ensure the availability and health of the data platform.
  4. Data Governance: Establish and enforce data governance best practices to uphold data quality, security, and compliance standards.
  5. Platform Integration: Integrate new technologies seamlessly into the data platform ecosystem, ensuring compatibility and interoperability.
  6. Collaboration: Work closely with data engineers, data scientists, analysts, and business stakeholders to comprehend requirements and offer technical expertise and support.
  7. Documentation: Create and maintain comprehensive documentation for the data platform architecture, processes, and workflows.
  8. Mentorship: Provide guidance and mentorship to junior members of the data engineering team, nurturing their growth and development.
  9. Design, develop, and maintain data pipelines to ingest and transform raw data into Silver and Gold tables using Databricks.
  10. Build reusable data pipelines that can be utilized by the application development team.
  11. Collaborate with data consumers and other stakeholders to understand data requirements and deliver high-quality data solutions.
  12. Implement declarative ETL pipelines using Databricks, Delta Lake, and other relevant tools to ensure data is accurate, timely, and accessible.
  13. Optimize data models and pipelines for performance, scalability, and reliability.
  14. Model data from various sources, ensuring consistency and quality in the Silver layer.
  15. Curate data assets in the Silver layer to support data science and machine learning applications.
  16. Build and maintain the Gold layer to provide clean, aggregated, and business-ready data for reporting and analytics.
  17. Ensure data governance and security best practices are followed.
  18. Well versed with Databricks fine-tuning techniques for huge data sets.
  19. Document data processes, models, and pipelines for transparency and knowledge sharing.
  20. Well versed with DevOps practices for continuous integration and deployment.
  21. Writing Code, reviewing pull requests, providing constructive feedback and maintaining high code quality standards.
  22. Maintain a deep understanding of data engineering principles, best practices and emerging technologies to drive engineering initiatives.
Skills Must have
  1. Overall 5-7 years of experience in data engineering and transformation on Cloud.
  2. 3+ Years of Very Strong Experience in Azure Data Engineering, Databricks.
  3. Expertise in supporting/developing lakehouse workloads at the enterprise level.
  4. Experience in PySpark is required.
  5. Developing and deploying the workloads to run on the Spark distributed computing.
  6. Candidate must possess at least a Graduate or bachelor's degree in Computer Science/Information Technology, Engineering (Computer/Telecommunication) or equivalent.
  7. Cloud deployment: Preferably Microsoft Azure.
  8. Experience in implementing the platform and application monitoring using Cloud native tools.
Other

Languages

Seniority : Lead

Seniority level
  • Mid-Senior level
Employment type
  • Full-time
Job function
  • Information Technology
  • Industries: IT Services and IT Consulting
#J-18808-Ljbffr