Senior Data Engineer

2 weeks ago


Dubai, Dubai, United Arab Emirates Convz Fze Full time
Responsibilities
  • Design end-to-end data solutions, including solution architecture, data modeling, and data flow diagrams, to address complex business requirements.
  • Design, develop, and maintain scalable data pipeline architecture to support the company's and clients' data processing needs.
  • Implement best practices for data ingestion, storage, and processing to ensure data integrity, reliability, and security.
  • Architect and implement Big Data processing workflows to handle large volumes of data with high throughput and low latency, ensuring timely and accurate data delivery.
  • Drive the adoption of data engineering best practices and standards across the organization, including data governance, data security, and data quality.
  • Lead and mentor junior team members, providing guidance on best practices and technical solutions.
  • Maintain consistent communication with the Project Team Lead and Project Manager, providing clear updates on task status and promptly escalating any issues or potential delays.
Good to have:
  • Design and develop real-time streaming data pipelines using technologies such as Apache Kafka, Apache Pulsar, or cloud-native streaming services (e.g., AWS Kinesis, Google Cloud Pub/Sub).
  • Lead data architecture reviews and provide recommendations for optimizing performance, scalability, and cost efficiency.
  • Collaborate with data scientists and analysts to understand data requirements and provide technical expertise in data modeling and analytics.
What we are looking for?
  • Proficiency in designing, building, and maintaining scalable ETL data processing systems using Python, Java, Scala, or similar programming languages.
  • Expertise in SQL – Demonstrate a strong grip on SQL to process and analyze various forms of data.
  • Experience working with Cloud Deployment Environments, preferably GCP, Azure or AWS.
  • Experience in creating and managing CI/CD pipelines using Azure DevOps, Jenkins, GoCD, or similar technologies.
  • Proficiency in orchestration tools like Apache Airflow, Azure Data Factory, AWS Data Pipelines, or similar.
  • Familiarity with version control systems like GitHub and CI/CD concepts.
  • Understanding of Data Modeling and Data Warehousing techniques, including star schema or raw data vault.
  • Experience working with large-scale data sets, including structured and unstructured data formats like Parquet, Avro, JSON, etc.
Good to have:
  • Knowledge of big data processing technologies such as Hadoop, Apache HBase, Apache Hive, or similar.
  • Experienced with designing and implementing Data Governance policies covering Data Accessibility, Security, Management, Quality etc.
#J-18808-Ljbffr
  • Senior Data Engineer

    2 weeks ago


    Dubai, Dubai, United Arab Emirates VML South Africa Full time

    Position Name: Senior Data EngineerPosition Location: Dubai & Abu Dhabi, UAE THE ROLE We are seeking an experienced Senior Data Engineer (ideally with experience in consumer retail banking and marketing) to lead the development of a new data integration for a key agency client. In this role, you will work closely with the Data Architect and lead the...


  • Dubai, Dubai, United Arab Emirates Edgnex Data Centers by DAMAC Full time

    We are looking for a Senior Mechanical Engineer to join our project management team at Edgnex Data Centers by DAMAC. As a senior engineer, you will be responsible for overseeing the mechanical design and implementation of our data center projects.This role requires a strong background in mechanical engineering, with experience in designing and delivering...

  • Senior Data Engineer

    2 weeks ago


    Dubai, Dubai, United Arab Emirates TPConnects Full time

    TPConnects is seeking a highly skilled Senior Data Engineer to join our team in Dubai. As a Senior Data Engineer, you will play a critical role in advancing best practices for data engineering within our organization. Your main responsibilities will include designing, building, and maintaining robust data architecture, ensuring it is stable, scalable, and...


  • Dubai, Dubai, United Arab Emirates Elevon Core Full time

    Elevon Core is a leading provider of innovative insurance solutions. We are seeking an experienced Senior Data Engineer and Analyst to lead our data engineering efforts and provide strategic guidance on data analysis.About the Role:Design and develop scalable data infrastructure to support business intelligence and analytics needsLeverage ETL tools and...


  • Dubai, Dubai, United Arab Emirates The Chemical Engineer Full time

    Key ResponsibilitiesThe Senior Process Design Engineer will be responsible for delivering challenging project and client targets using sound technical knowledge and decision-making skills. This includes:Carrying out process engineering design activities, following client and company standards and procedures to schedule and budget as advised by the Process...


  • Dubai, Dubai, United Arab Emirates Teachmecode Full time

    About the Role: We are looking for a talented Senior Data Engineer to join our team in Dubai. As a Senior Data Engineer, you will be responsible for designing, building, and maintaining scalable and robust backend services using Python. You will also work on data pipelines, transforming large datasets into meaningful insights, and collaborate with data...


  • Dubai, Dubai, United Arab Emirates The Chemical Engineer Full time

    Job OverviewThis role is an exciting opportunity for a Senior Process Design Engineer to join The Chemical Engineer's team in Dubai, UAE. The successful candidate will be responsible for strengthening our team's capabilities in FEED and Detail Engineering for a Major Onshore Brownfield Project.About the RoleCandidate shall have strong analytical skills in...

  • SENIOR DATA ENGINEER

    3 weeks ago


    Dubai, Dubai, United Arab Emirates Elevon Core Full time

    Job Purpose:The Senior Data Quality & Automation Engineer is afullyparticipating member of a crossfunctional team workingautonomously on technology development and problem resolution inthe Enterprise Data & Analytics space. The role involveshands on contributing to quality practices along with designing andimplementing data quality and automation platforms....


  • Dubai, Dubai, United Arab Emirates Flatgigs Full time

    FlatGigs is pleased to announce an excellent career opportunity with one of our distinguished clients. We are seeking a highly experiencedSenior Data Engineerto join a fast-paced and innovative team. This role offers the chance to design and implement cutting-edge data solutions that support advanced analytics and machine learning initiatives.Role...


  • Dubai, Dubai, United Arab Emirates Tampa Gardens Senior Living Full time

    This role as a Senior Project Surveyor within the AECOM Dubai Aviation team will provide the right individual an environment which they can thrive and develop into a leader for the future. Working across a wide range of projects and end markets, will give the candidate exposure to many asset types, procurement routes and major aviation schemes in the region....


  • Dubai, Dubai, United Arab Emirates Edgnex Data Centers by DAMAC Full time

    We are seeking a highly experienced Edgnex Data Center Mechanical Engineering Director to lead our data center project teams. As a director, you will be responsible for overseeing the mechanical design and implementation of our data center projects.This role requires a strong background in mechanical engineering, with experience in designing and delivering...

  • Data Engineer

    2 weeks ago


    Dubai, Dubai, United Arab Emirates VML South Africa Full time

    Position Name: Data EngineerPosition Location: Dubai & Abu Dhabi, UAE THE ROLE We are seeking a skilled Data Engineer to join our team. The successful candidate will work closely with the Senior Data Engineer and be responsible for designing and managing the data structure and ETL processes of our retail bank client. They will handle data from various...


  • Dubai, Dubai, United Arab Emirates Elevon Core Full time

    About the RoleElevon Core is seeking an experienced Senior Data Engineer to lead the development of a new data integration for one of our key agency clients. As a Senior Data Engineer, you will work closely with the Data Architect and lead the implementation/development phase while working with the data scientist/analyst to incorporate analytics and...

  • Data Engineer

    2 weeks ago


    Dubai, Dubai, United Arab Emirates Astek Middle East Full time

    We are seeking an experienced Data Engineer to join our team. The ideal candidate will have a proven track record of designing and implementing ETL/ELT solutions on modern, on-premises platforms . This role supports the development of enterprise data warehouses, data marts, and advanced analytics capabilities. To succeed in this position, you will need a...


  • Dubai, Dubai, United Arab Emirates YO IT Group Full time

    Job OverviewWe are seeking a highly skilled and experienced Big Data Engineer to join our team at YO IT Group.About the RoleThis mid-senior level position is responsible for building and maintaining large-scale data pipelines, working with big data frameworks, and cloud platforms. As a key member of our team, you will leverage your technical acumen to drive...


  • Dubai, Dubai, United Arab Emirates PARK Senior Villas Chandler Full time

    Working within the framework of the Middle East Business Area's policies, processes and commercial strategy, the Senior Proposals Manager leads and coordinates the preparation, negotiation and successful finalization of large (Municipal/Industrial) proposals (including technical, financial and contractual aspects) in the (Water/Waste) sector. The Senior...


  • Dubai, Dubai, United Arab Emirates Emirates Global Aluminium (EGA) Full time

    The Head of Data Engineering is primarily responsible for leading the data engineering team, overseeing the development, deployment, and maintenance of scalable data infrastructures and pipelines. The Head of Data Engineering will be responsible for the execution of the overall Data strategy for Digital transformation. They will work closely with the...


  • Dubai, Dubai, United Arab Emirates VAM Systems Full time

    Job Title: Senior Data EngineerCompany Overview: VAM Systems is a cutting-edge technology firm dedicated to providing innovative data solutions.We strive to deliver exceptional results and build lasting relationships with our clients.Job DescriptionThis Senior Data Engineer position requires expertise in Azure fabric data lake concepts, BI architecture, API...


  • Dubai, Dubai, United Arab Emirates Edgnex Data Centers by DAMAC Full time

    Data Center – AutoCAD DraughtsmanThe ideal candidate will have a strong background in mechanical design and experience working with data centers or mission-critical facilities. Proficiency in design software such as AutoCAD, Revit and BIM is required.Key Responsibilities:Develop high-quality Mechanical Data Center Design documentation in accordance with...


  • Dubai, Dubai, United Arab Emirates The Chemical Engineer Full time

    Required Skills and QualificationsTo be successful in this role, you will need to possess:An engineering degree.A minimum of 8-14 years of design experience in onshore Oil and Gas projects with Brownfield experience.A minimum of 5 years of FEED experience in upstream projects.Experience in FEED design of Crude Oil Storage systems, Produced Water system, and...