Data Engineer

3 weeks ago


Abu Dhabi, Abu Dhabi, United Arab Emirates Findicia Full time

Key Responsibilities:

Functional

  • Solve complex data processing challenges using Python programming skills.
  • Design, build, and launch new data extraction, transformation, and loading processes in production.
  • Web crawling, data cleaning, data annotation, data ingestion, and data processing.
  • Reading and collating complex datasets.
  • Creating and maintaining scalable data pipelines.
  • Continual focus on process improvement to drive efficiency and productivity within the team.
  • Use of Python, SQL, ES, Shell, etc. to build the infrastructure required for optimal extraction, transformation, and loading of data.
  • Provide insights into key business performance metrics by building analytical tools that utilize the data pipeline.
  • Support the wider business with their data needs on an ad hoc basis.
  • Comply with QHSE (Quality, Health, Safety, and Environment) Business Continuity, Information Security, Privacy, Risk Compliance Management, and Governance of Organizations policies, procedures, plans, and related risk assessments.
Qualifications

Requirements:

  • Bachelor's degree in Computer Engineering, Computer Science, or Electrical Engineering and Computer Sciences.
  • 3 years of programming experience with solid coding skills in Python, Shell, and Java.
  • Good corporate capacity and good communication skills.
  • Experience with web crawling and cleaning.
  • Experience with solution architecture, data ingestion, query optimization, data segregation, ETL, ELT, AWS, EC2, S3, SQS, lambda, Elastic Search, Redshift, CI/CD frameworks, and workflows.
  • Working knowledge of data platform concepts, data lake, data warehouse, ETL, big data processing (designing and supporting variety/velocity/volume), real-time processing architecture for data platforms, scheduling, and monitoring of ETL/ELT jobs.
  • PostgreSQL and programming (preferably Java, Python) proficiency in understanding data entity relationships, structured & unstructured data, SQL, and NoSQL databases.
  • Knowledge of best practices in optimizing columnar and distributed data processing systems and infrastructure.
  • Experienced in designing and implementing dimensional modeling.
  • Knowledge of machine learning and data mining techniques in one or more areas of statistical modeling, text mining, and information retrieval.
  • Develop and maintain scalable data pipelines and systems on Azure.
  • Extensive experience with Azure cloud services.

Ideal Candidate:

  • In-depth market and domain knowledge.
  • A passion for constant improvement.
  • An innovative and creative approach to problem-solving.
  • Excellent communication skills.

Work Arrangement:

No remote work.



  • Abu Dhabi, Abu Dhabi, United Arab Emirates Sense7ai Data Solution Pvt Ltd Full time

    About the Role:We are seeking a seasoned Business Analyst with Data Quality Issue Management and Financial Services experience to lead and support our top private banking client in revolutionizing their data management processes.The ideal candidate will be responsible for designing the Target Operating Model to specify deliverables and recommend ways of...

  • Lead Data Engineer

    3 weeks ago


    Abu Dhabi, Abu Dhabi, United Arab Emirates Talent Pal Full time

    Talent Pal is seeking an experienced Data Engineering Expert to join our team. The ideal candidate will have 4 years of experience in data engineering and data visualization using tools such as Python, SQL, ETL, Bower BI, and Tableau. Additionally, experience with IBM Products like DataStage, Db2 Cloud Pak for Data is a plus.Key Responsibilities:Design,...

  • Senior Data Engineer

    4 weeks ago


    Abu Dhabi, Abu Dhabi, United Arab Emirates Talent Pal Full time

    Job RequirementsAs a Senior Data Engineer at Talent Pal, you will be responsible for designing, developing, and maintaining large-scale data processing systems. You will work with a team of experienced professionals to ensure the smooth operation of our data infrastructure.Key ResponsibilitiesDesign and develop data processing pipelines using Python, SQL,...

  • Azure Data Engineer

    3 weeks ago


    Abu Dhabi, Abu Dhabi, United Arab Emirates LANDMARK Group Full time

    Data Solutions ArchitectLANDMARK Group is seeking a highly skilled Data Solutions Architect to join our team. As a key member of our data engineering team, you will be responsible for designing, implementing, and optimizing data solutions on the Azure ecosystem.Key Responsibilities:Design and implement data solutions using Azure services such as Azure Data...

  • Senior Data Engineer

    4 weeks ago


    Abu Dhabi, Abu Dhabi, United Arab Emirates Presight Full time

    Data Engineering Role at PresightWe are seeking a highly skilled Data Engineer to join our team at Presight. The ideal candidate will have a solid background in software development with strong Python coding skills and experience in solving challenging problems.Key Responsibilities:Developing data pipelines with Cloud Services & On-premise Data Centers.Web...


  • Abu Dhabi, Abu Dhabi, United Arab Emirates Thndr Full time

    Unlock Your Data Engineering PotentialAre you ready to take your data engineering skills to the next level? Thndr, the MENA region's mobile first investment platform, is excited to announce its internship program for summer 2024. As a data engineering intern, you'll have the opportunity to work alongside our experienced data team and gain hands-on experience...


  • Abu Dhabi, Abu Dhabi, United Arab Emirates G42 Full time

    Key Responsibilities:Education and Experience: Bachelor's degree in Computer Science, Engineering, Mathematics, or a related field, or equivalent work experience. 3+ years of experience in a Data Engineering role.Technical Skills: Proficiency in SQL and programming languages like Python, Java, and Scala. Hands-on experience with big data technologies like...


  • Abu Dhabi, Abu Dhabi, United Arab Emirates ATRIBS METSCON GROUP Full time

    Job PurposeAs a Technical Project Manager at ATRIBS METSCON GROUP, you will be responsible for managing data engineering projects, adhering to timelines, scope, and budget. You will set up timely scheduled discussions with stakeholders and execute projects in each step.Key Responsibilities• Strong technical understanding of cloud computing, serverless...


  • Abu Dhabi, Abu Dhabi, United Arab Emirates Talent Pal Full time

    About the RoleWe are seeking a highly skilled Electrical Engineer to join our Data Center Operations team. As an Electrical Engineer, you will be responsible for the operation and maintenance of our data center's electrical infrastructure, including UPSs, switchgear, circuit breakers, and generators.Key ResponsibilitiesSupport electrical and mechanical...


  • Abu Dhabi, Abu Dhabi, United Arab Emirates Precision Hire Solution Full time

    At Precision Hire Solution, we're seeking a talented Data Engineer Management and Governance Specialist to join our team. As a key member of our organization, you'll play a crucial role in shaping our data management and governance strategy.About the Role:We're looking for a highly skilled professional with expertise in data engineering, management, and...


  • Abu Dhabi, Abu Dhabi, United Arab Emirates Thndr Full time

    About Thndr's Data Engineering Internship ProgramThndr, the MENA region's mobile-first investment platform, is excited to announce the launch of its internship program for the summer of 2024. This program is designed for data engineering students in the UAE who are eager to gain hands-on experience and deepen their knowledge in data engineering.As a data...


  • Abu Dhabi, Abu Dhabi, United Arab Emirates ادنوك للبترول Full time

    Data Management CoordinationAs a key member of the team, you will be responsible for coordinating data management activities across the organization. This includes acting as the primary liaison for data management queries, collaborating with stakeholders to ensure successful delivery of digital data and assets, and understanding inter and intra-functional...

  • Data Engineer

    3 weeks ago


    Abu Dhabi, Abu Dhabi, United Arab Emirates Talent Pal Full time

    Job DescriptionWe are seeking a highly skilled Data Engineer to join our team in the Middle East. The ideal candidate will have experience with Azure Databricks, Python, and PySpark, and a strong understanding of data validation rules.ResponsibilitiesCollaborate with business SMEs to implement data validation rules.Understand business requirements and...


  • Abu Dhabi, Abu Dhabi, United Arab Emirates Wood PLC Full time

    Job Title: Information Management CoordinatorAt Wood PLC, we are seeking a highly skilled Information Management Coordinator to join our team. The successful candidate will play a key role in developing and implementing Project Information and Data Management Plans, ensuring the project team is aware of all stakeholder requirements, and coordinating with...

  • Data Analyst

    3 weeks ago


    Abu Dhabi, Abu Dhabi, United Arab Emirates Outsized India Private Limited Full time

    Data Scientist - Payments Consulting Firm - MENA RegionJob Title: Data ScientistJob Description:Our client is a leading payments and consulting firm seeking a Data Scientist to develop and validate predictive models using machine learning techniques for one of their clients, a bank. The role involves working with cross-functional teams to develop select use...

  • Data Architect

    4 weeks ago


    Abu Dhabi, Abu Dhabi, United Arab Emirates Dautom Full time

    Key Responsibilities:As a Data Architect at Dautom, you will collaborate closely with our Business Intelligence and Data Engineering teams to design and implement our Enterprise Canonical Data Model (CDM). This involves gathering requirements, fostering innovation, and ensuring the CDM aligns with our organizational goals and industry best practices.Design...

  • Data Analyst

    3 weeks ago


    Abu Dhabi, Abu Dhabi, United Arab Emirates Talent Pal Full time

    Job SummaryTalent Pal is seeking a skilled Data Analyst to join our team. As a Data Analyst, you will be responsible for analyzing data using statistical techniques, implementing and maintaining databases, gathering data from primary and secondary sources, identifying, analyzing, and interpreting trends from these data using dashboarding and modeling...

  • Data Analyst

    3 weeks ago


    Abu Dhabi, Abu Dhabi, United Arab Emirates Siemens Energy Full time

    Key ResponsibilitiesAs a Data Scientist at Siemens Energy, you will be responsible for developing advanced analytics solutions leveraging artificial intelligence and machine learning techniques for application along the value chain.Key responsibilities include:Developing advanced analytics solutions leveraging artificial intelligence and machine learning...


  • Abu Dhabi, Abu Dhabi, United Arab Emirates Wood PLC Full time

    Job Description:OverviewWood PLC is seeking a highly skilled Digital Data Governance Specialist to join our team in Abu Dhabi, UAE. As a key member of our project management team, you will be responsible for developing and implementing data management strategies that ensure the integrity and security of our engineering information...


  • Abu Dhabi, Abu Dhabi, United Arab Emirates Al Nahiya Group Full time

    Data Analysis and InsightsAs a Data Analyst PMO Specialist at Al Nahiya Group, you will be responsible for collecting and analyzing data from various sources to inform business decisions. This will involve working with different teams and stakeholders to gather data, cleaning and validating it to ensure accuracy, and conducting regular audits to maintain...