Senior Data Engineer

5 days ago

Abu Dhabi, Abu Dhabi, United Arab Emirates Presight Full time
Overview

Job Description: Senior Data Engineer (12 months contract)

Location: Abu Dhabi

About Presight

Presight is an ADX-listed public company with Abu Dhabi based G42 as its majority shareholder and is the region's leading big data analytics company powered by GenAI. It combines big data, analytics, and AI expertise to serve every sector, of every scale, to create business and positive societal impact. Presight excels at all-source data interpretation to support insight-driven decision-making that shapes policy and creates safer, healthier, happier, and more sustainable societies. Today, through its range of GenAI-driven products and solutions, Presight is bringing Applied AI to the private and public sector, enabling them to realize their AI strategy and ambitions faster.

The Opportunity:

Presight is looking for an astute, proficient and qualified Senior Data Engineer to assess, analyze and work with data concepts, use-cases & complex new data sources to provide business insights to customers and support the implementation & integration of the data sources into the Presight AI platform.

Responsibilities

Key Responsibilities:

Functional

  • Solve challenging problems, using python coding skills.
  • Design, build and launch new data extraction, transformation & loading processes in production.
  • Web crawling, data cleaning, data annotation, data ingestion and data processing.
  • Reading and collating complex data sets.
  • Creating and maintaining data pipelines.
  • Continual focus on process improvement to drive efficiency and productivity within the team.
  • Use of Python, SQL, ES, Shell etc. to build the infrastructure required for optimal extraction, transformation, and loading of data.
  • Provide insights into key business performance metrics by building analytical tools that utilize the data pipeline.
  • Support the wider business with their data needs on an ad hoc basis.
  • Comply with QHSE (Quality Health Safety and Environment), Business Continuity, Information Security, Privacy, Risk, Compliance Management and Governance of Organizations policies, procedures, plans and related risk assessments.
Qualifications

Requirements:

  • Bachelor's degree in computer engineering, Computer Science, or Electrical Engineering and Computer Sciences.
  • 6+ years of programming experience, solid coding skills in Python, Shell, and Java
  • Experience with Web crawling, cleaning.
  • In-depth knowledge in the design and implementation of Spark jobs to execute, schedule, monitor, and control processes.
  • Experienced in Spark SQL and Postgres query languages.
  • Skilled in writing complex queries with joins for processing large datasets.
  • Proficient in using containerization technologies such as Docker.
  • Experienced with orchestration tools like Kubernetes.
  • Adept at implementing testing and monitoring systems for data pipelines to ensure high availability and reliability.
  • Experience with tools like Apache Kafka and Apache Flink for real-time data processing.
  • Skilled in using data orchestration tools like Apache Airflow and Apache NiFi.
  • Strong understanding of Elasticsearch architecture, queries, and ingestion techniques.
  • Experience with solution architecture, data ingestion, query optimization, data segregation, ETL, ELT, AWS, EC2, S3, SQS, lambda, Elastic Search, Redshift, CI/CD frameworks and workflows.
  • Working knowledge of data platform concepts - data lake, data warehouse, ETL, big data processing (designing and supporting variety/velocity/volume), real time processing architecture for data platforms, scheduling and monitoring of ETL/ELT jobs.
  • PostgreSQL and programming (preferably Java, Python), proficiency in understanding data, entity relationships, structured & unstructured data, SQL and NoSQL databases.
  • Knowledge of best practice in optimizing columnar and distributed data processing system and infrastructure.
  • Experienced in designing and implementing dimensional modelling.
  • Knowledge of machine learning and data mining techniques in one or more areas of statistical modelling, text mining and information retrieval.
  • Strong Analytical Skills & Problem-solving skills.

Ideally, you'll also need

  • In-depth market and domain knowledge
  • A passion for constant improvement
  • An innovative and creative approach to problem-solving
  • Excellent communication skills

What we look for:

If you are a performance-driven, inquisitive mind with the agility to adapt to ambiguity, you will fit right in. You should be eager to explore opportunities to build meaningful collaborations with stakeholders and aspire to create unique customer-centric solutions. Bias for action and a passion to conquer new frontiers in the AI space is at the heart of the Presight community.

What working at Presight offers:Culture: An open, diverse and inclusive environment with a global vision that encourages personal growth and focuses on ground-breaking, industry-first innovations.

Career: Outstanding learning, development & growth opportunities via structured training programs and innovative, high-tech projects.

Rewards: A competitive remuneration package with a host of perks including healthcare, leave benefits and more.

#J-18808-Ljbffr

  • Data Protection Engineer

    7 days ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates Alpha Data Full time

    Job OverviewWe are seeking a skilled Data Protection Engineer to join our team at Alpha Data. In this role, you will be responsible for administering and managing Veeam Backup as a service platform, including vCloud Connect, Kasten, and VBR.Key ResponsibilitiesDevelop customized plans to maximize value from Veeam products and services.Identify pain points...

  • Engineering Solutions Manager

    20 hours ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates The Chemical Engineer Full time

    We are seeking a highly skilled Senior Process Designer to join our team at The Chemical Engineer. As a Senior Process Designer, you will be responsible for developing and optimizing process designs, ensuring efficiency, safety, and regulatory compliance.About the JobThe Senior Process Designer will work closely with engineering teams to develop and optimize...

  • Senior Design Professional

    20 hours ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates The Chemical Engineer Full time

    The Chemical Engineer is seeking a highly skilled Senior Process Designer to join our team. This exciting opportunity is for an experienced Senior Process Designer with a proven track record in developing and optimizing process designs.About the TeamYou will work closely with engineering teams to deliver high-quality solutions for complex projects. Our team...

  • Senior Engineer, Piping

    3 weeks ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates Tampa Gardens Senior Living Full time

    Provide Engineering support and technical expertise to operating plants & pipeline, projects related to Pipeline discipline through all phases of project.. Acts as subject matter expert for Pipeline (Offshore & Onshore), participating in project implementation, peer reviews for other business units/areas, modifications, upgrading, capacity improvement...

  • Help Desk Engineer

    4 days ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates Alpha Data Full time

    Job SummaryWe are seeking a highly experienced Help Desk Engineer to join our team at Alpha Data.In this role, you will be responsible for providing technical support to our clients, troubleshooting complex issues, and collaborating with senior engineers to resolve escalated problems.The ideal candidate will have a strong background in IT, excellent...

  • Senior Big Data Engineer

    5 days ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates G42 Full time

    About the RoleWe are looking for a skilled Senior Data Engineer to develop and maintain data systems that support our company's strategic goals. Your role will encompass a range of activities focused on data pipeline development, data quality, and cross-functional collaboration.As a Senior Data Engineer, you will be responsible for building and maintaining...

  • Data Protection Specialist

    6 days ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates Alpha Data Full time

    About the PositionWe are looking for an experienced Veeam Backup Engineer to join our team at Alpha Data. As a key member of our IT services delivery team, you will be responsible for the administration and management of Veeam Backup as a service platform (vCloud Connect), Kasten, and VBR.Main ResponsibilitiesService Platform Administration: Ensure the...

  • Senior Data Engineer

    3 weeks ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates Deeplight AI Full time

    About DeepLight: DeepLight is a pioneering AI company committed to pushing the boundaries of innovation in artificial intelligence. Our mission is to harness the power of data and machine learning to revolutionize industries and create a brighter future. With a dynamic team of experts and a culture of relentless innovation, we are at the forefront of AI...

  • Senior Data Engineer

    5 days ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates G42 Full time

    OverviewAs a Senior Data Engineer at Inception, you will be responsible for building and maintaining the infrastructure that supports data collection, processing, and storage. Reporting to the Lead Data Engineer or Principal Data Engineering, you will work closely with data scientists, analysts, and other stakeholders to ensure that data systems are...

  • Senior Data Engineer

    5 days ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates G42 Full time

    OverviewAs a Senior Data Engineer at Inception, you will be responsible for building and maintaining the infrastructure that supports data collection, processing, and storage. Reporting to the Lead Data Engineer or Principal Data Engineering, you will work closely with data scientists, analysts, and other stakeholders to ensure that data systems are...

  • Senior Data Engineer

    5 hours ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates G42 Full time

    OverviewAs a Senior Data Engineer at Inception, you will be responsible for building and maintaining the infrastructure that supports data collection, processing, and storage. Reporting to the Lead Data Engineer or Principal Data Engineering, you will work closely with data scientists, analysts, and other stakeholders to ensure that data systems are...

  • PMC Senior Process Safety Engineer

    2 days ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates The Chemical Engineer Full time

    JOB DESCRIPTION Remarkable people, trusted by clients to design and advance the world. The Role This is an exciting opportunity for an experienced PMC Senior Process Safety Engineer with a proven track record in implementation and management of process safety systems, mitigating risks and ensuring compliance with safety standards in oil and gas projects...

  • Senior HSE Engineer

    3 weeks ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates Tampa Gardens Senior Living Full time

    A bachelor's degree in relevant engineering (i.e Mechanical, Electrical, Civil, Environmental, Chemical, IT, Computer, Software, Electronic, etc.) or equivalent from an accredited university with a minimum of fifteen (15+) years of relevant experience(with design experience) in the Oil & Gas or Petrochemical industry, including minimum (5) years in in GCC...

  • Senior HSE Engineer

    2 weeks ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates Tampa Gardens Senior Living Full time

    A bachelor's degree in relevant engineering (i.e Mechanical, Electrical, Civil, Environmental, Chemical, IT, Computer, Software, Electronic, etc.) or equivalent from an accredited university with a minimum of fifteen (15+) years of relevant experience(with design experience) in the Oil & Gas or Petrochemical industry, including minimum (5) years in in GCC...

  • Senior HSE Engineer

    8 hours ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates Tampa Gardens Senior Living Full time

    A bachelor's degree in relevant engineering (i.e Mechanical, Electrical, Civil, Environmental, Chemical, IT, Computer, Software, Electronic, etc.) or equivalent from an accredited university with a minimum of fifteen (15+) years of relevant experience(with design experience) in the Oil & Gas or Petrochemical industry, including minimum (5) years in in GCC...

  • Senior Data Engineer

    2 days ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates AI71 Full time

    Get AI-powered advice on this job and more exclusive features. AI71, a pioneering AI company launched by Abu Dhabi's Advanced Technology Research Council (ATRC) and VentureOne, stands as a pivotal movement in the realm of AI innovation. Leveraging the globally top-ranked Falcon AI models from the Technology Innovation Institute, AI71's focus spans across...

  • Senior Data Engineer

    2 days ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates AI71 Full time

    Get AI-powered advice on this job and more exclusive features.AI71, a pioneering AI company launched by Abu Dhabi's Advanced Technology Research Council (ATRC) and VentureOne, stands as a pivotal movement in the realm of AI innovation. Leveraging the globally top-ranked Falcon AI models from the Technology Innovation Institute, AI71's focus spans across...

  • Senior Data Engineer

    2 days ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates AI71 Full time

    Job DescriptionRole: Senior Data EngineerLocation: Abu Dhabi, UAECompany: AI71About Us:AI71, a pioneering AI company launched by Abu Dhabi&aposs Advanced Technology Research Council (ATRC) and VentureOne, stands as a pivotal movement in the realm of AI innovation. Leveraging the globally top-ranked Falcon AI models from the Technology Innovation Institute,...

  • Senior Data Engineer

    57 minutes ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates TEC Evolution Technology Systems Full time

    Get AI-powered advice on this job and more exclusive features.Passionate Recruiter | Talent Acquisition Enthusiast | Building Diverse & Inclusive TeamsPosition: Senior IT Data EngineerAccountability Area:1. Oversee the Database Administration function ensuring the established RTO / RPO / SLAs with the Clients are met.2. Responsible for the implementation,...

  • Data-Centric Solutions Engineer

    6 days ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates Big Data Technology Solutions Full time

    Job RequirementsWe are seeking a highly skilled Data-Centric Solutions Engineer to join our team at Big Data Technology Solutions. As an expert in data-centric solutions, you will be responsible for designing and implementing scalable solutions that meet the needs of our clients.Main Responsibilities:Design and deploy HPC systems using Dell PowerEdge...