Data Engineer

6 days ago

Abu Dhabi, Abu Dhabi, United Arab Emirates ParamInfo Full time
Roles and responsibilities

Data Engineer

Location : Dubai

We are looking for Experience upto: 5-8 Years

Summary: Experienced Informatica PC and IDMC Developer with 5+ years in data engineering. Skilled in designing end-to-end data pipelines using PC/IDMC for effective migration and transformation across cloud platforms. The ideal candidate will have in-depth knowledge of Informatica PowerCenter and IDMC. A strong foundation in Data Warehousing concepts and proficiency in Snowflake and SQL is essential. Strong team player with agile experience, delivering timely, high-impact data solutions.

Technical Skills

  • Tools: Informatica Cloud Data Integration, Informatica PowerCenter
  • Data Warehousing: Snowflake, DataLake
  • Programming: SQL, Python, Shell Scripting
  • Data Management: Storage management, quality monitoring, governance
  • Modeling: Dimensional modeling, star/snowflake schema

Core Competencies

  • Design, develop, and optimize ETL workflows using Informatica PowerCenter (PC) and Informatica IDMC.
  • Manage data ingestion processes from diverse data sources such as Salesforce, Oracle databases, PostgreSQL, and MySQL.
  • Implement and maintain ETL processes and data pipelines to ensure efficient data extraction, transformation, and loading.
  • Utilize Snowflake as the data warehouse solution for managing large volumes of structured and unstructured data.
  • Maintain and optimize ETL jobs for performance and reliability, ensuring timely data availability for business users.
  • Support data migration, data integration, and data consolidation efforts.
  • Write and maintain basic Python scripts for data processing and automation tasks.
  • Utilize Unix shell commands for data-related tasks and system management.
  • Troubleshoot and resolve ETL-related issues, ensuring data integrity and availability.
  • Ensure adherence to best practices for data governance and security.

Professional Experience

  • Informatica Developer
  • Developed ELT processes using PC/IDMC to integrate data into Snowflake.
  • Implemented storage management for Azure Blob and Snowflake, enhancing data security.
  • Worked on basis Python and shell scripting languages
Desired candidate profile

  • Data Architecture Design :

    • Design and develop scalable, efficient, and reliable data architectures that support data storage, processing, and analytics needs.
    • Build and maintain data warehouses, databases, and other storage solutions.
    • Create and optimize data models that meet the organization's analytical and business requirements.

  • Data Pipeline Development :

    • Build and maintain ETL (Extract, Transform, Load) pipelines to move data from various sources to data warehouses, databases, or cloud storage systems.
    • Ensure pipelines can handle high volumes of data, perform transformations, and ensure data integrity and accuracy.
    • Automate data workflows and ensure they are scalable and robust for ongoing data processing tasks.

  • Data Integration :

    • Integrate data from diverse sources (databases, APIs, third-party services, etc.) into unified systems.
    • Collaborate with external teams to gather data requirements and develop integration solutions.
    • Manage batch and real-time data integration processes, ensuring that data flows continuously and efficiently.

  • Data Quality Management :

    • Ensure the accuracy, consistency, and reliability of data by implementing quality checks and monitoring.
    • Identify and resolve issues related to missing, incomplete, or inconsistent data.
    • Establish and maintain data governance standards to ensure compliance with regulatory and internal data policies.

  • Data Warehousing :

    • Develop and optimize data warehouses, ensuring they are structured efficiently for query performance and analysis.
    • Ensure data storage is cost-effective while providing fast access and scalability.
    • Support the implementation of OLAP (Online Analytical Processing) and OLTP (Online Transaction Processing) solutions.

  • Performance Optimization :

    • Optimize query performance to ensure fast data retrieval, using techniques like indexing, partitioning, and caching.
    • Monitor and tune data systems for better performance, minimizing bottlenecks and downtime.
    • Scale data infrastructure based on increasing data volumes and processing demands.

  • Cloud Data Engineering :

    • Work with cloud platforms like AWS , Google Cloud Platform (GCP) , or Microsoft Azure to deploy, manage, and scale data storage and processing systems.
    • Utilize cloud-native tools (e.g., AWS Redshift , BigQuery , Azure Synapse Analytics ) to manage and process data.

  • Collaboration with Data Teams :

    • Work closely with data scientists and data analysts to understand their data requirements and provide clean, reliable, and accessible data.
    • Support the development of machine learning models by providing clean, labeled, and pre-processed data.
    • Collaborate with business intelligence teams to ensure data is structured in a way that supports reporting and analytics.

  • Data & Integration Specialist

    1 week ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates Gulf Data International Full time

    How to apply: Data & Integration SpecialistGDI takes pride in creating opportunities for personal growth and achievement. To apply for a job opening, please email your latest CV in MS Word or PDF format to careers@gdi.ae, with the job title applied for in the subject line.Job DescriptionWe are actively seeking a Data & Integration Specialist with expertise...

  • Data Engineer

    2 weeks ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates Talent Pal Full time

    How you can make yourmarkAre you currently searching for adata engineering job that offers the opportunity to work onglobally impactful operations all while being part of a dynamic andenthusiastic teamImagine automating the realtimesensor data from our fleet and supporting on NOx reduction forsustainability reporting. In this role you will have the chance...

  • Data Engineer

    1 day ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates Presight Full time

    Overview Role: Data Engineer Location: Abu Dhabi About Presight Presight is an ADX-listed public company with Abu Dhabi based G42 as its majority shareholder and is the region's leading big data analytics company powered by GenAI. It combines big data, analytics, and AI expertise to serve every sector, of every scale, to create business and positive...

  • Audiovisual Systems Engineer

    3 hours ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates Alpha Data LLC. Full time

    Job DescriptionWe are seeking an experienced Audiovisual Systems Engineer to join our team at Alpha Data LLC. As a key member of our technical staff, you will be responsible for the design, installation, and commissioning of complex audiovisual systems.Your primary focus will be on ensuring that all systems meet the required specifications and are properly...

  • Lead Data Engineer

    2 weeks ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates Dicetek LLC Full time

    Roles and ResponsibilitiesOverall 5-7 years of experience in data engineering and transformation on Cloud3+ Years of Very Strong Experience in Azure Data Engineering, DatabricksExpertise in supporting/developing lakehouse workloads at enterprise levelExperience in pyspark is required – developing and deploying the workloads to run on the Spark distributed...

  • Data Warehouse Engineer

    2 days ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates CAREEM Full time

    Roles and responsibilitiesWe are seeking a highly skilled andmotivated Data Warehouse Engineer to join our team. As a DataWarehouse Engineer, you will play a critical role in designing,developing, and maintaining our data infrastructure, ensuring theavailability, scalability, and reliability of our data systems. Youwill collaborate closely with...

  • Data Warehouse Engineer

    2 weeks ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates CAREEM Full time

    Roles and responsibilitiesWe are seeking a highly skilled andmotivated Data Warehouse Engineer to join our team. As a DataWarehouse Engineer, you will play a critical role in designing,developing, and maintaining our data infrastructure, ensuring theavailability, scalability, and reliability of our data systems. Youwill collaborate closely with...

  • Senior Data Engineer

    2 weeks ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates Deeplight AI Full time

    About DeepLight: DeepLight is a pioneering AI company committed to pushing the boundaries of innovation in artificial intelligence. Our mission is to harness the power of data and machine learning to revolutionize industries and create a brighter future. With a dynamic team of experts and a culture of relentless innovation, we are at the forefront of AI...

  • Lead Data Engineer

    6 days ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates Dicetek LLC Full time

    Roles and responsibilities Overall 5-7 years of experience in data engineering and transformation on Cloud 3+ Years of Very Strong Experience in Azure Data Engineering, Databricks Expertise in supporting/developing lakehouse workloads at enterprise level Experience in pyspark is required – developing and deploying the workloads to run on the Spark...

  • Lead Data Engineer

    2 weeks ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates Dicetek LLC Full time

    Roles and responsibilitiesOverall 5-7 years ofexperience in data engineering and transformation onCloud3+ Years of Very Strong Experience inAzure Data Engineering, DatabricksExpertise insupporting/developing lakehouse workloads at enterpriselevelExperience in pyspark is required– developing and deploying the workloads to run on theSpark distributed...

  • Lead Data Engineer

    2 days ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates Dicetek LLC Full time

    Roles and responsibilitiesOverall 5-7 years ofexperience in data engineering and transformation onCloud3+ Years of Very Strong Experience inAzure Data Engineering, DatabricksExpertise insupporting/developing lakehouse workloads at enterpriselevelExperience in pyspark is required– developing and deploying the workloads to run on theSpark distributed...

  • Data Engineer

    2 weeks ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates ParamInfo Full time

    Roles and responsibilitiesDataEngineerLocation: DubaiWe are looking for Experienceupto: 5-8YearsSummary:Experienced Informatica PC and IDMCDeveloper with 5+ yearsin data engineering. Skilled in designing end-to-enddata pipelines using PC/IDMC for effective migration andtransformation across cloud platforms. The ideal candidate willhave in-depth knowledge of...

  • Data Engineer

    2 days ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates ParamInfo Full time

    Roles and responsibilitiesDataEngineerLocation: DubaiWe are looking for Experienceupto: 5-8YearsSummary:Experienced Informatica PC and IDMCDeveloper with 5+ yearsin data engineering. Skilled in designing end-to-enddata pipelines using PC/IDMC for effective migration andtransformation across cloud platforms. The ideal candidate willhave in-depth knowledge of...

  • Business yst Data Quality Issue Management

    2 days ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates Sense7ai Data Solution Pvt Ltd Full time

    This is a remoteposition.ProjectPartners has a passion for delivering projects. Not justsuccessfully, but on-time and to budget We started thisjourney on a mission to empower people to deliver projectssuccessfully. Being project professionals ourselves we know whatworks.Our insider knowledge means we know exactly whatgreat project delivery needs. We went on...

  • Senior Data Engineer

    2 weeks ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates RecruitMe Plus Full time

    Responsibilities &Requirements: Experiencein:Using data engineering tools(Python SQL ETL) to extract Transform and load thedata.Using data visualization tools like PowerBI Tableau and Cognos Analytics.IBM Productslike (DataStage Db2 Cloud Pak for Data).DataLakehouse and opensource tools like Hive Iceberg Spark Presto andParquet.Data Cataloging Governance...

  • Data Visualization Engineer

    1 day ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates KBR, Inc. Full time

    Job SummaryWe are seeking a highly skilled Data Visualization Engineer to join our team at KBR, Inc.The ideal candidate will have a strong background in data analysis, excellent presentation skills, and experience working with large datasets.Responsibilities:Design and develop interactive dashboards and reports using Power BI and other tools.Analyze complex...

  • Data Engineer Professional

    6 days ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates Andersen Lab Full time

    The Andersen Lab is inviting a skilled professional to join its team as a Data Engineer. In this position, you will work closely with the IT department to design and manage data pipelines, ETL processes, and data storage solutions.The company is embarking on a transformative digital journey to enhance its operational efficiency and customer experiences. The...

  • Senior Data Engineer

    2 days ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates RecruitMe Plus Full time

    Responsibilities &Requirements: Experiencein:Using data engineering tools(Python SQL ETL) to extract Transform and load thedata.Using data visualization tools like PowerBI Tableau and Cognos Analytics.IBM Productslike (DataStage Db2 Cloud Pak for Data).DataLakehouse and opensource tools like Hive Iceberg Spark Presto andParquet.Data Cataloging Governance...

  • Dynamics Power Apps Engineer

    1 week ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates Big Data Technology Solutions Full time

    The role of Dynamics Power Apps Engineer at Big Data Technology Solutions requires a highly skilled professional to design, build, and test our CRM system. As a key member of our ERP and IT Software departments, you will be responsible for developing, configuring, and testing the CRM system.Main ResponsibilitiesDevelop and customize Power Apps and Power...

  • Data Infrastructure Engineer

    2 weeks ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates KS Talent Solutions Full time

    We are hiring a Data Infrastructure Engineer to design and optimize data lakehouse solutions using Starburst/Trino, cloud technologies, and automation tools. This role focuses on high-performance infrastructure, query optimization, and cost efficiency across cloud-based and on-prem environments. Key Responsibilities: Architect, deploy, and manage data...