Data Engineer

3 weeks ago

Dubai, Dubai, United Arab Emirates Dubizzle Full time
Roles and Responsibilities

The Data Engineer intern will be participating in exciting projects covering the end-to-end data lifecycle - from raw data integrations with primary and third-party systems, through advanced data modelling, to state-of-the-art data visualisation and development of innovative data products.

You will have the opportunity to learn how to build and work with both batch and real-time data processing pipelines. You will work in a modern cloud-based data warehousing environment alongside a team of diverse, intense and interesting co-workers. You will liaise with other departments - such as product & tech, the core business verticals, trust & safety, finance and others - to enable them to be successful.

Key Responsibilities Include:

  1. Raw data integrations with primary and third-party systems
  2. Data warehouse modelling for operational and application data layers
  3. Development in Amazon Redshift cluster
  4. SQL development as part of agile team workflow
  5. ETL design and implementation in Matillion ETL
  6. Design and implementation of data products enabling data-driven features or business solutions
  7. Data quality, system stability and security
  8. Coding standards in SQL, Python, ETL design
  9. Building data dashboards and advanced visualisations in Periscope Data with a focus on UX, simplicity and usability
  10. Working with other departments on data products - i.e. product & technology, marketing & growth, finance, core business, advertising and others
  11. Being part and contributing towards a strong team culture and ambition to be on the cutting edge of big data

Requirements

  • Bachelor's degree in computer science, engineering, math, physics or any related quantitative field
  • Knowledge of relational and dimensional data models
  • Knowledge of terminal operations and Linux workflows
  • Ability to communicate insights and findings to a non-technical audience
  • Good SQL skills across a variety of relational data warehousing technologies especially in cloud data warehousing (e.g. Amazon Redshift, Google BigQuery, Snowflake, Vertica, etc.)
  • Attention to details and analytical thinking
  • Entrepreneurial spirit and ability to think creatively; highly-driven and self-motivated; strong curiosity and strive for continuous learning

Desired Candidate Profile

  1. Data Architecture and Infrastructure
    • Designing Data Pipelines : Develop, construct, and maintain efficient data pipelines that enable the movement and transformation of large datasets between various systems and storage solutions.
    • Building Data Warehouses : Create data storage solutions like data warehouses or data lakes that allow easy access, retrieval, and analysis of data from various sources (e.g., transactional databases, cloud platforms).
    • Database Design and Optimization : Design databases, ensuring that they are scalable, secure, and optimized for both performance and storage.
  2. Data Collection and Integration
    • Data Integration : Integrate data from a variety of sources such as APIs, databases, flat files, cloud storage, and real-time data streams into centralized systems.
    • ETL Processes (Extract, Transform, Load) : Develop and maintain ETL processes to clean, transform, and load raw data into usable formats for analytics.
    • Data Governance : Ensure that data is accurate, consistent, and secure by enforcing data governance practices, and maintaining data quality standards.
  3. Data Transformation and Processing
    • Data Cleaning : Process and clean raw data to remove inconsistencies, errors, or duplicates, ensuring that the data used for analysis is reliable and of high quality.
    • Data Transformation : Transform data into a structured format suitable for analysis, reporting, and further processing by data scientists and analysts.
  4. Performance and Scalability
    • Optimization : Continuously monitor, optimize, and troubleshoot data pipelines and storage solutions to ensure they perform efficiently at scale, especially as data volumes grow.
    • Automation : Automate repetitive tasks like data loading and monitoring to reduce manual effort and improve the efficiency of data processing.
  5. Collaboration with Data Scientists and Analysts
    • Collaborate on Data Needs : Work closely with data scientists and analysts to understand their data requirements and provide them with clean, organized, and ready-to-use datasets.
    • Provide Data Access : Ensure that analysts and other users can easily access and query the data they need by setting up efficient querying tools and user interfaces.
  6. Cloud Platforms and Big Data
    • Cloud Solutions : Leverage cloud-based platforms (e.g., AWS , Google Cloud Platform , Microsoft Azure ) for scalable data storage and computing resources.
    • Big Data Technologies : Implement and manage big data technologies (e.g., Hadoop , Spark , Kafka ) to process and analyze large datasets across distributed systems.
#J-18808-Ljbffr

  • Edgnex Data Center Mechanical Engineering Director

    5 days ago

    Dubai, Dubai, United Arab Emirates Edgnex Data Centers by DAMAC Full time

    We are seeking a highly experienced Edgnex Data Center Mechanical Engineering Director to lead our data center project teams. As a director, you will be responsible for overseeing the mechanical design and implementation of our data center projects.This role requires a strong background in mechanical engineering, with experience in designing and delivering...

  • Data Center Draughtsman

    6 days ago

    Dubai, Dubai, United Arab Emirates Edgnex Data Centers by DAMAC Full time

    Data Center – AutoCAD DraughtsmanThe ideal candidate will have a strong background in mechanical design and experience working with data centers or mission-critical facilities. Proficiency in design software such as AutoCAD, Revit and BIM is required.Key Responsibilities:Develop high-quality Mechanical Data Center Design documentation in accordance with...

  • Data Engineer

    2 weeks ago

    Dubai, Dubai, United Arab Emirates LanceSoft UAE Full time

    We have a new opportunity for a Data Engineer with our client.Title: Data EngineerDuration: 6 MonthsLocation: DubaiQualifications:A Bachelor's degree in Data Engineering, Computer Science, Information Technology, or a related discipline is required.A Master's degree is preferred but not mandatory.Certifications in ETL tools, data engineering platforms, or...

  • Data Engineer

    2 weeks ago

    Dubai, Dubai, United Arab Emirates VML South Africa Full time

    Position Name: Data EngineerPosition Location: Dubai & Abu Dhabi, UAE THE ROLE We are seeking a skilled Data Engineer to join our team. The successful candidate will work closely with the Senior Data Engineer and be responsible for designing and managing the data structure and ETL processes of our retail bank client. They will handle data from various...

  • Data Center Mechanical Systems Manager

    5 days ago

    Dubai, Dubai, United Arab Emirates Edgnex Data Centers by DAMAC Full time

    Data Center Mechanical Systems Manager needed for Edgnex Data Centers by DAMAC. This role involves developing and implementing mechanical design solutions for our data center projects. The ideal candidate will have a strong background in mechanical engineering and experience in designing and delivering large-scale data center projects.You will work closely...

  • Data Engineer

    2 days ago

    Dubai, Dubai, United Arab Emirates SimplyApply Full time

    Data Engineer Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking...

  • Data Engineer

    3 weeks ago

    Dubai, Dubai, United Arab Emirates ClickJobs Full time

    Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers, and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers...

  • Data Engineer

    3 weeks ago

    Dubai, Dubai, United Arab Emirates SimplyApply Full time

    DataEngineerDo you love building and pioneeringin the technology space? Do you enjoy solving complex businessproblems in a fast-paced, collaborative, inclusive, and iterativedelivery environment? At Capital One, you'll be part of abig group of makers, breakers, doers and disruptors, who solve realproblems and meet real customer needs. We are seeking...

  • Data Engineer

    3 weeks ago

    Dubai, Dubai, United Arab Emirates Property Finder Group Full time

    We are seeking an inventive and forward-thinking Data Engineer to join our innovative team. In this role, you will not just follow the traditional paths of data engineering; instead, you'll break new ground by bringing a fresh, creative perspective to every project. Your self-motivation and ability to think differently will be key as you design and implement...

  • Mechanical Design Lead

    5 days ago

    Dubai, Dubai, United Arab Emirates Edgnex Data Centers by DAMAC Full time

    The Edgnex Data Centers by DAMAC team is seeking a highly skilled Mechanical Design Lead to oversee the design and implementation of our data center projects. As a key member of our team, you will be responsible for developing and managing the mechanical design process from concept to completion.This role requires a strong background in mechanical...

  • Data Engineer

    3 weeks ago

    Dubai, Dubai, United Arab Emirates ClickJobs Full time

    Do you love building andpioneering in the technology space? Do you enjoy solving complexbusiness problems in a fast-paced, collaborative, inclusive, anditerative delivery environment? At Capital One, you'll bepart of a big group of makers, breakers, doers and disruptors, whosolve real problems and meet real customer needs. We are seekingData Engineers who...

  • Data Engineer

    6 days ago

    Dubai, Dubai, United Arab Emirates ClickJobs Full time

    Do you love building andpioneering in the technology space? Do you enjoy solving complexbusiness problems in a fast-paced, collaborative, inclusive, anditerative delivery environment? At Capital One, you'll bepart of a big group of makers, breakers, doers and disruptors, whosolve real problems and meet real customer needs. We are seekingData Engineers who...

  • Data Engineer

    2 weeks ago

    Dubai, Dubai, United Arab Emirates Property Finder Group Full time

    Founded by Michael Lahyani in 2005 as a magazine (Al Bab World), Property Finder today is a single technology platform and brand across multiple countries in the MENA region. We offer the most advanced tools and best-in-class user experience for homeseekers, real estate brokers, and developers. Property Finder's most recent valuation secures our status among...

  • Data Engineer

    3 weeks ago

    Dubai, Dubai, United Arab Emirates Property Finder Group Full time

    Founded by Michael Lahyani in 2005 as a magazine (Al Bab World), Property Finder today is a single technology platform and brand across multiple countries in the MENA region. We offer the most advanced tools and best-in-class user experience for homeseekers, real estate brokers, and developers. Property Finder's most recent valuation secures our status among...

  • Data Engineer

    3 weeks ago

    Dubai, Dubai, United Arab Emirates Talent Pal Full time

    Job Summary: We are seeking an experienced professional with strong expertise in ETL mechanisms, particularly with Informatica Big Data Management 10.2.X and Spark/Hive execution engines. The ideal candidate should have expertise in dynamic mapping, data transformation, and loading of complex data sources, as well as a good understanding of Hadoop ecosystem...

  • Data Engineer

    3 weeks ago

    Dubai, Dubai, United Arab Emirates Property Finder Group Full time

    Roles and responsibilitiesDesign and ImplementInnovative Data Solutions: Develop and maintain advanced ETLpipelines using SQL, Python, and Generative AI, transformingtraditional data processes into highly efficient and automatedsolutions.Orchestrate Complex Data Workflows:Utilize tools such as Dagster and Airflow for sophisticatedpipeline orchestration,...

  • Data Engineer

    6 days ago

    Dubai, Dubai, United Arab Emirates Property Finder Group Full time

    Roles and responsibilities Design and ImplementInnovative Data Solutions: Develop and maintain advanced ETLpipelines using SQL, Python, and Generative AI, transformingtraditional data processes into highly efficient and automatedsolutions. Orchestrate Complex Data Workflows:Utilize tools such as Dagster and Airflow for sophisticatedpipeline orchestration,...

  • Data Engineer

    2 weeks ago

    Dubai, Dubai, United Arab Emirates Astek Middle East Full time

    We are seeking an experienced Data Engineer to join our team. The ideal candidate will have a proven track record of designing and implementing ETL/ELT solutions on modern, on-premises platforms . This role supports the development of enterprise data warehouses, data marts, and advanced analytics capabilities. To succeed in this position, you will need a...

  • Data Engineer

    1 week ago

    Dubai, Dubai, United Arab Emirates Overture Rede Full time

    Data Engineer Experience: 58YearsSummary: Experienced InformaticaPC and IDMC Developer with 5 years in data engineering. Skilled indesigning endtoend data pipelines using PC/IDMC for effectivemigration and transformation across cloud platforms. The idealcandidate will have indepth knowledge of Informatica PowerCenterand IDMC. A strong foundation in Data...

  • Data Engineer

    7 days ago

    Dubai, Dubai, United Arab Emirates Teachmecode Full time

    At Teachmecode, we're seeking a talented Python Engineer to join our team in Dubai. As a key member of our backend development team, you will be responsible for designing, building, and maintaining scalable and robust backend services using Python.We're looking for someone with a strong understanding of Big Data architectures and tools, including Hadoop,...