Big Data Engineer

1 week ago


Dubai, Dubai, United Arab Emirates Asterix Communications Full time

About Us

Erbis is a software development company with offices in the US, UK, Poland, and Ukraine. The majority of our customers come from the EU and the US. We undertake project implementation on our side or augment the clients' in-house teams. Now, our team consists of 100+ IT professionals with expertise across domains. We help enterprises and SMBs create software solutions that make the world a better place :)

About The Role

We are looking for talented Big Data Engineers to join our dynamic team for an exciting new project. This is a unique opportunity to work on a cutting-edge initiative, building a team from scratch in a fast-paced environment. If you are passionate about big data technologies and ready for a new challenge, we want to hear from you This long-term project requires engineers to join ASAP and relocate to the Middle East.

Requirements
  1. Proficient in Hadoop and the HDFS ecosystem.
  2. At least 3 years of experience in Data Engineering.
  3. Extensive familiarity with Cloudera Data Platform and its runtime components.
  4. Strong expertise with Apache Spark.
  5. Hands-on experience with one or more programming languages such as Python, Go, or Java.
  6. Solid foundational knowledge of computer software, including Linux operating systems, storage, network I/O, and related principles.
  7. Experience with computing, distributed, or big data systems (e.g., Nginx, Kubernetes, Docker, OpenStack, Kafka) is advantageous.
  8. Highly preferred to have good data structure and system design skills.
Responsibilities
  1. Oversee the setup, configuration, and maintenance of Hadoop clusters and the HDFS ecosystem.
  2. Ensure data integrity and availability across the Hadoop Distributed File System.
  3. Design, develop, and maintain scalable data pipelines.
  4. Implement data ingestion processes to capture and store large volumes of data efficiently.
  5. Collaborate with data scientists and analysts to support their data needs.
  6. Manage and optimize the Cloudera Data Platform and its runtime components.
  7. Monitor system performance and troubleshoot issues to ensure high availability and reliability.
  8. Develop and maintain Apache Spark applications for data processing.
  9. Write and maintain code in programming languages such as Python, Go, or Java.
  10. Apply solid foundational knowledge of computer software, including Linux operating systems, storage, network I/O, and related principles.
  11. Utilize experience with computing, distributed, or big data systems (e.g., Nginx, Kubernetes, Docker, OpenStack, Kafka).
  12. Apply strong data structure and system design skills to develop reliable solutions.

#J-18808-Ljbffr
  • Big Data Engineer

    1 week ago


    Dubai, Dubai, United Arab Emirates Big Fish Recruitment Full time

    The job posting is outdated and position may be filledJob Alert You will be updated with latest job alerts via emailValid email field requiredSend jobsJob Alert You will be updated with latest job alerts via emailValid email field requiredSend jobsLiaising with coworkers and clients to elucidate the requirements for each task.Conceptualizing and generating...

  • Big Data Engineer

    1 week ago


    Dubai, Dubai, United Arab Emirates Apple Dubai Full time

    The job posting is outdated and position may be filled Meeting with managers to determine the company's Big Data needs.Developing Hadoop systems.Loading disparate data sets and conducting pre-processing services using Hive or Pig.Finalizing the scope of the system and delivering Big Data solutions.Managing the communications between the internal system and...

  • Big Data Architect

    1 week ago


    Dubai, Dubai, United Arab Emirates Profecia Links Full time

    Proficiency in programming languages like Java/Scala is desired, along with a solid understanding of Big Data technologies such as Apache Pinot/Druid/Hudi, HDFS, Hive, Presto, Flume, Storm, Kafka, Spark, and NO-SQL databases. Experience in crafting and managing highthroughput, lowlatency data platforms tailored for realtime analytics is highly valued....


  • Dubai, Dubai, United Arab Emirates Precision Hire Solution Full time

    Job Purpose: At Emirates we believe in connecting the world to and through our global hub in Dubai; and in constantly innovating to ensure our customers Fly Better. Join the Emirates Group IT Team in Dubai. Emirates Group IT thrives on the dynamic nature of technology. Being pioneers in aviation innovation were always at the forefront pushing boundaries....

  • Big ID Engineer

    2 months ago


    Dubai, Dubai, United Arab Emirates Gulf Career Hunt Full time

    We are Hiring for a Data Privacy (Big ID)Engineer, Candidates who are willing to relocate to Dubai or Local in Dubai, Job Description:Title: Big ID EngineerExperience: 10+ yearsJob Location: DubaiJob DescriptionEssential Job Duties and Responsibilities: Implement BigID for a large Telecommunication client. Deliver on the following key functions: BIGID...

  • Online Big Data tutor

    2 months ago


    Dubai Festival City, Dubai, United Arab Emirates TeacherOn Full time

    I need someone to help me for BIG DATA ASSIGNMENT + remotingLevel: Intermediate Gender Preference: NoneMeeting options: Available online - via skype etc.

  • Data Engineer

    1 week ago


    Dubai, Dubai, United Arab Emirates SimplyApply Full time

    Data EngineerDo you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking...

  • Data Engineer

    1 week ago


    Dubai, Dubai, United Arab Emirates SimplyApply Full time

    Data EngineerDo you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking...

  • Data Engineer

    1 week ago


    Dubai, Dubai, United Arab Emirates SimplyApply Full time

    Data EngineerDo you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking...

  • Data Engineer

    1 week ago


    Dubai, Dubai, United Arab Emirates dubizzle Full time

    Data Engineer | Intern Dubizzle Dubaidubizzle is the UAE'S favorite marketplace to buy, sell and find anything. If you can search for it, you can find it on dubizzle From Batmobiles to Dinosaur bones to a Boeing 747Bayut & dubizzle – The Arab World's only Homegrown Unicorn Business is now inviting applications for internships of 6 months duration in our...

  • Online Big Data tutor

    3 weeks ago


    Dubai Festival City, Dubai, United Arab Emirates TeacherOn Full time

    need someone to help me for BIG DATA ASSIGNMENT + remoting working on my system Kindly check for the pdf Payment PayPalDeadline today 12 amLevel: ExpertGender Preference: Preferably maleMeeting options:Available online - via skype etc.

  • Online Big Data tutor

    2 months ago


    Dubai Festival City, Dubai, United Arab Emirates TeacherOn Full time

    need someone to help me for BIG DATA ASSIGNMENT + remoting working on my system Kindly check for the pdf Payment PayPalDeadline today 12 amLevel: ExpertGender Preference: Preferably maleMeeting options:Available online - via skype etc.


  • Dubai, Dubai, United Arab Emirates University of Wollongong in Dubai Full time

    Position ProfileUOWD is currently seeking applicants to fill the position of Instructor - Computer Science (Permanent Full Time) with the Faculty of Engineering & Information Sciences. The Instructor position is suitable for applicants who are looking to gain experience to develop their scholarly career.The position holder is also expected to conduct...


  • Dubai, Dubai, United Arab Emirates Crayon Data Full time

    The job posting is outdated and position may be filled Crayon Data is a fast-growing big data and AI company, founded in 2012 with a vision to simplify the world s choices. Crayons is the world s first AI engine that engages customers through taste-led customization and increases conversion rates for enterprises.Who are we looking for?In this role, you ll...

  • Data Engineer

    1 week ago


    Dubai, Dubai, United Arab Emirates JobItUs Full time

    Work Experience: 5.0 Year(s) To 12.0 Year(s)Function: IT Software - System Programming Notice Period : Early joiners preferred (Maximum 30 days)Job Description:We are looking for a highly skilled and motivated Spark Data Engineer to join our team. The ideal candidate will have a strong background in Apache Spark, data ingestion, data processing, and data...


  • Dubai, Dubai, United Arab Emirates Core42 Full time

    Requirements to excel in this roleBachelor's degree in Computer Science, Engineering, Mathematics, or a related field; or equivalent work experience.5+ years of experience in a Data Engineering role.Proficiency in SQL and programming languages like Python, Java, and Scala.Hands-on experience with big data technologies like Hadoop, Spark, and...


  • Dubai, Dubai, United Arab Emirates Core42 Full time

    Qualifications for Success:Bachelor's degree in Computer Science, Engineering, Mathematics, or related field; or equivalent work experience.5+ years of experience in a Data Engineering role.Proficiency in SQL and programming languages like Python, Java, and Scala.Hands-on experience with big data technologies like Hadoop, Spark, and Flink.Familiarity with...

  • Data Engineer

    1 week ago


    Dubai, Dubai, United Arab Emirates Asterix Communications Full time

    Role: Data EngineerSkill: Informatica BDM 10.2.x, ETL, Big Data, Hadoop ecosystemDescription:Should have Strong expertise of Extraction, Transformation and Loading (ETL) mechanism using Informatica Big Data Management 10.2.X and various Push down mode using Spark, Blaze and Hive execution engine.Should have Strong expertise of Dynamic mapping Use case,...


  • Dubai, Dubai, United Arab Emirates Core42 Full time

    QualificationsSkills and attributes to success:Bachelor's degree in Computer Science, Engineering, Mathematics, or a related field; or equivalent work experience.5+ years of experience in a Data Engineering role.Proficiency in SQL and programming languages like Python, Java, and Scala.Hands-on experience with big data technologies like Hadoop, Spark and...


  • Dubai, Dubai, United Arab Emirates Core42 Full time

    QualificationsSkills and attributes to success Bachelor's degree in Computer Science, Engineering, Mathematics, or a related field; or equivalent work experience.5+ years of experience in a Data Engineering role.Proficiency in SQL and programming languages like Python, Java, and Scala.Hands-on experience with big data technologies like Hadoop, Spark and...