Data Engineer

4 days ago


Abu Dhabi, Abu Dhabi, United Arab Emirates Avrioc Technologies Full time

About the Role:

As part of a cross-functional team of engineers, data scientists, and product owners you will be responsible for designing, implementing, optimizing, and evaluating our product (specific product language here) algorithms. If you love seeing your ideas blossom through their whole life cycle from concept to governing the interaction with millions of users - then Avrioc is the place to be for you

Responsibilities

  • Collaborate with various stakeholders to deeply understand the needs of data practitioners and deliver at scale.
  • Help define, build, and maintain the Data Platform.
  • Work with emerging technologies to build distributed applications.
  • Manage end-to-end development efforts for timely delivery of high-quality solutions that meet requirements, align with the architectural vision, and comply with applicable standards.
  • Present technical solutions, capabilities, considerations, and features in business terms.
  • Contribute to critical initiatives such as Data Discovery, Data Lineage, and Data Quality.
  • Build data systems, pipelines, analytical tools, and programs.
  • Conduct complex data analyses and report on results.

Skills and Attributes

  • Strong technical expertise in data modeling, data ingestion, distributed processing, data warehousing, and ETL processes.
  • Experience with Apache Kafka and Spark Streaming.
  • Exposure to connecting and querying different data sources, including NoSQL databases (e.g., MongoDB), MySQL, Elasticsearch, and Kafka topics.
  • Proficiency in SQL, Python, PySpark, Spark SQL, and a solid understanding of the Databricks platform.
  • Ability to build large-scale batch and real-time data pipelines.
  • Knowledge of best practices for optimizing Databricks cluster configurations (size, type, memory) based on data requirements and delivering optimized code.
  • Experience in maintaining, monitoring, and handling enhancement requests for data pipelines.
  • Familiarity with visualization tools such as Kibana and QlikView.
  • Exposure to Docker, Kubernetes, and GitLab.
  • Experience with JIRA processes and Confluence for documentation and project management.

Qualification & Requirements

  • Degree in Computer Science, Data Science, Mathematics, IT, or a related field.
  • 5 years of Experience as a data engineer or similar role.
#J-18808-Ljbffr

  • Abu Dhabi, Abu Dhabi, United Arab Emirates Alpha Data Full time

    Job OverviewWe are seeking a skilled Data Protection Engineer to join our team at Alpha Data. In this role, you will be responsible for administering and managing Veeam Backup as a service platform, including vCloud Connect, Kasten, and VBR.Key ResponsibilitiesDevelop customized plans to maximize value from Veeam products and services.Identify pain points...


  • Abu Dhabi, Abu Dhabi, United Arab Emirates Gulf Data International Full time

    How to apply: Data & Integration SpecialistGDI takes pride in creating opportunities for personal growth and achievement. To apply for a job opening, please email your latest CV in MS Word or PDF format to careers@gdi.ae, with the job title applied for in the subject line.Job DescriptionWe are actively seeking a Data & Integration Specialist with expertise...


  • Abu Dhabi, Abu Dhabi, United Arab Emirates Gulf Data International Full time

    How to apply: Data & Integration Specialist GDI takes pride in creating opportunities for personal growth and achievement. To apply for a job opening, please email your latest CV in MS Word or PDF format to , with the job title applied for in the subject line. Job Description We are actively seeking a Data & Integration Specialist with expertise in...


  • Abu Dhabi, Abu Dhabi, United Arab Emirates The Chemical Engineer Full time

    JOB DESCRIPTION Remarkable people, trusted by clients to design and advance the world. The Role This is an exciting opportunity for an experienced PMC Senior Process Safety Engineer with a proven track record in implementation and management of process safety systems, mitigating risks and ensuring compliance with safety standards in oil and gas...


  • Abu Dhabi, Abu Dhabi, United Arab Emirates Alpha Data LLC. Full time

    Alpha Data LLC - Multimedia Systems Engineer PositionWe are seeking a highly skilled Multimedia Systems Engineer to join our team at Alpha Data LLC. This role involves the design, installation, and maintenance of multimedia systems in various settings.The ideal candidate will have experience working with AV systems, including displays, audio systems, control...

  • Data Engineer

    3 weeks ago


    Abu Dhabi, Abu Dhabi, United Arab Emirates Talent Pal Full time

    How you can make yourmarkAre you currently searching for adata engineering job that offers the opportunity to work onglobally impactful operations all while being part of a dynamic andenthusiastic teamImagine automating the realtimesensor data from our fleet and supporting on NOx reduction forsustainability reporting. In this role you will have the chance...

  • Data Engineer

    7 days ago


    Abu Dhabi, Abu Dhabi, United Arab Emirates Presight Full time

    Overview Role: Data Engineer Location: Abu Dhabi About Presight Presight is an ADX-listed public company with Abu Dhabi based G42 as its majority shareholder and is the region's leading big data analytics company powered by GenAI. It combines big data, analytics, and AI expertise to serve every sector, of every scale, to create business and positive...


  • Abu Dhabi, Abu Dhabi, United Arab Emirates Alpha Data LLC. Full time

    Job DescriptionWe are seeking an experienced Audiovisual Systems Engineer to join our team at Alpha Data LLC. As a key member of our technical staff, you will be responsible for the design, installation, and commissioning of complex audiovisual systems.Your primary focus will be on ensuring that all systems meet the required specifications and are properly...

  • Lead Data Engineer

    3 weeks ago


    Abu Dhabi, Abu Dhabi, United Arab Emirates Dicetek LLC Full time

    Roles and ResponsibilitiesOverall 5-7 years of experience in data engineering and transformation on Cloud3+ Years of Very Strong Experience in Azure Data Engineering, DatabricksExpertise in supporting/developing lakehouse workloads at enterprise levelExperience in pyspark is required – developing and deploying the workloads to run on the Spark distributed...

  • Data Engineer Leader

    7 hours ago


    Abu Dhabi, Abu Dhabi, United Arab Emirates CAREEM Full time

    About the RoleCAREEM is seeking an experienced Data Warehouse Engineer to join our team. This role will play a critical part in designing, developing, and maintaining our data infrastructure.Develop and maintain robust, scalable, and high-performance data pipelines and ETL processes using various tools and technologies.Collaborate with stakeholders to...


  • Abu Dhabi, Abu Dhabi, United Arab Emirates CAREEM Full time

    Roles and responsibilitiesWe are seeking a highly skilled andmotivated Data Warehouse Engineer to join our team. As a DataWarehouse Engineer, you will play a critical role in designing,developing, and maintaining our data infrastructure, ensuring theavailability, scalability, and reliability of our data systems. Youwill collaborate closely with...


  • Abu Dhabi, Abu Dhabi, United Arab Emirates CAREEM Full time

    Roles and responsibilities We are seeking a highly skilled andmotivated Data Warehouse Engineer to join our team. As a DataWarehouse Engineer, you will play a critical role in designing,developing, and maintaining our data infrastructure, ensuring theavailability, scalability, and reliability of our data systems. Youwill collaborate closely with...


  • Abu Dhabi, Abu Dhabi, United Arab Emirates CAREEM Full time

    Roles and responsibilitiesWe are seeking a highly skilled andmotivated Data Warehouse Engineer to join our team. As a DataWarehouse Engineer, you will play a critical role in designing,developing, and maintaining our data infrastructure, ensuring theavailability, scalability, and reliability of our data systems. Youwill collaborate closely with...

  • Senior Data Engineer

    2 weeks ago


    Abu Dhabi, Abu Dhabi, United Arab Emirates Deeplight AI Full time

    About DeepLight: DeepLight is a pioneering AI company committed to pushing the boundaries of innovation in artificial intelligence. Our mission is to harness the power of data and machine learning to revolutionize industries and create a brighter future. With a dynamic team of experts and a culture of relentless innovation, we are at the forefront of AI...


  • Abu Dhabi, Abu Dhabi, United Arab Emirates Avrioc Technologies Full time

    About UsAvrioc Technologies is a cutting-edge company that excels in designing and implementing innovative data solutions. We are seeking an experienced Data Engineer Specialist to join our team of talented engineers, data scientists, and product owners.

  • Lead Data Engineer

    3 weeks ago


    Abu Dhabi, Abu Dhabi, United Arab Emirates Dicetek LLC Full time

    Roles and responsibilitiesOverall 5-7 years ofexperience in data engineering and transformation onCloud3+ Years of Very Strong Experience inAzure Data Engineering, DatabricksExpertise insupporting/developing lakehouse workloads at enterpriselevelExperience in pyspark is required– developing and deploying the workloads to run on theSpark distributed...

  • Lead Data Engineer

    1 week ago


    Abu Dhabi, Abu Dhabi, United Arab Emirates Dicetek LLC Full time

    Roles and responsibilitiesOverall 5-7 years ofexperience in data engineering and transformation onCloud3+ Years of Very Strong Experience inAzure Data Engineering, DatabricksExpertise insupporting/developing lakehouse workloads at enterpriselevelExperience in pyspark is required– developing and deploying the workloads to run on theSpark distributed...

  • Lead Data Engineer

    1 day ago


    Abu Dhabi, Abu Dhabi, United Arab Emirates Dicetek LLC Full time

    Roles and responsibilities Overall 5-7 years ofexperience in data engineering and transformation onCloud 3+ Years of Very Strong Experience inAzure Data Engineering, Databricks Expertise insupporting/developing lakehouse workloads at enterpriselevel Experience in pyspark is required– developing and deploying the workloads to run on theSpark distributed...


  • Abu Dhabi, Abu Dhabi, United Arab Emirates Sense7ai Data Solution Pvt Ltd Full time

    This is a remoteposition.ProjectPartners has a passion for delivering projects. Not justsuccessfully, but on-time and to budget We started thisjourney on a mission to empower people to deliver projectssuccessfully. Being project professionals ourselves we know whatworks.Our insider knowledge means we know exactly whatgreat project delivery needs. We went on...


  • Abu Dhabi, Abu Dhabi, United Arab Emirates Sense7ai Data Solution Pvt Ltd Full time

    This is a remoteposition. ProjectPartners has a passion for delivering projects. Not justsuccessfully, but on-time and to budget We started thisjourney on a mission to empower people to deliver projectssuccessfully. Being project professionals ourselves we know whatworks.Our insider knowledge means we know exactly whatgreat project delivery needs. We went on...