Data Engineer
3 days ago
**HIRING**
For this specific position, the client is only considering candidates who are based in the UAE.
Job Title – Data Engineer
Salary – MAX AED 30,000 Per Month
Contract Length – 1 Year Contract with the view to extend
Location – Abu Dhabi
Start Date – ASAP
My customer is a specialist AI and data consultancy with extensive experience implementing intelligent enterprise systems across multiple industries, with particular depth in financial services banking, and government.
The Data Engineer is responsible for designing, implementing, and optimising data pipelines and infrastructure to support the cutting-edge AI systems. The Data Engineer collaborates closely with a multidisciplinary team to ensure the efficient collection, storage, processing, and analysis of large-scale data, enabling them to unlock valuable insights and drive innovation across various domains.
Responsibilities
- Design, develop, and maintain scalable and reliable data pipelines to ingest, transform, and load diverse datasets from various sources, including structured and unstructured data, streaming data, and real-time feeds
- Implement robust data integration processes to seamlessly integrate data from different sources, ensuring consistency, reliability, and data quality.
- Design and optimize data storage solutions, including relational databases, NoSQL databases, data lakes, and cloud storage services, to efficiently store and manage large volumes of data.
- Optimise data processing and query performance to enhance system scalability, reliability, and efficiency, leveraging techniques such as indexing, partitioning, caching, and parallel processing.
- Implement data governance frameworks to ensure data security, privacy, integrity, and compliance with regulatory requirements, including data encryption, access controls, and auditing.
- Monitor data pipelines and infrastructure components, proactively identify and address issues, and perform routine maintenance tasks to ensure system stability and reliability
- Collaborate closely with cross-functional teams, including data scientists, architects, and domain experts, to understand requirements, gather insights, and deliver integrated solutions.
- Create comprehensive documentation, including technical specifications, data flow diagrams, and operational procedures, to facilitate understanding, collaboration, and knowledge sharing
Essential Capabilities
- Proven demonstrable experience with Databricks
- Proven experience as a Data Engineer, with a track record of designing and implementing complex data pipelines and infrastructure solutions.
- Expertise in data modelling, ETL processes, and data warehousing concepts, with proficiency in SQL and scripting languages (e.g., Python)
- Strong hands-on experience with big data technologies and frameworks, such as, PySpark, Spark, Kafka, as well as cloud platforms (e.g., AWS, Azure)
- Familiarity with containerization and orchestration technologies, such as Docker and Kubernetes, and DevOps practices for CI/CD (Continuous Integration/Continuous Deployment).
- Excellent analytical, problem-solving, and communication skills, with the ability to translate complex technical concepts into clear and actionable insights.
- Proven ability to work effectively in a fast-paced, collaborative environment, with a passion for innovation and continuous learning
Thanks,
Ollie
-
Data Engineer
22 hours ago
Abu Dhabi, Abu Dhabi, United Arab Emirates Institute Of Foundation Models Full timeAs a Data Engineer specializing in Natural Language Processing (NLP) and large-scale data processing, you will quickly and effectively gather, curate, and prepare high-quality datasets to support cutting-edge NLP research. Your role will be instrumental in enabling researchers by delivering essential data through efficient and scalable engineering practices,...
-
Data Engineer
2 weeks ago
Abu Dhabi, Abu Dhabi, United Arab Emirates Durlston Partners Full timeRole: Data EngineerClient: Quant Trading FirmSalary: Up to $300,000 (tax-free)Location: Abu Dhabi, UAE (full relocation assistance provided)Durlston Partners is partnering with a leading Quant Trading firm that leverages advanced data and technology to execute market-beating strategies. They are seeking a Data Engineer to design, build, and scale the...
-
Data Engineer
1 week ago
Abu Dhabi, Abu Dhabi, United Arab Emirates Adecco Full timeRole OverviewWe are seeking a highly skilledData Engineerto design, build, and optimize scalable data platforms that power analytics, regulatory reporting, and AI-driven innovation. The ideal candidate has strong cloud experience, deep understanding of distributed data systems, and a passion for building reliable, high-performance data...
-
Data Engineer
22 hours ago
Abu Dhabi, Abu Dhabi, United Arab Emirates Inception Full time*Overview:We are looking for aData Engineer*who can build scalable data pipelines while also developing intelligent AI solutions using Azure Agent Foundry, OpenAI services, LangChain, Databricks, and modern cloud architectures. The ideal candidate has strong data engineering foundations combined with hands-on experience designing and deploying...
-
Data Engineer
1 week ago
Abu Dhabi, Abu Dhabi, United Arab Emirates ClearPeaks Full timeClearPeaks is a specialist consulting firm delivering services and solutions in "Everything Data" - Business Intelligence, Advanced Analytics, Big Data & Cloud, and Web & Mobile Applications. Founded in 2000, we have been a trusted partner to our customers in over 15 industry verticals and functional areas, with operations spanning Europe, Middle East, the...
-
Data Engineer
1 week ago
Abu Dhabi, Abu Dhabi, United Arab Emirates Dicetek LLC Full timeKey ResponsibilitiesAnalyze and interpret large datasets to generate actionable insights for business stakeholders.Design, develop and maintain conceptual and physical data model for both on-premise and cloud database environments.Collaborate with Data Engineers, Architects and Business analysts to ensure proper implementation of data models in data...
-
Data Engineer
1 week ago
Abu Dhabi, Abu Dhabi, United Arab Emirates DICETEK LLC Full timeKey Responsibilities:Analyze and interpret large datasets to generate actionable insights for business stakeholders.Design, develop and maintain conceptual and physical data model for both on-premise and cloud database environments.Collaborate with Data Engineers, Architects and Business analysts to ensure proper implementation of data models in data...
-
Head of Data Engineering
6 days ago
Abu Dhabi, Abu Dhabi, United Arab Emirates Arcus Search Full timeArcus Search have partnered with a leading Financial Services organisation in Abu Dhabi, who are looking for a Head of Data Engineering (Emirati) to join the team. More details are below:Role: Head of Data EngineeringLocation: Abu Dhabi - possibly could be based in Dubai tooBudget: 45, ,000 AEDThe role:This role owns the organisation's data platform and...
-
Integration and Data Engineer
21 hours ago
Abu Dhabi, Abu Dhabi, United Arab Emirates Penta Consulting Full timeThis role is a hybrid position that bridges the gap between real-time interoperability (Integration) and strategic analytical infrastructure (Data Engineering).The Integration and Data Engineer acts as the bridge between the our client's core systems and its AI-driven future. You will design and manage the data pipelines that fuel our AI models. This...
-
Data Engineer
22 hours ago
Abu Dhabi, Abu Dhabi, United Arab Emirates GlobalXperts Technology Full timeJob Title: Data EngineerLocation: UAE (Onsite)Experience : 5+ yearsNotice Period : Immediate Joiners preferredRole SummaryResponsible for building scalable data pipelines, ensuring data quality and governance, and delivering reliable Power BI analytics solutions to support business decision-making.Key ResponsibilitiesDesign, build, and maintain ETL/ELT...