Lead Data Ops Engineer
3 weeks ago
The Lead Data Ops Engineer will play a critical role in building, scaling, automating, and maintaining the company's Big Data infrastructure and Machine Learning operations (MLOps). This individual will work in close collaboration with our Data Architect, Data Science, Data Engineering, and IT teams to ensure the development, deployment, and scale of robust, high-performance data processing systems and ML models.
KEY ACCOUNTABILITIES:
- Big Data Infrastructure: Design, build, and maintain high-performance, cloud-based, fault-tolerant, scalable distributed data infrastructure that supports the company's data-intensive applications (Real time/Batch/LLMs). This includes developing strategies for data storage (TBs), processing, and analysis, and implementing high-performance, scalable data pipelines for ML models and data products, supporting up to 50-60 use cases a year and thousands of IoT devices.
- Create infrastructure as Code, perform configuration and set up managed data services. Build and deploy a data science playground for research and prototyping for the professional and citizen data science program being rolled out and supporting 15-20 citizen data scientists/ambassadors.
- Machine Learning Operations (MLOps): Develop and manage the ML operational process, working closely with the data science team to implement ML models into production, including edge. This includes streamlining the ML lifecycle, from model development and testing to deployment and implementing the monitoring and alerting strategy.
- Automation and Scalability: Implement automation tools and frameworks to manage system updates/changes. Ensure that all systems and infrastructures can scale effectively with the increase in IoT sensors and devices.
- Continuous Integration and Deployment (CI/CD): Oversee continuous integration and continuous deployment practices for the data and ML pipeline, ensuring that software can be reliably released at any time.
- System Monitoring and Reliability: Monitor system performance and reliability to ensure high levels of performance, availability, and security. This includes identifying and fixing potential and existing system issues.
- Collaboration and Communication: Strong collaboration with Data Architect/Engineer, data scientists for the implementation and testing of new data services to provide an elastic data infrastructure.
- Security: Oversee and ensure that all Big Data and ML Ops platforms comply with the company's security standards and policies.
- Mentorship and Leadership: Act as a mentor to junior data members, providing guidance and support in their professional development.
- Innovation and Continuous Improvement: Stay up-to-date with industry trends and new technologies. Continuously explore innovative solutions and enhancements to the existing data architecture to improve its scalability, reliability, and efficiency.
- Problem Solving: Anticipate and resolve technical issues before they become roadblocks, maintaining the continuity of data flow and ensuring the highest levels of data quality and integrity.
AUTHORITY/DECISION MAKING:
- Infrastructure Design: Decide on the most effective design and implementation of the company's Big Data infrastructure.
- ML Ops Process: Make key decisions on the ML operational process, ensuring that ML models can be effectively integrated into production.
- Automation Tools: Choose the most appropriate automation tools and frameworks for the company's needs.
- CI/CD Practices: Determine the best practices for continuous integration and deployment in the context of the company's operations.
- System Monitoring: Make decisions on system monitoring strategies, including the selection of tools and responses to system performance metrics.
- Security Policies: Have a say in the implementation of security policies as they pertain to the Big Data and ML Ops platforms.
- Budget and Costing: Taking ownership of managing data platform costs and relevant data services.
QUALIFICATIONS & SKILLS:
- Bachelor's degree required, MS or PhD preferred.
- Bachelor's in Data Science, Computer Science, Engineering, Statistics and 10+ years of relevant experience.
- Experience: A minimum of 5-7 years of experience in a DevOps role, with a focus on managing Big Data infrastructures and MLOps.
- Technical Skills:
- Strong experience with Big Data technologies such as Hadoop, Spark, Kafka, etc.
- Proven expertise in managing and deploying ML models into production.
- Proficient in using CI/CD tools like Jenkins, Travis CI, CircleCI, etc.
- Proficient in using infrastructure automation tools like Terraform, Chef, Puppet, Ansible, etc.
- Strong knowledge of cloud platforms such as Azure (AWS, GCP).
- Experience with containerization technologies like Docker, Kubernetes, etc.
- Familiarity with various database technologies, both SQL and NoSQL.
- Proficiency in programming languages such as Python, Java, or Scala.
- Experience of leveraging MS/Azure ecosystem to manage the development and maintenance of cloud platform operations.
-
ML Ops Engineer
7 days ago
United Arab Emirates Marc Ellis Full timeJob Title: Machine Learning Operations (ML Ops) Engineer Location: Abu Dhabi, UAE About Us: AI71 is a dynamic applied research team dedicated to creating reliable, ethical, and innovative AI-driven solutions tailored for knowledge workers. As part of the Technology Innovation Institute (TII), we leverage cutting-edge research to develop solutions that...
-
Lead Data Engineer
3 weeks ago
United Arab Emirates Emirates Global Aluminium (EGA) Full timeA Lead Data Engineer works closely with a multidisciplinary Agile team to build high quality data pipelines driving analytic solutions. These solutions will generate insights allowing to advance data-driven decision-making capabilities. This role requires deep understanding of data architecture, data engineering, data analysis, reporting, and a basic...
-
United Arab Emirates The Chemical Engineer Full time£65 K to £110 K + housing allowance UAE Insurance risk Company Our client is a leading player in the International high hazard Insurance sector where it is involved in cover associated with a variety of sectors including oil and gas, refining, petrochemicals, LNG, metals, and mining, maritime, mass-transport and so on. The organisation's Gulf hub is...
-
Data Engineer
4 weeks ago
United Arab Emirates Involved Solutions Full timeOur client, a leading name in the insurance sector, is hiring a Data Engineer to drive their data innovation efforts.About the role:As a Data Engineer, you'll design and optimize data pipelines and systems to power business objectives. Your work will enable smarter decision-making and enhance efficiency across the organization. Build and maintain robust data...
-
Lead Civil Structural Designer
3 weeks ago
United Arab Emirates Lead Soluções Ambientais Full timeWood has been awarded a major project with ADNOC and, we are looking to hire a Lead Designer (Civil Structural) to be based at our Abu Dhabi Engineering Center. RESPONSIBILITIES Review Designs for O&G processing facilities and their associated infrastructure. Cooperate with other disciplines to ensure the timely realization of competitive, achievable and...
-
Data Engineer
7 days ago
United Arab Emirates ENTERTAINER FZ LLC Full timeAbout Us The ENTERTAINER is a leading digital company dedicated to adding value for consumers by bringing them the best incentive offers globally. We are a 100% digital, data-driven tech company providing first-rate offers across renowned dining, leisure, entertainment, and hotel brands worldwide. The ENTERTAINER has grown with the aim of creating...
-
Oil and Chemicals Insurance Risk Engineer
7 days ago
United Arab Emirates The Chemical Engineer Full timeSalary: £75,000 - £115,000 (max) + housing allowance Location: UAE Company: The company is a leading player in the International high hazard Insurance sector, involved in cover associated with various sectors including oil and gas, refining, petrochemicals, LNG, metals, mining, and maritime. The organisation's Gulf hub is enjoying significant client...
-
Data Science and Analytics Lead
1 day ago
United Arab Emirates titc Full timeWe represent a technology player whose digital banking platform is transforming financial services in emerging markets, making a real impact by embedding credit and savings products into the digital channels people use every day. Their data-driven technology powers MNOs, fintechs, and banks, enabling them to scale fast and drive financial inclusion for...
-
Data Science Lead
3 weeks ago
United Arab Emirates Michael Page Full timeAs the leading delivery company in the region, we have a great responsibility and opportunity to impact the lives of millions of customers, restaurant partners, and riders. To realize our potential, we need to advance our platform to become much more intelligent in how it understands and serves our users. As a data scientist on the algorithms track, your...
-
Data Science Lead
1 day ago
United Arab Emirates Michael Page Full timeAs the leading delivery company in the region, we have a great responsibility and opportunity to impact the lives of millions of customers, restaurant partners, and riders. To realize our potential, we need to advance our platform to become much more intelligent in how it understands and serves our users. As a data scientist on the algorithms track, your...
-
Data Engineer
3 weeks ago
United Arab Emirates Lune Full timeThe data engineer is responsible for designing, implementing, and maintaining the systems and processes necessary for efficient data collection, storage, and analysis. They work closely with the product team, data labeling team, and other stakeholders to understand data requirements and ensure that data pipelines are robust, scalable, and optimized for...
-
Senior Data Analyst
7 days ago
United Arab Emirates Alpha Data Full timeJob Responsibilities Patient leads origination – originate patient referral leads from hospitals and referring physicians, establish and demonstrate an active network of referrals. Patient relations – maintain direct contact with the family/patient and engage nursing and rehabilitation operations teams to execute on patient care, catering to all...
-
Data Engineer
7 days ago
United Arab Emirates Traverse Technology Services Full timeJob Title: Data Engineer – Finance SystemsJob Type: Long-term Contract | RemoteJob Location: Remote in EgyptJob Description: We are hiring an experienced Data Engineer to support finance systems, including OFSAA, Financial Consolidation, and Regulatory Reporting . The ideal candidate will have expertise in ETL processes, data modeling, and big data...
-
Data Engineer
4 weeks ago
United Arab Emirates HEMOdata Full timeJOB DESCRIPTION Data Engineer Role - Remote About HEMOdata HEMOdata is a Data Solutions Consultancy helping organisations across the Middle East to elevate their data strategy, ensure compliance and supercharge customer conversions with our expertise in integrating a best-in-breed technology ecosystem. Based in Dubai and established in May 2022, we have...
-
Data Engineer
7 days ago
United Arab Emirates RP International Full timeWe're looking for a Data Engineer to design and maintain scalable data pipelines and models that support analytics and business intelligence. You'll play a key role in ensuring seamless data flow, optimizing performance, and maintaining data integrity across various functions for our client in United Arab Emirates. What You'll Do Develop & Manage Pipelines...
-
Data Engineer
3 weeks ago
United Arab Emirates DuneSoft Full timeA data engineer is an IT worker whose primary job is to prepare data for analytical or operational uses. These software engineers are typically responsible for building data pipelines to bring together information from different source systems. Overview You will be responsible for: Designing and implementing Big Data systems (e.g. data warehouses, data...
-
Product Strategy and Ops
1 day ago
United Arab Emirates Huspy Full timeThe Story so far: Who we are Founded in August 2020, Huspy started as a digital mortgage platform and quickly evolved into the largest proptech company in the EMEA region. Backed by leading investors such as Sequoia, Balderton, Founders Fund, and Olayan, we have experienced rapid growth with offices in Dubai, Abu Dhabi, Madrid, and Valencia. Our mission is...
-
Senior Data Engineer
1 day ago
United Arab Emirates Elevon Core Full timeOur team comprises highly skilled professionals who bring a wealth of international experience in technology entrepreneurship. We thrive on ambition and recognize that fun and performance go hand in hand. Together, we create a dynamic environment where excellence is the currency of success. Position Overview As a Data Engineer, you will play a crucial role...
-
AI Data Engineer
7 days ago
United Arab Emirates Austin Werner Full timeAI Data Engineer - Fintech/Financial Services, Data Analytics, AI, SQL, Python This role can be based in Dubai, Istanbul or Vienna Austin Werner, a reputable Crypto and Fintech recruitment business with a footprint in the UK and UAE, is pleased to present an exclusive opportunity for a number of Data Engineers to join a brand new AI team at an extremely...
-
Data Engineer
3 weeks ago
United Arab Emirates ParamInfo Full timeRoles and responsibilities Data Engineer Location : Dubai We are looking for Experience upto: 5-8 Years Summary: Experienced Informatica PC and IDMC Developer with 5+ years in data engineering. Skilled in designing end-to-end data pipelines using PC/IDMC for effective migration and transformation across cloud platforms. The ideal candidate will have...