Senior Data Engineer

7 days ago

Abu Dhabi, Abu Dhabi, United Arab Emirates G42 Full time
Overview

As a Senior Data Engineer at Inception, you will be responsible for building and maintaining the infrastructure that supports data collection, processing, and storage. Reporting to the Lead Data Engineer or Principal Data Engineering, you will work closely with data scientists, analysts, and other stakeholders to ensure that data systems are reliable, scalable, and secure. Your work will be crucial in enabling data-driven decision-making across the organization.

The Data Engineer is a key technical role focused on developing and optimizing the company's data infrastructure. This role involves designing and implementing data pipelines, ensuring data quality, and collaborating with cross-functional teams to support various data initiatives. The ideal candidate will have strong technical skills in data engineering, experience with data architectures, and a passion for working with data.

Inception is the UAE's national-scale enabler in AI Research and Development. Partnering with Microsoft's AI SaaS, we offer domain-specific Agentic AI Orchestrator platforms utilizing reasoning agents for precise and cost-effective services. Our focus includes AI incubation, IP creation, applied AI R&D, and AI investment products.

Responsibilities

As a Senior Data Engineer, you will be responsible for developing and maintaining data systems to support the company's strategic goals. Your role will encompass a range of activities focused on data pipeline development, data quality, and cross-functional collaboration.

  1. Data Pipeline Architecture and Development: Design, construct, install, test, and maintain highly scalable data pipelines with a focus on machine learning models and analytics.
  2. Data Integration: Work closely with data scientists, ML engineers, and stakeholders to ensure that data is accessible, consistent, and reliable for ongoing projects.
  3. API and Data Services: Develop and maintain APIs for data access and manipulation, and integrate with external data services as needed.
  4. Data Storage: Manage and optimize data storage solutions for both structured and unstructured data, where structured data includes relational databases and unstructured data includes Text, Image, Audio, Video, Search Engines like Elasticsearch and NoSQL databases, to support machine learning models.
  5. Data Quality and Governance: Implement processes to monitor data quality and ensure production data is always accurate and available for key stakeholders.
  6. Collaboration and Support: Collaborate with ML engineers to assist in data-related technical issues and provide architectural guidance and solutions.
  7. Security and Compliance: Ensure compliance with data security and privacy policies.
  8. Documentation: Maintain clear and up-to-date documentation including data dictionaries, metadata, and architectural diagrams.
Qualifications

Skills and attributes for success:

  1. Bachelor's degree in Computer Science, Engineering, Mathematics, or a related field; or equivalent work experience.
  2. 7+ years of experience in a Data Engineering role.
  3. Proficiency in programming languages like Python, Java, and Scala and managing large-scale data (potentially Terabyte to Petabyte).
  4. Hands-on experience with big data technologies like Hadoop, Spark, and Flink.
  5. Familiarity with machine learning frameworks such as TensorFlow, PyTorch, or similar.
  6. Strong understanding of data warehousing concepts, ETL processes, and data modeling.
  7. Experience with API development and integration with data services.
  8. Experience with cloud platforms like Azure.
  9. Knowledge in DevOps, CI/CD methods, and containerization technologies like Docker or Kubernetes.
  10. Experience with real-time/streaming data processing.

Technical stack:

  1. Programming Languages: Python, Java, Scala, SQL, Bash
  2. Big Data Technologies: Hadoop, Spark, Flink
  3. Unstructured Data: Text, Image, Audio & Video
  4. Databases: MySQL, PostgreSQL, MongoDB, Cassandra, HBase, Redis
  5. Cloud Platforms: Azure
  6. API Development: RESTful APIs, GraphQL, OpenAPI
  7. Data Services: Kafka, RabbitMQ
  8. Containers: Docker, Kubernetes

What we look for: If you are a performance-driven, inquisitive mind with the agility to adapt to ambiguity, you will fit right in. You should be eager to explore opportunities to build meaningful collaborations with stakeholders and aspire to create unique customer-centric solutions. Bias for action and a passion to conquer new frontiers in the AI space is at the heart of the Inception community.

What working at Inception offers:

  1. Culture: An open, diverse, and inclusive environment with a global vision that encourages personal growth and focuses on ground-breaking, industry-first innovations.
  2. Career: Outstanding learning, development & growth opportunities via structured training programs and innovative, high-tech projects.
  3. Work-Life: A hybrid work policy to strike the perfect balance between office and home.
  4. Rewards: A competitive remuneration package with a host of perks including healthcare, education support, leave benefits, and more.

If you can confidently demonstrate that you meet the criteria above, please contact us as soon as possible.

#J-18808-Ljbffr

  • Senior Chemical Engineer

    13 hours ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates The Chemical Engineer Full time

    We are seeking a skilled PMC Senior Process Engineer to lead our process engineering team in delivering high-profile projects to clients across the energy sector. As a member of our team, you will be responsible for ensuring all process engineering deliverables are completed on time and to the highest quality standards.Key ResponsibilitiesTo manage the...

  • Engineering Solutions Manager

    2 days ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates The Chemical Engineer Full time

    We are seeking a highly skilled Senior Process Designer to join our team at The Chemical Engineer. As a Senior Process Designer, you will be responsible for developing and optimizing process designs, ensuring efficiency, safety, and regulatory compliance.About the JobThe Senior Process Designer will work closely with engineering teams to develop and optimize...

  • Help Desk Engineer

    6 days ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates Alpha Data Full time

    Job SummaryWe are seeking a highly experienced Help Desk Engineer to join our team at Alpha Data.In this role, you will be responsible for providing technical support to our clients, troubleshooting complex issues, and collaborating with senior engineers to resolve escalated problems.The ideal candidate will have a strong background in IT, excellent...

  • Senior Engineer, Piping

    4 weeks ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates Tampa Gardens Senior Living Full time

    Provide Engineering support and technical expertise to operating plants & pipeline, projects related to Pipeline discipline through all phases of project.. Acts as subject matter expert for Pipeline (Offshore & Onshore), participating in project implementation, peer reviews for other business units/areas, modifications, upgrading, capacity improvement...

  • Data Protection Specialist

    7 days ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates Alpha Data Full time

    About the PositionWe are looking for an experienced Veeam Backup Engineer to join our team at Alpha Data. As a key member of our IT services delivery team, you will be responsible for the administration and management of Veeam Backup as a service platform (vCloud Connect), Kasten, and VBR.Main ResponsibilitiesService Platform Administration: Ensure the...

  • Senior Big Data Engineer

    7 days ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates G42 Full time

    About the RoleWe are looking for a skilled Senior Data Engineer to develop and maintain data systems that support our company's strategic goals. Your role will encompass a range of activities focused on data pipeline development, data quality, and cross-functional collaboration.As a Senior Data Engineer, you will be responsible for building and maintaining...

  • Senior Design Professional

    2 days ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates The Chemical Engineer Full time

    The Chemical Engineer is seeking a highly skilled Senior Process Designer to join our team. This exciting opportunity is for an experienced Senior Process Designer with a proven track record in developing and optimizing process designs.About the TeamYou will work closely with engineering teams to deliver high-quality solutions for complex projects. Our team...

  • Senior Data Engineer

    4 weeks ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates Deeplight AI Full time

    About DeepLight: DeepLight is a pioneering AI company committed to pushing the boundaries of innovation in artificial intelligence. Our mission is to harness the power of data and machine learning to revolutionize industries and create a brighter future. With a dynamic team of experts and a culture of relentless innovation, we are at the forefront of AI...

  • Senior Data Engineer

    6 days ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates G42 Full time

    OverviewAs a Senior Data Engineer at Inception, you will be responsible for building and maintaining the infrastructure that supports data collection, processing, and storage. Reporting to the Lead Data Engineer or Principal Data Engineering, you will work closely with data scientists, analysts, and other stakeholders to ensure that data systems are...

  • Senior Cloud Data Engineer

    1 day ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates Dicetek LLC Full time

    Job SummaryWe are looking for a highly skilled Senior Cloud Data Engineer to join our team at Dicetek LLC. As a senior member of our data engineering team, you will be responsible for designing and implementing complex data architectures, data pipelines, and data warehouses on cloud platforms. The ideal candidate will have extensive experience in cloud-based...

  • Senior Data Engineer

    2 days ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates G42 Full time

    OverviewAs a Senior Data Engineer at Inception, you will be responsible for building and maintaining the infrastructure that supports data collection, processing, and storage. Reporting to the Lead Data Engineer or Principal Data Engineering, you will work closely with data scientists, analysts, and other stakeholders to ensure that data systems are...

  • PMC Senior Process Engineer

    16 hours ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates The Chemical Engineer Full time

    Remarkable people, trusted by clients to design and advance the world. The RoleThis is an exciting opportunity for an experienced PMC Senior Process Engineer with a proven track record in overseeing the process engineering team, ensuring safety, quality, and adherence to industry standards in project design and execution for a high-profile client.What we can...

  • Senior HSE Engineer

    4 weeks ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates Tampa Gardens Senior Living Full time

    A bachelor's degree in relevant engineering (i.e Mechanical, Electrical, Civil, Environmental, Chemical, IT, Computer, Software, Electronic, etc.) or equivalent from an accredited university with a minimum of fifteen (15+) years of relevant experience(with design experience) in the Oil & Gas or Petrochemical industry, including minimum (5) years in in GCC...

  • Senior HSE Engineer

    2 weeks ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates Tampa Gardens Senior Living Full time

    A bachelor's degree in relevant engineering (i.e Mechanical, Electrical, Civil, Environmental, Chemical, IT, Computer, Software, Electronic, etc.) or equivalent from an accredited university with a minimum of fifteen (15+) years of relevant experience(with design experience) in the Oil & Gas or Petrochemical industry, including minimum (5) years in in GCC...

  • Senior HSE Engineer

    2 days ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates Tampa Gardens Senior Living Full time

    A bachelor's degree in relevant engineering (i.e Mechanical, Electrical, Civil, Environmental, Chemical, IT, Computer, Software, Electronic, etc.) or equivalent from an accredited university with a minimum of fifteen (15+) years of relevant experience(with design experience) in the Oil & Gas or Petrochemical industry, including minimum (5) years in in GCC...

  • Senior Data Engineer

    3 days ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates AI71 Full time

    Get AI-powered advice on this job and more exclusive features. AI71, a pioneering AI company launched by Abu Dhabi's Advanced Technology Research Council (ATRC) and VentureOne, stands as a pivotal movement in the realm of AI innovation. Leveraging the globally top-ranked Falcon AI models from the Technology Innovation Institute, AI71's focus spans across...

  • Senior Data Engineer

    3 days ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates AI71 Full time

    Get AI-powered advice on this job and more exclusive features.AI71, a pioneering AI company launched by Abu Dhabi's Advanced Technology Research Council (ATRC) and VentureOne, stands as a pivotal movement in the realm of AI innovation. Leveraging the globally top-ranked Falcon AI models from the Technology Innovation Institute, AI71's focus spans across...

  • PMC Senior Process Safety Engineer

    3 days ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates The Chemical Engineer Full time

    JOB DESCRIPTION Remarkable people, trusted by clients to design and advance the world. The Role This is an exciting opportunity for an experienced PMC Senior Process Safety Engineer with a proven track record in implementation and management of process safety systems, mitigating risks and ensuring compliance with safety standards in oil and gas projects...

  • Oil, Gas, and refining Insurance Risk Engineer

    3 hours ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates The Chemical Engineer Full time

    Our client is a world leader in the Energy, Chemicals and Petroleum insurance sector providing risk engineering services across the globe for clients in all COMAH sectors, from oil & gas exploration and production through refining and downstream petrochemicals. The business is looking to recruit an additional engineer to work in its fast-growing and...

  • Process Engineering Leader

    13 hours ago

    Abu Dhabi, Abu Dhabi, United Arab Emirates The Chemical Engineer Full time

    At The Chemical Engineer, we are committed to delivering high-quality projects that meet the asset operational needs. Our team is looking for an experienced PMC Senior Process Engineer to oversee the process engineering team, ensuring safety, quality, and adherence to industry standards.Job DescriptionTo manage the Process engineering and design teamTo have...