Senior Databricks Data Engineer

3 weeks ago


abu dhabi, United Arab Emirates Talent Pal Full time
Abu Dhabi, United Arab Emirates BigData Development BCM Industry

Date: 15/04/2024

Req.: VR-103447

Project description

We are hiring for projects in the Middle East. There are many opportunities in the region. Our team consists of frontend and backend developers, data analysts and data scientists, architects, analysts and project managers, and Databricks Data engineers. As a Senior Databricks Data Engineer, you will play a crucial role within our data platform team, focusing on our central data platform's design, development, optimization, and maintenance. Leveraging your expertise in Databricks, big data technologies, and software engineering, you will be focusing on our data platform's design, enhancement, and support to ensure its scalability, reliability, and performance.

Responsibilities
  • Platform Design: Collaborate with cross-functional teams to refine and design the architecture of our data platform.
  • Platform Optimization: Continuously enhance the performance, scalability, and reliability of the data platform to meet evolving business requirements.
  • Platform Maintenance: Implement monitoring, alerting, and maintenance processes to ensure the availability and health of the data platform.
  • Data Governance: Establish and enforce data governance best practices to uphold data quality, security, and compliance standards.
  • Platform Integration: Integrate new technologies seamlessly into the data platform ecosystem, ensuring compatibility and interoperability.
  • Collaboration: Work closely with data engineers, data scientists, analysts, and business stakeholders to comprehend requirements and offer technical expertise and support.
  • Documentation: Create and maintain comprehensive documentation for the data platform architecture, processes, and workflows.
  • Mentorship: Provide guidance and mentorship to junior members of the data engineering team, nurturing their growth and development.
Skills

Must have

  • Proficiency in programming languages such as Python, Scala, or Java.
  • Strong understanding of big data technologies and distributed computing principles.
  • Experience with cloud platforms such as Azure and AWS.
  • Strong understanding of SQL and relational databases.
  • Excellent problem-solving skills and attention to detail.
  • Strong communication and collaboration skills.

Nice to have

  • Benefits
  • Other Languages
  • English: C1 Advanced
  • Seniority: Senior

This job has been sourced from an external job board. More jobs on

#J-18808-Ljbffr

  • Abu Dhabi, United Arab Emirates Talent Pal Full time

    Abu Dhabi United Arab Emirates BigData Development BCM Industry15/04/2024 Req. VR103447Project description We are hiring for projects in the Middle East. There are many opportunities in the region. Our team consists of frontend and backend developers data analysts and data scientists architects analysts and project managers and Databricks Data engineers. As...


  • abu dhabi, United Arab Emirates Talent Pal Full time

    We are hiring for projects in the Middle East. There are many opportunities in the region. Our team consists of frontend and backend developers data analysts and data scientists architects analysts and project managers and Databricks Data engineers. As a Senior Databricks Data Engineer you will play a crucial role within our data platform team focusing on...


  • Abu Dhabi, United Arab Emirates Talent Pal Full time

    Abu DhabiUnited Arab EmiratesBigData DevelopmentBCMIndustry15/04/2024Req.VR103447Projectdescription We are hiring forprojects in the Middle East. There are many opportunities in theregion. Our team consists of frontend and backend developers dataanalysts and data scientists architects analysts and projectmanagers and Databricks Data engineers. As a Senior...


  • Abu Dhabi, United Arab Emirates Farah Experiences Full time

    Responsible for the understanding and documenting the business requirements - Manage Data & ML Engineering and Data Ops teams - Design and develop the Big Data architecture - Deep understanding of ETL methodologies, Big Data, API and Data Warehousing principles, approaches, technologies, and architectures including the concepts, designs and usage of data...

  • Data Engineer

    3 weeks ago


    abu dhabi, United Arab Emirates BlackStone eIT Full time

    BlackStone eIT Data Engineer Job DescriptionBlackStone eIT, a leading computer software company, is seeking a talented and experienced Data Engineer to join our dynamic team. As a Data Engineer at BlackStone eIT, you will be responsible for designing, developing, and maintaining scalable data infrastructure and systems. You will work closely with...


  • abu dhabi, United Arab Emirates Cognizant Full time

    Databricks Architect Jobs In Abu Dhabi | CognizantApply Also Food and Beverage Host Jobs In Sharjah | HiltonNeed to have Databricks/ Spark, SQL, Azure ADF, Azure mapping workflow.Strong experience as technical lead in Azure ADF developmentHands on development experience in developing pipelines in ADF.Strong knowledge in ETL solutioningStrong experience in...


  • Abu Dhabi, United Arab Emirates Talent Pal Full time

    **Project** Description****: We are hiring for projects in the Middle East. There are many opportunities in the region. Our team consists of frontend and backend developers, data analysts and data scientists, architects, analysts and project managers. **Responsibilities**: - Participate in data model creation and help manage financial data processing -...


  • Abu Dhabi, United Arab Emirates ALPHA DATA PROCESSING SERVICES LLC Full time

    Create Data-warehouses / Data-marts• In-depth understanding of healthcare data (Preferred)• Informatica DEI (Data Integration) and DQ (Data Quality) tool (Preferred)• Create Data Architecture optimized for analytics and collaborative research• Create Data Dictionary, ER models and other technical documentation• Train and support data analysts and...


  • abu dhabi, United Arab Emirates ALPHA DATA PROCESSING SERVICES LLC Full time

    Create Data-warehouses / Data-marts• In-depth understanding of healthcare data (Preferred)• Informatica DEI (Data Integration) and DQ (Data Quality) tool (Preferred)• Create Data Architecture optimized for analytics and collaborative research• Create Data Dictionary, ER models and other technical documentation• Train and support data analysts and...


  • abu dhabi, United Arab Emirates ALPHA DATA PROCESSING SERVICES LLC Full time

    Create Data-warehouses / Data-marts• In-depth understanding of healthcare data (Preferred)• Informatica DEI (Data Integration) and DQ (Data Quality) tool (Preferred)• Create Data Architecture optimized for analytics and collaborative research• Create Data Dictionary, ER models and other technical documentation• Train and support data analysts and...

  • Process Engineer I

    3 weeks ago


    abu dhabi, United Arab Emirates The Chemical Engineer Full time

    51,000 people. 49 countries. Over 120 office locations.We’re not just engineers. We’re a global team of data scientists, consultants, construction workers andinnovators all working to create a better tomorrow. Every day, we help customers in energy, chemicals andresources get one step closer to solving our planet’s toughest issues. Climate change. The...

  • AML Tuning

    3 weeks ago


    abu dhabi, United Arab Emirates Alpha Data Recruitment Full time

    Notice Period: ImmediateContinuous ImprovementSupport the Compliance Technology, Data and Reporting Department in identifying continuous improvement and sustainability improvement opportunities for the related systems, processes and practices.Manage the implementation of the AML Group compliance systems Road map as agreed with the Compliance management and...


  • Abu Dhabi, United Arab Emirates SoftwareOne Full time

    Responsibilities:Solution Design: Collaborate with cross-functional teams to gather requirements, design end-to-end data analytics solutions, and create architectural diagrams and documentation.Azure Expertise: Leverage your extensive knowledge of Azure services such as Azure Synapse, Azure Data Factory, Azure Databricks, Microsoft Power BI, and others to...


  • Abu Dhabi, Abu Dhabi, United Arab Emirates Charterhouse UAE Full time

    ​Charterhouse is working with a government entity based in Abu Dhabi who is looking to hire a Senior Business Data Analyst. This role will play a crucial part in collecting, managing, and presenting strategic data to support decision-making within the organization. This position involves daily operations, continuous process improvement, and collaboration...


  • Abu Dhabi, United Arab Emirates Charterhouse UAE Full time

    ​Charterhouse is working with a government entity based in Abu Dhabi who is looking to hire a Senior Business Data Analyst. This role will play a crucial part in collecting, managing, and presenting strategic data to support decision-making within the organization. This position involves daily operations, continuous process improvement, and...


  • abu dhabi, United Arab Emirates Amazon Data Serv Emirates LLC Full time

    Facility Engineer – Data Centers | Amazon Jobs in Abu DhabiDescription:We are currently looking for an energetic, detail-oriented individual to join our Data Center Engineering Operations Team. This committed group works to maintain the critical physical infrastructure that supports our Data Center Organization within Amazon. Specifically, this team works...


  • Abu Dhabi, United Arab Emirates HTC Global Services Full time

    Good understanding of other Azure servicesExcellent knowledge of SQLGood understanding of Data Warehouse Architecture, Data Modelling and design conceptsExperience in Power BI, SFTP, Messaging, APIsLead and guide the data engineering team technically and share best practices with the teamExcellent analytical and organization skills.Effective working in a...


  • abu dhabi, United Arab Emirates BlackStone eIT Full time

    BlackStone eIT Machine Learning EngineerBlackStone eIT, a leading computer software company, is seeking a talented and experienced Machine Learning Engineer to join our dynamic team. As a Machine Learning Engineer at BlackStone eIT, you will be responsible for designing, developing, and deploying cutting-edge machine learning models and algorithms. You will...


  • abu dhabi, United Arab Emirates First Abu Dhabi Bank Full time

    Job DescriptionJob PurposeRole is required to support the transformation programme which aims at modernizing the data platforms estate for the bank. Traditional on-premises data warehouse and data lake should be transformed to meet the scalability, agility and modern capabilities needs as the bank embarks on the journey to implement the industry best...


  • abu dhabi, United Arab Emirates HTC Global Services Full time

    Skills Required:Azure: Good understanding of other Azure servicesSQL: Excellent knowledge of SQLData Warehouse: Good understanding of Data Warehouse Architecture, Data Modelling, and design conceptsTools: Experience in Power BI, SFTP, Messaging, APIsResponsibilities:Lead and guide the data engineering team technicallyShare best practices with the teamUtilize...