Current jobs related to Databricks Data Platform Engineer/Architect - Abu Dhabi - Luxoft

  • Databricks Data Platform Engineer/Architect

    22 hours ago

    abu dhabi, United Arab Emirates Luxoft Full time

    Project description We are seeking an expert with deep proficiency as a DataBricks Platform Engineer, possessing experience in data engineering. This individual should have a comprehensive understanding of both data platforms and software engineering, enabling them to integrate the platform effectively within an IT ecosystem. Responsibilities Manage and...

  • Databricks Data Platform Engineer/Architect

    22 hours ago

    abu dhabi, United Arab Emirates Luxoft Full time

    Project description We are seeking an expert with deep proficiency as a DataBricks Platform Engineer, possessing experience in data engineering. This individual should have a comprehensive understanding of both data platforms and software engineering, enabling them to integrate the platform effectively within an IT ecosystem. ResponsibilitiesManage and...

  • Databricks Data Platform Engineer/Architect

    2 weeks ago

    Abu Dhabi, United Arab Emirates Luxoft Full time

    Project description We are seeking an expert with deep proficiency as a DataBricks Platform Engineer, possessing experience in data engineering. This individual should have a comprehensive understanding of both data platforms and software engineering, enabling them to integrate the platform effectively within an IT ecosystem. Responsibilities Manage and...

  • Senior Databricks Platform Architect

    2 weeks ago

    Abu Dhabi, United Arab Emirates Luxoft Full time

    A technology consulting firm in Abu Dhabi seeks a skilled DataBricks Platform Engineer to manage and optimize data systems. The ideal candidate will have over 10 years in IT and a deep understanding of data engineering, alongside proficiency in Python and PySpark. Key responsibilities include ensuring system performance and security, optimizing ETL...

  • Senior Databricks Platform Architect

    21 hours ago

    abu dhabi, United Arab Emirates Luxoft Full time

    A technology consulting firm in Abu Dhabi seeks a skilled DataBricks Platform Engineer to manage and optimize data systems. The ideal candidate will have over 10 years in IT and a deep understanding of data engineering, alongside proficiency in Python and PySpark. Key responsibilities include ensuring system performance and security, optimizing ETL...

  • Senior Databricks Lead Engineer

    1 week ago

    Abu Dhabi, United Arab Emirates Cognizant Full time

    A leading technology firm is seeking a seasoned Databricks Lead Engineer in Abu Dhabi. You will drive next-gen platform uplift and lead modernization efforts within the Lakehouse ecosystem. Ideal candidates have over 7 years of experience in data engineering with deep expertise in Databricks and strong hands-on skills in Pyspark and related tools....

  • Senior Databricks Lead Engineer

    2 weeks ago

    Abu Dhabi, United Arab Emirates Cognizant Full time

    A leading technology firm in Abu Dhabi is seeking a seasoned Databricks Lead Engineer to drive next-gen platform uplift and define best practices. You will lead modernization efforts, design Lakeflow jobs, and implement advanced features across our Lakehouse ecosystem. The ideal candidate has 7+ years of experience in data engineering, proven leadership in...

  • Senior Databricks Lead Engineer

    22 hours ago

    abu dhabi, United Arab Emirates Cognizant Full time

    A leading technology firm in Abu Dhabi is seeking a seasoned Databricks Lead Engineer to drive next-gen platform uplift and define best practices. You will lead modernization efforts, design Lakeflow jobs, and implement advanced features across our Lakehouse ecosystem. The ideal candidate has 7+ years of experience in data engineering, proven leadership in...

  • Data Engineer

    2 weeks ago

    Abu Dhabi, United Arab Emirates Salt Full time

    Data, AI, & Software Engineering Specialist HIRING For this specific position, the client is only considering candidates who are based in the UAE. Job Title – Data Engineer Salary – MAX AED 30,000 Per Month Contract Length – 1 Year Contract with the view to extend Start Date – ASAP My customer is a specialist AI and data consultancy with extensive...

  • Databricks Data Engineer — Azure Pipelines

    2 weeks ago

    Abu Dhabi, United Arab Emirates Contango Full time

    A data engineering consulting firm in Abu Dhabi is seeking a Data Engineer to develop data platforms and pipelines within a Databricks on Azure environment. The ideal candidate will have strong experience in Databricks and Python, coupled with cloud data engineering skills. This role offers the opportunity to work closely with cross-functional teams in a...

Databricks Data Platform Engineer/Architect

2 days ago

Abu Dhabi, United Arab Emirates Luxoft Full time

Project description We are seeking an expert with deep proficiency as a DataBricks Platform Engineer, possessing experience in data engineering. This individual should have a comprehensive understanding of both data platforms and software engineering, enabling them to integrate the platform effectively within an IT ecosystem. Responsibilities - Manage and optimize Databricks data platform. - Ensure high availability, security, and performance of data systems. - Provide valuable insights about data platform usage. - Optimize computing and storage for large-scale data processing. - Design and maintain system libraries (Python) used in ETL pipelines and platform governance. - Optimize ETL Processes - Enhance and tune existing ETL processes for better performance, scalability, and reliability. SKILLS Must have - Minimum 10 Years of experience in IT/Data. - Minimum 3 years of experience as a Databricks Data Platform Engineer. - Bachelor's in IT or related field. - Infrastructure & Cloud: Azure, AWS (expertise in storage, networking, compute). - Programming: Proficiency in PySpark for distributed computing. - Proficiency in Python for ETL development. - SQL: Expertise in writing and optimizing SQL queries, preferably with experience in databases such as PostgreSQL, MySQL, Oracle, or Snowflake. - Data Warehousing: Experience working with data warehousing concepts and Databricks platform. - ETL Tools: Familiarity with ETL tools & processes - Data Modelling: Experience with dimensional modelling, normalization/denormalization, and schema design. - Version Control: Proficiency with version control tools like Git to manage codebases and collaborate on development. - Data Pipeline Monitoring: Familiarity with monitoring tools (e.g., Prometheus, Grafana, or custom monitoring scripts) to track pipeline performance. - Data Quality Tools: Experience implementing data validation, cleaning, and quality frameworks, ideally Monte Carlo. Nice to have - Containerization & Orchestration: Docker, Kubernetes. - Infrastructure as Code (IaC): Terraform. - Understanding of Investment Data domain (desired). #J-18808-Ljbffr