Data Engineer

منذ 4 ساعات

abu dhabi, الإمارات العربية المتحدة Saal.ai دوام كامل

Designs, builds, and operates scalable, resilient data platforms that enable high-impact analytics, insights, and decision-making. Working with product, analytics, and engineering teams, the role rapidly prototypes, delivers, and runs reliable data pipelines and big data services in production

Key Responsibilities:
  • Design and develop services for large-scale ingestion, storage, and management across RDBMS, NoSQL, logs, and event streams.
  • Build and operate robust, scalable batch and streaming pipelines with Apache NiFi, Kafka, Spark, Flink, and Airflow.
  • Develop highly concurrent, low-latency systems handling structured and unstructured data.
  • Implement change data capture and data models (OLAP, dimensional, lakehouse) for analytics and AI.
Quality & Operations
  • Ensure pipelines are deployable, observable, and operationally manageable, monitored against data SLAs.
  • Implement data quality checks, lineage, documentation, and governance and access controls.
  • Optimize the performance and cost of data storage and processing.
  • Work with product teams and third-party providers on integrations, and with Data Scientists on datasets.
  • Participate in sprint planning and delivery, and advise on emerging data technologies and best practices.
  • Protect sensitive data (encryption, masking, least privilege) and comply with SAAL security and HSE policies.
  • Data pipelines with Apache NiFi, Kafka, Spark, Flink, and Airflow (batch and real-time).
  • Distributed data architectures, data modeling, OLAP design, and CDC (e.g., Debezium).
  • Storage and messaging platforms (MinIO/S3, Kafka) and data formats (Avro, Parquet, ORC).
  • Strong programming and scripting (Python, Scala, or Java) and advanced SQL.
  • Agile delivery and Git version control. Excellent English; Arabic is an advantage.
  • Enterprise analytics and reporting platforms; infrastructure and containerized deployments (Docker, Kubernetes).
  • Lakehouse formats (Iceberg, Delta Lake), dbt, data quality tooling, and data preparation for GenAI (RAG).
Education:
  • Bachelor's degree in Computer Science, Software Engineering, or a related field (preferred).
Certifications (preferred):
  • Databricks, Confluent (Kafka), or cloud data engineering certifications are an advantage.
Experience:
  • 3-5 years of professional experience as a Data Engineer or Big Data Engineer.