Senior Data Engineer

Senior Data Engineer

Client / Project description:

The client is a major airline based in Abu Dhabi, United Arab Emirates. It operates a vast network of flights to over 120 destinations worldwide, offering passenger transportation, holiday packages, and cargo services. With a fleet of 102 aircraft.

Role description:

Data Processing on Azure: Azure Data Factory, Streaming Analytics, Event Hubs, Azure Databricks, Data Migration Service, Data Pipeline.

  1. Azure skills highly preferred, including provisioning, configuring and developing solutions in ADL, ADF, ADW etc. In-depth understanding of database structure principals.
  2. Experience in DevOps, Azure Devops, Jenkins, Airflow, Azure Monitor good o have.
  3. Hands-on experience using MS SQL Server, Oracle or similar RDBMS platform.
  4. Distributed Data Processing of big data batch or streaming pipelines (Kafka or similar)
  5. Familiarity with data visualization tools (e.g. PowerBI, Tableau etc.)
  6. Data Modeling, Data Structure
  7. Strong analytics skills.
  8. Problem-solving attitude.
  9. Highly self-motivated, self-directed and attentive to details.
  10. Ability to effectively prioritize and execute tasks.

 Requirements:

  1. Batch data processing: Azure Data Factory, Databricks/pySpark, Python, SQL, Synapse (experience with Synapse is nice-to-have)
  2. Streaming processing: Event Hub, CosmosDB, Spark Streaming
  3. Batch processing is much more important than streaming processing.
  4. Good to have: Azure DevOps, experience in Aviation Industry and Copilot

 Type of work: Remote or on-site in the Emirates

 If you're excited about the opportunity, join our team and enjoy an attractive salary package that reflects your expertise and dedication. Please send your CV to careers@amsoft-group.com

 

AMSoft Group maintains Common Security Framework (CSF) R2 Certifications from the Health Information Trust Alliance (HITRUST) covering the healthcare-related systems it has built and operates. HITRUST was established under the premise that information security should be a core pillar of the broad adoption of health information systems and exchanges. The CSF combines requirements from existing federal, state, and third- party standards such as HIPAA, HITECH, PCI, COBIT, NIST, and FTC.