Senior Azure Data Engineer (Databricks)

Senior Azure Data Engineer (Databricks)

Responsibilities:

  • Responsible for at-scale infrastructure design, build and deployment with a focus on distributed systems,
  • Building and maintaining architecture patterns for data processing, workflow definitions, and system to system integrations using Big Data and Cloud technologies,
  • Evaluating and translating technical design to workable technical solutions/code and technical specifications at par with industry standards,
  • Driving creation of re-usable artifacts,
  • Establishing scalable, efficient, automated processes for data analysis, data model development, validation, and implementation,
  • Working closely with analysts/data scientists to understand impact to the downstream data models,
  • Writing efficient and well-organized software to ship products in an iterative, continual release environment,
  • Contributing and promoting good software engineering practices across the team,
  • Communicating clearly and effectively to technical and non-technical audiences,
  • Defining data retention policies,
  • Monitoring performance and advising any necessary infrastructure changes.

Profile:

  • Ready to start immediately,
  • 3+ years’ experience with Azure (Data Factory, Databricks, SQL, Data Lake, Power BI, DevOps, Delta Lake, CosmosDB),
  • 5+ years’ experience with data engineering or backend/fullstack software development,
  • Strong SQL skills,
  • Python scripting proficiency,
  • Experience with data transformation tools - Databricks and Spark,
  • Data manipulation libraries (such as Pandas, NumPy, PySpark),
  • Experience in structuring and modelling data in both relational and non-relational forms,
  • Ability to elaborate and propose relational/non-relational approach,
  • Normalization / denormalization and data warehousing concepts (star, snowflake schemas),
  • Designing for transactional and analytical operations,
  • Experience with CI/CD tooling (GitHub, Azure DevOps, Harness etc),
  • Git,
  • Good verbal and written communication skills in English.

Nice to have:

  • Experience with Azure Event Hubs, Azure Blob Storage, Azure Synapse, Spark Streaming,
  • Experience with data modelling tools, preferably DBT,
  • Experience with Enterprise Data Warehouse solutions, preferably Snowflake,
  • Familiarity with ETL tools (such as Informatica, Talend, Datastage, Stitch, Fivetran etc),
  • Experience in containerization and orchestration (Docker, Kubernetes etc),
  • Cloud (Azure, AWS, GCP) certification.

Type of work: Remote (only as employee working from Moldova)

 

If you're excited about the opportunity, join our team and enjoy an attractive salary package that reflects your expertise and dedication. Please send your CV to careers@amsoft-group.com

AMSoft Group maintains Common Security Framework (CSF) R2 Certifications from the Health Information Trust Alliance (HITRUST) covering the healthcare-related systems it has built and operates. HITRUST was established under the premise that information security should be a core pillar of the broad adoption of health information systems and exchanges. The CSF combines requirements from existing federal, state, and third- party standards such as HIPAA, HITECH, PCI, COBIT, NIST, and FTC.