Description
Responsibilities:
- Design, implement, and maintain data pipelines and transformations on Databricks and Synapse.
- Develop and manage reusable, high-performance data products across bronze, silver, and gold layers.
- Integrate structured and unstructured data from diverse sources (e.g., SAP, Salesforce, external
systems). - Ensure data quality, lineage, and compliance with governance and security standards.
- Optimize data processing for scalability, performance, and cost efficiency.
- Collaborate with the Data architect, Business Analysts and Business stakeholders to translate
requirements into technical solutions. - Automate workflows, testing, and deployment via CI/CD pipelines.
Requirements
Years of experience:
- 5+ years of proven experience as a Data Engineer.
Functional Skills:
- Strong understanding of modern data architectures.
- Ability to work cross-functionally with data, IT, and business teams.
- Knowledge of data modeling techniques and data lifecycle management.
- Experience with Agile and DevOps delivery approaches.
- Focus on standardization, documentation, and reusability of data components.
Technical Skills:
- Languages & Frameworks: Python, PySpark, SQL.
- Platforms: Azure Databricks (mandatory), Azure Synapse, Azure Data Lake Storage, Azure Data
Factory. - Data Modeling: Data Vault, Dimensional, and Entity-Relationship modeling.
- Automation & DevOps: CI/CD (e.g., Azure DevOps, Git), Infrastructure-as-Code (e.g., Terraform).
- Data Governance: Familiarity with Microsoft Purview & Databricks Unity Catalog or comparable
metadata/lineage tools.
Soft Skills:
- Strong problem-solving and analytical mindset.
- High reliability and ownership for data quality and delivery.
- Collaborative, open communicator across technical and business teams.
- Proactive, curious, and eager to continuously learn new technologies.
- Structured and autonomous working style in agile environments.
Languages:
- Fluency in English (mandatory)
Desired Certifications:
- Databricks related certifications.
Benefits
The benefits will be determined once the contractual terms have been established.