Senior Data Engineer & Team Lead

Description

The client is a private equity firmBasic information:Location: mostly remote (once a month from Warsaw)Rate: 180-240PLN/h net + VATEmployment type: B2B contractDuration: 12 months + extensionsRecruitment process: 2 stagesEnglish: B2+/C1Luxmed, MultiSport, equipment provided by the clientProject descriptionClient is transforming cloud-first, data-driven technology environment and data platform. The role sits in the Core Development team and focuses on owning end-to-end data engineering solutions on Azure Databricks, acting as the Databricks subject matter expert and hands-on technical lead.Responsibilities- Own end-to-end delivery from scoping, design, build and testing through deployment, support and production ownership.- Architect and build scalable Databricks pipelines and workflows, including Jobs, Notebooks, SDP and Workflows.- Implement CDF/CDC patterns and develop Delta Lake / Lakehouse solutions aligned with Bronze, Silver and Gold architecture.- Design and manage Unity Catalog resources, access controls, permissions and governance policies.- Promote solutions through CI/CD pipelines using Declarative Automation Bundles and GitHub Actions or Azure DevOps.- Collaborate with BAs, business stakeholders, QA and Scrum Master to translate requirements, define acceptance criteria and deliver stories within sprints.- Define and enforce engineering standards, code quality, testing, documentation and reusable component libraries.- Mentor and upskill team members, facilitate communication, run check-ins and support team coherence- 2+ years of leadership experience is requiredKey technologies:- Databricks: Jobs, Workflows, Notebooks, Spark Declarative Pipelines, Unity Catalog, CDF/CDC, Declarative Automation Bundles- Azure: ADLS Gen2, Azure SQL, Azure Key Vault, Entra ID- PySpark / Python, Delta Lake, Lakehouse and Medallion architecture- CI/CD: GitHub Actions or Azure DevOps, GitHub / Azure Repos- Infrastructure as Code: Pulumi or Terraform- AI/LLM APIs, MCP servers, agentic AI workflows- Nice to have: Kafka / Event Hub, Power BI, MongoDB, Logic Apps / Power AutomateTeam:Core Development team. Agile/Scrum delivery is referenced, including sprint planning, backlog grooming, estimation and retrospectives. The role includes shared responsibility with the Scrum Master and close cooperation with BAs, business stakeholders and QAHays Poland sp. z o.o. is an employment agency registered in a registry kept by Marshal of the Mazowieckie Voivodeship under the number 361.#LI-DNI #1201188 - Mateusz Malachowski

Responsibilities

• Client is transforming cloud-first, data-driven technology environment and data platform. The role sits in the Core Development team and focuses on owning end-to-end data engineering solutions on Azure Databricks, acting as the Databricks subject matter expert and hands-on technical lead.

Informacje dodatkowe

• Nr ref.: 1201188

• Lokalizacja: Mazowieckie

• Rodzaj pracy: Kontrakt