Azure Databricks Developer

Description

We are seeking an experienced Azure Databricks Developer to join our dynamic team. The ideal candidate will have strong expertise in Azure Databricks and Azure DevOps to design and implement scalable cloud-based data solutions. You will work closely with other data engineers, architects, and business teams to develop and optimize data pipelines, real-time data streaming, and cloud-based analytics solutions. The applications primarily consist of data pipelines built in Azure Databricks. They either transform data and load it into downstream systems, or ingest data from upstream systems and transform it for further processing. You will be part of the SaaS Data Layer implementation team responsible for building and maintaining the client environments of the new trading platform. Luxoft will invest into your professional training and allow you to grow your professional career.

What we offer

• Global Relocation - (Relocation options; Experience in an international environment; Cross-cultural experience)

• Recognition and Evaluation - (Feedback culture; Regular appraisals)

• Time Off - (Annual holiday - 20 or 26 days. The duration of the leave depends on the overall seniority; Occasional leave - 1 or 2 days/ depending on the circumstances; Child care leave - 2 days or 16 hours per year; Absence due to force majeure - 2 days or 16 hours per year; Maternity Leave - 20 weeks; Parental Leave - 41 weeks; Paternity Leave - 14 days)

• Luxoft Training Center - (Expert-led tech courses covering basic to advanced topics; Internal instructor-led soft skills courses; Comprehensive in-house self-learning resources for both soft and hard skills; Access to external self-learning libraries like ProQuest eBook and Udemy for Business; Cloud Programs: MS Cloud Academy, AWS Partner Academy, Google Cloud Academy; Custom Learning Programs: upskilling, reskilling, technical mentorship; Leadership Programs for Managers)

• Well-being and Work-life Balance - (Multisport card; Possibility to order Multisport card at the corporate rate for family members; LuxGood Program: wellbeing seminars, contests, relaxation sessions, yoga sessions, etc.; One Team Program: Buddy for each New Joiner; seminars, meeting and workplace space to support integration with local community and culture; “Hire me” workshops for partners; Preferential banking offer; Preferential car leasing offer; Cafeteria program discounts for shops, cinema tickets, holiday offers; Luxoft Social Benefit Fund: sport and recreation benefits, the possibility to receive financial support)

• Health Care - (Private Healthcare Insurance with unlimited access to specialists; Full dental support; Travel Insurance; Possibility to add private healthcare coverage for family members at the corporate rate; Life insurance at the corporate rate for employees and family members, including payment of the basic package for the employee by the employer; Reimbursement for corrective glasses)

• Company Events and Friendly Environment - (Many fun social activities organized by the Luxoft team offline in your city; Online entertainment events for whole company and local team events; A workplace where you’re treated with respect within a multicultural team)

• Internal Mobility - (Rotation between projects and accounts; New career opportunities)

• Self-Learning Library

• CSR Projects

Other

• Languages: English: C1 Advanced

• Seniority: Senior

Requirements

• 10+ years experience in development

• 3+ years of hands-on experience with Azure cloud services, including Databricks and DevOps.

• Strong proficiency Python and Pyspark or SQL for data transformation and analysis.

• Experience with real-time data streaming and event-driven architectures.

• Deep understanding of ETL/ELT workflows and big data processing frameworks.

• Knowledge of Azure DevOps and CI/CD pipelines for automated deployments.

• Familiarity with data security, governance, and compliance best practices in cloud environments.

• Excellent problem-solving skills and ability to work in an agile development environment.

• Strong communication and collaboration skills.

• Azure network concepts, Azure Service Bus, Azure Functions

• Agile

• Certifications such as Microsoft Certified: Azure Data Engineer Associate or Azure Solutions Architect.

• Experience with Power BI or other visualization tools.

• Knowledge of machine learning and AI-based analytics on Azure.

Responsibilities

• Cloud expertise in Azure Databricks, Azure DevOps, Azure Log Analytics. Knowledge of Azure network concepts, Azure Service Bus, Azure Functions is a plus.

• Develop, implement, and maintain data pipelines and ETL processes using Azure Databricks.

• Design and manage Azure Databricks for optimized data storage and retrieval.

• Collaborate with cross-functional teams to define and implement data integration solutions across multiple sources and platforms.

• Implement best practices for data governance, security, and compliance in cloud-based solutions.

• Monitor and troubleshoot performance issues in Azure-based applications and data pipelines.

• Automate deployment and monitoring processes using CI/CD pipelines.

• Stay updated with emerging Azure technologies and provide recommendations for improvements.

• Producing Architectural design diagram/Technical Documentation