Senior Data Integration Engineer (Databricks / Snowflake)

Description

We are looking for a Senior Data Integration Engineer to join our growing Data Practice and contribute to EPAM strategic data projects. You will play a key role in building and maintaining data systems and applications that support business decision-making. You will primarily focus on developing data pipelines and data-driven solutions in public cloud environments such as AWS and Azure, as well as supporting data migration from on-premises data centers to the cloud. You will also have the opportunity to build and maintain components of enterprise data platforms, working closely with data scientists, architects, and other technology professionals. Responsibilities Design, build, and manage enterprise data solutions in public cloud environments such as AWS and Azure Develop and maintain data pipelines and components of enterprise data platforms Implement data acquisition processes using APIs, FTP and other data sources Perform data transformation, normalization, and integration from raw data to structured database schemas Build and maintain data storage solutions including raw files, databases, and data platforms Develop data distribution and access solutions including APIs, file extracts, user queries, and access layers Implement secure and auditable data processes to ensure data integrity, accuracy, and availability Collaborate with data scientists, data architects, and other stakeholders to understand and deliver data requirements Troubleshoot data-related issues and continuously improve the quality and reliability of data systems Contribute to EPAM strategic data projects and enterprise data platform initiatives Requirements 3+ years of professional experience as a Data Engineer or in a similar role Advanced knowledge of SQL and Python Hands-on experience with public cloud platforms such as AWS and/or Azure Experience with DBMS and ETL/ELT tools Hands-on experience with Databricks and/or Snowflake Practical experience with data acquisition using APIs, FTP downloads, and other data sources Experience with ETL processes, data transformation, and normalization from raw data to structured database schemas Experience with data storage solutions including raw files and database systems Experience building components for enterprise data platforms such as Data Warehouses, Operational Data Stores, and data access layers Experience developing data access solutions including APIs, file extracts, and user query interfaces Bachelor’s degree in Computer Science, Information Technology, or a related technical field Strong communication and collaboration skills Good analytical and problem-solving skills Ability to work effectively in a distributed, team-oriented environment

Requirements

• 3+ years of professional experience as a Data Engineer or in a similar role

• Advanced knowledge of SQL and Python

• Hands-on experience with public cloud platforms such as AWS and/or Azure

• Experience with DBMS and ETL/ELT tools

• Hands-on experience with Databricks and/or Snowflake

• Practical experience with data acquisition using APIs, FTP downloads, and other data sources

• Experience with ETL processes, data transformation, and normalization from raw data to structured database schemas

• Experience with data storage solutions including raw files and database systems

• Experience building components for enterprise data platforms such as Data Warehouses, Operational Data Stores, and data access layers

• Experience developing data access solutions including APIs, file extracts, and user query interfaces

• Bachelor’s degree in Computer Science, Information Technology, or a related technical field

• Strong communication and collaboration skills

• Good analytical and problem-solving skills

• Ability to work effectively in a distributed, team-oriented environment

Responsibilities

• Design, build, and manage enterprise data solutions in public cloud environments such as AWS and Azure

• Develop and maintain data pipelines and components of enterprise data platforms

• Implement data acquisition processes using APIs, FTP and other data sources

• Perform data transformation, normalization, and integration from raw data to structured database schemas

• Build and maintain data storage solutions including raw files, databases, and data platforms

• Develop data distribution and access solutions including APIs, file extracts, user queries, and access layers

• Implement secure and auditable data processes to ensure data integrity, accuracy, and availability

• Collaborate with data scientists, data architects, and other stakeholders to understand and deliver data requirements

• Troubleshoot data-related issues and continuously improve the quality and reliability of data systems

• Contribute to EPAM strategic data projects and enterprise data platform initiatives

Seniority

• Senior