Lead Data Software Engineer

Anforderungen

• 4+ years of experience in software development with Big Data technologies

• Advanced knowledge of one of the languages: Python, Scala or Java

• Vast experience with Spark and/or Databricks

• Experience with Azure or AWS

• Experience in managing small and mid-size teams using Agile methodology

• Bachelor's degree in Computer Science, Mathematics, related technical field or equivalent practical experience

Zakres obowiązków

• Develop and implement innovative analytical solutions using Cloud Native, Big Data, and NoSQL-related technologies

• Develop and implement Cloud/On-Premise/Hybrid solutions using best-in-the-class data frameworks

• Work with product and engineering teams to understand requirements and evaluate new features and architecture to help drive decisions

• Build collaborative partnerships with architects, technical leads and key individuals within other functional groups

• Perform detailed analysis of business problems and technical environments and use this in designing quality technical solution

• Actively participate in code review and test solutions to ensure they meet best practice specifications

• Build and foster a high-performance engineering culture, mentor team members and provide the team with the tools and motivation

• Write project documentation

Seniority

• Lead

Mile widziane

• Production experience with one or more of the following tools: Hadoop, Spark, Kafka, Oozie, Airflow, HDFS, YARN

• Preferred experience with message queues, specifically Kafka, and working with large data transfer applications/middleware

• Production experience in search technologies such as Solr, OpenSearch, or Lucene is highly advantageous

Beschreibung

We seek a Lead Data Software Engineer with cloud experience to join our growing Data Practice. The projects we are working on are diverse, covering all technologies and solutions currently available on the market and represented by open-source communities. We serve clients across domains such as financial services, health care, insurance, and more, so you will have the opportunity to develop in any direction you choose. Responsibilities Develop and implement innovative analytical solutions using Cloud Native, Big Data, and NoSQL-related technologies Develop and implement Cloud/On-Premise/Hybrid solutions using best-in-the-class data frameworks Work with product and engineering teams to understand requirements and evaluate new features and architecture to help drive decisions Build collaborative partnerships with architects, technical leads and key individuals within other functional groups Perform detailed analysis of business problems and technical environments and use this in designing quality technical solution Actively participate in code review and test solutions to ensure they meet best practice specifications Build and foster a high-performance engineering culture, mentor team members and provide the team with the tools and motivation Write project documentation Requirements 4+ years of experience in software development with Big Data technologies Advanced knowledge of one of the languages: Python, Scala or Java Vast experience with Spark and/or Databricks Experience with Azure or AWS Experience in managing small and mid-size teams using Agile methodology Bachelor's degree in Computer Science, Mathematics, related technical field or equivalent practical experience Nice to have Production experience with one or more of the following tools: Hadoop, Spark, Kafka, Oozie, Airflow, HDFS, YARN Preferred experience with message queues, specifically Kafka, and working with large data transfer applications/middleware Production experience in search technologies such as Solr, OpenSearch, or Lucene is highly advantageous

Stichwörter / Fähigkeiten