Lead Big Data Developer

Wymagania

• 4+ years of experience in software development with Big Data technologies

• Advanced knowledge of one of the languages: Python, Scala or Java

• Vast experience with Spark and/or Databricks

• Experience with Azure or AWS

• Experience in managing small and mid-size teams using Agile methodology

• Bachelor's degree in Computer Science, Mathematics, related technical field or equivalent practical experience

Zakres obowiązków

• Develop and implement innovative analytical solutions using Cloud Native, Big Data, and NoSQL-related technologies

• Develop and implement Cloud/On-Premise/Hybrid solutions using best-in-the-class data frameworks

• Work with product and engineering teams to understand requirements and evaluate new features and architecture to help drive decisions

• Build collaborative partnerships with architects, technical leads and key individuals within other functional groups

• Perform detailed analysis of business problems and technical environments and use this in designing quality technical solution

• Actively participate in code review and test solutions to ensure they meet best practice specifications

• Build and foster a high-performance engineering culture, mentor team members and provide the team with the tools and motivation

• Write project documentation

Seniority

• Lead

Mile widziane

• Production experience with one or more of the following tools: Hadoop, Spark, Kafka, Oozie, Airflow, HDFS, YARN

• Preferred experience with message queues, specifically Kafka, and working with large data transfer applications/middleware

• Production experience in search technologies such as Solr, OpenSearch, or Lucene is highly advantageous

Opis

We seek Lead Big Data Developers with cloud experience to join our growing Data Practice. The projects we are working on are diverse, covering all technologies and solutions currently available on the market and represented by open-source communities. We provide our service to clients in various domains: financial, health care, insurance, and many others, so as a Lead Big Data Developer, you will have a chance to develop yourself in any direction you want. Responsibilities Develop and implement innovative analytical solutions using Cloud Native, Big Data, and NoSQL-related technologies Develop and implement Cloud/On-Premise/Hybrid solutions using best-in-the-class data frameworks Work with product and engineering teams to understand requirements and evaluate new features and architecture to help drive decisions Build collaborative partnerships with architects, technical leads and key individuals within other functional groups Perform detailed analysis of business problems and technical environments and use this in designing quality technical solution Actively participate in code review and test solutions to ensure they meet best practice specifications Build and foster a high-performance engineering culture, mentor team members and provide the team with the tools and motivation Write project documentation Requirements 4+ years of experience in software development with Big Data technologies Advanced knowledge of one of the languages: Python, Scala or Java Vast experience with Spark and/or Databricks Experience with Azure or AWS Experience in managing small and mid-size teams using Agile methodology Bachelor's degree in Computer Science, Mathematics, related technical field or equivalent practical experience Nice to have Production experience with one or more of the following tools: Hadoop, Spark, Kafka, Oozie, Airflow, HDFS, YARN Preferred experience with message queues, specifically Kafka, and working with large data transfer applications/middleware Production experience in search technologies such as Solr, OpenSearch, or Lucene is highly advantageous

Słowa kluczowe / Umiejętności