[Wombi] Big Data Engineer

Apr 5, 2022 02:31 PM
Hiring Manager
Related to Vacancies Tracker (Vacancy)
Salary, $
Wombi - google analytics for Web3 is looking for Big Data Engineer to join our team on full-time basis. Wombi connects the knowledge about DApp users from the web to their on-chain and in-app activity
Job description
As a member of Wombi team, you will build a large-scale, real-time analytics tool to help web3 developers understand the behavior of their users.
Duties and Responsibilities
  • Responsible for the building, deployment, and maintenance of a data platform that processes data quickly at big data scales
  • Contributes design, code, configurations, and documentation for components that manage data ingestion, batch processing, data extraction, transformation, and loading across multiple data sources
  • Performs development, QA, and dev-ops roles as needed to ensure total end to end responsibility of solutions
  • Works directly with business analysts and data scientists to understand and support their use cases
Required skills:
  • Product and a customer-focused mindset
  • 4+ years of experience coding in Python or Java with SQL
  • 3+ years contributing to production deployments of large backend data processing and analysis systems
  • 2+ years of hands-on implementation experience working with a combination of the following technologies: Spark, Kafka/Kinesis, Hive/Glue, Kubernetes/EMR
  • 2+ years of experience in cloud data platforms — AWS
  • Knowledge of SQL
  • Knowledge of Data Lake, design, implementation, and optimization
  • Knowledge of BI reports and dashboards design and implementation
  • Knowledge of development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations
  • Experience designing, documenting, and defending designs for key components in large distributed computing systems
  • Ability to handle multiple competing priorities in a fast-paced environment
  • Implementing GDPR compliance is a big plus
Education and degree:
Masters or Bachelor's Degree in a quantitative field (Math, Statistics, Computer Science, Engineering, Data Science, Operations Research, etc.).
Specialized knowledge:
  • Development Tools (Git, GitLab)
  • CI/CD processes
  • Understanding of software development company functioning
  • Understanding of software development life cycles
Skills and abilities:
  • Team playing and result orientation skills
  • Self-management skills
  • A desire to work in a fast startup environment