BelPrime is a product company that builds tools for Digital Marketers.Our team is looking for a Big Data Engineer to work on an Internet scale data analysis platform.
- 5+ years of experience as Java/Scala developer.
1+ years of experience as Big Data Engineer (Java/Scala/Python/R).
Experience using Hadoop and Spark. Solid understanding of their major design decisions and tradeoffs.
Experience using at least one key-value DB (HBase, Cassandra etc).
Solid understanding of the MR computing paradigm. Practical experience writing MR jobs and workflows.
Ability to troubleshoot performance troubles in MR and Spark jobs.
Solid understanding of well-known algorithms and data structures is a must.
Bonus points for:
Experience in Spark Streaming or Spark Structured Streaming.
Experience using HBase.
Experience using Kafka.
Experience using large scale distributed OLAP storage and query engines (Clickhouse, Druid, Pinot, Drill, etc).
- Write complex MR and Spark workflows that process hundreds of terabytes of data.
Tune and improve existing MR and Spark workflows.
Write ETL workflows for OLAP databases. Write and tune queries for OLAP schemas.
Improve and extend Java-based user-facing frontend services that connect to large scale OLAP deployments.
What we offer:
An opportunity to work on a technologically complex product and impact its development directly.
An office in the city centre with all the corporate niceness.
An extended benefits package.