Вакансия Big Data Engineer

2 вакансии
Специализация: Other
Уровень: senior
Опыт: 3 года
Уровень английского: Intermediate
Город: Минск
Режим работы: Полный день
Размер команды: 13+
Размер компании: 60

BelPrime is a product company that builds tools for Digital Marketers.Our team is looking for a Big Data Engineer to work on an Internet scale data analysis platform.

Requirements:

  • 5+ years of experience as Java/Scala developer.
  • 1+ years of experience as Big Data Engineer (Java/Scala/Python/R).

  • Experience using Hadoop and Spark. Solid understanding of their major design decisions and tradeoffs.

  • Experience using at least one key-value DB (HBase, Cassandra etc).

  • Solid understanding of the MR computing paradigm. Practical experience writing MR jobs and workflows.

  • Ability to troubleshoot performance troubles in MR and Spark jobs.

  • Solid understanding of well-known algorithms and data structures is a must.

Bonus points for:

  • Experience in Spark Streaming or Spark Structured Streaming.

  • Experience using HBase.

  • Experience using Kafka.

  • Experience using large scale distributed OLAP storage and query engines (Clickhouse, Druid, Pinot, Drill, etc).

Responsibilities:

  • Write complex MR and Spark workflows that process hundreds of terabytes of data.
  • Tune and improve existing MR and Spark workflows.

  • Write ETL workflows for OLAP databases. Write and tune queries for OLAP schemas.

  • Improve and extend Java-based user-facing frontend services that connect to large scale OLAP deployments.

What we offer:

  • An opportunity to work on a technologically complex product and impact its development directly.

  • An office in the city centre with all the corporate niceness.

  • An extended benefits package.

Missing dc2dee645480aabc67b54d291271580aa34628939fceddb02bb23fd5777d20cc
Представитель компании
Вакансии компаний