Big Data Engineer

Main mission

Builds systems for processing massive data (Spark, Hadoop).

5 key responsibilities

• Build distributed processing on massive data (Spark).
• Optimize jobs: partitioning, memory, computing costs.
• Manage clusters and their scaling.
• Ensure the reliability of critical batch chains for the company.
• Migrate legacy processing to modern platforms.

Key skills

Spark, Scala/Python, Hadoop, column formats (Parquet), performance tuning.

What's expected

Massive processing that runs quickly, accurately, and at the right cost.

Career paths

Data Architect, Data Platform Engineer, Streaming Engineer.