Qualifications / Requirements

• Proficiency with Python language to analyze and organize raw data;
• Knowledge of AWS, especially Data Lake (Glue, Athena);
• Experience with Apache Spark;
• Experience building and optimizing ETLs, data pipelines, architectures and data sets;
• Experience with implementation of any data warehouse;
• 4-5 years of experience;
• Master’s degree in computer science or related field;
• English – upper intermediate level;
• Strong middle – Senior;

Responsibilities

• Building Data Lake tables using AWS Glue (Spark);
• Data ingestion using Apache NiFi and AWS services;

Nice to have

• Experience with NiFi would be a big plus;
• Knowledge of Scala language (Akka http, actors, streams) would be a big plus;
• Experience with Druid;
• No-SQL DBs like Mongdb;
• any RDBMS;