Hadoop Kafka Consultant, Stockholm

For a customer we are looking for a Hadoop consultant. You will join a financial company, where your primary responsibilities will be to:

- Be a leading part in defining identifying points needed to be managed in Exploration Hub
- Together with the rest of the team be responsible for data and information content, metadata management
- Translating business needs to technical specifications
- Build, maintain and improve data pipelines that retrieve data
- Build, maintain and improve Data warehouses
- Develop, maintain and manage current Kafka setup, local and in the cloud
- Develop, maintain and manage current Big Data setup, local and in the cloud
- Secure and improve on scalable infrastructure
- Testing
- Technical documentation
- Make sure development is done according to the right principles and architect road map

Start: ASAP
Duration:3-6 months
Location: Stockholm
Work load: 100 %
Working language:  Swedish and English

Your competencies:
- Experienced in Hadoop and Kafka
- Experienced in sourcing in real time using Kafka and Hadoop platforms
- Experience with Spark, SQL and Scala
- Experience with managing Hadoop and Kafka platforms
- Experienced in running and maintaining Airflow for automation and workflow
- Experience with testing and testing methods
- Experience with Terraform and Ansible
- Jira would be an advantage