Warszawa, mazowieckie
Support Team Lead - Hadoop DevOps
RESPONSIBILITIES:
- Being a bridge between cluster users and hadoop administrators
- Developing Cluster monitoring tools that would make the monitoring process easier
- Cluster maintenance and outage mitigation for Big Data ecosystem
- Problems identification & rootcause analysis
- HDFS support and ongoing administration of Hadoop infrastructure, incl. VLAN management
- Debugging the production job failure to find the root cause and fixing the issue
WE ARE OFFERING:
- Opportunity to
remote working - Private Medical
Care on favourable
terms - Free parking spot
- Long-term cooperation based on B2B contract
- Sport cards
on favourable terms - and more …
IF YOU:
- Have very good command of written and spoken English
- Have architectural understanding and experience maintenance Apache Hadoop environment (Spark, Hive, NiFi, Airflow) or the passion and desire to learn
- Have strong working knowledge of UNIX/Linux HA clusters maintenance
- Have experience across at least one of relational databases, eg.: MySQL, PostgreSQL, Oracle
- Have architectural understanding and experience administering Apache Hadoop environment (Spark, Hive, Airflow)
- Have ability to create automation scripts using Bash or Python
- Have working knowledge of Zabbix, Nagios, Promethes or other monitoring tools
Nice to have:
- Experience administering Docker and related orchestration systems (ECS, Kubernetes)
- Experience with continuous integration tools, e.g. Jenkins
- Knowledge of Kibana and ElasticSearch tools
Inne oferty pracy