Warszawa, mazowieckie

Support Team Lead - Hadoop DevOps

RESPONSIBILITIES:

  • Being a bridge between cluster users and hadoop administrators
  • Developing Cluster monitoring tools that would make the monitoring process easier
  • Cluster maintenance and outage mitigation for Big Data ecosystem
  • Problems identification & rootcause analysis
  • HDFS support and ongoing administration of Hadoop infrastructure, incl. VLAN management
  • Debugging the production job failure to find the root cause and fixing the issue

WE ARE OFFERING:

  • Opportunity to
    remote working
  • Private Medical
    Care on favourable
    terms
  • Free parking spot
  • Long-term cooperation based on B2B contract
  • Sport cards
    on favourable terms
  • and more …

IF YOU:

  • Have very good command of written and spoken English
  • Have architectural understanding and experience maintenance Apache Hadoop environment (Spark, Hive, NiFi, Airflow) or the passion and desire to learn
  • Have strong working knowledge of UNIX/Linux HA clusters maintenance
  • Have experience across at least one of relational databases, eg.: MySQL, PostgreSQL, Oracle
  • Have architectural understanding and experience administering Apache Hadoop environment (Spark, Hive, Airflow)
  • Have ability to create automation scripts using Bash or Python
  • Have working knowledge of Zabbix, Nagios, Promethes or other monitoring tools

Nice to have:

  • Experience administering Docker and related orchestration systems (ECS, Kubernetes)
  • Experience with continuous integration tools, e.g. Jenkins
  • Knowledge of Kibana and ElasticSearch tools
Inne oferty pracy