Dehazelabs
DevOps Engineer
8mo ago
216000 –240000 USD / yearWorldwideRemotehadoophbasescyllahivekafkastormpuppetansible+7
DevOps Engineer responsible for managing and automating large-scale Hadoop/Big Data infrastructure and ensuring system reliability and performance.
Responsibilities
- We are seeking a skilled DevOps Engineer to join our Hadoop/Big Data Infrastructure Team . The role involves managing and supporting large-scale distributed systems and automating infrastructure operations across global data centers. You will play a key role in ensuring system reliability, scalability, and performance across 5000+ compute, storage, and distributed systems.
- Provide operational support for Hadoop clusters and other Big Data tools such as HBase, Scylla, Hive/Hue, Kafka, and Storm.
- Automate deployments and operations to enhance efficiency and reliability.
- Perform upgrades of Hadoop and associated tools as required.
- Fine-tune configurations using management tools such as Puppet and InfraDB (in-house Ruby on Rails CM Database).
- Orchestrate deployments and services using Ansible.
- Implement continuous integration processes following change management protocols using Git and Gerrit.
- Develop monitoring and alerting scripts using Python and Bash/Shell.
- Monitor system health using tools like Nagios, Graphite, Grafana, OpenTSDB, and Prometheus.
- Troubleshoot and optimize system and service performance.
- Collaborate with cross-functional teams, including Data Center Operations, NOC, Network, Database, and Engineering.
- Track and resolve incidents, conduct root cause analysis, and maintain detailed runbooks and documentation.
Requirements
- Bachelor’s degree in Computer Science, Computer Engineering, or a related field.
- Proven experience in DevOps, Big Data infrastructure, or system administration.
- Hands-on expertise in Linux-based systems, automation tools, and monitoring platforms.
- Strong problem-solving and collaboration skills.
Other
- Job Title: DevOps Engineer Employment Type: Full-time Location: Remote Shift: Night Shift