Big Data Administrator

Job Summary Experienced Big Data Support Engineer providing L2 production support, ensuring the stability, performance, and operational excellence of Big Data platforms while collaborating with L3 teams, architects, and project stakeholders to support infrastructure and technology initiatives. Mandatory Skill-set • 6–8 years of experience in Big Data/Data Platform Engineering within enterprise environment; • Strong hands-on experience with Hadoop ecosystem (HDFS, YARN, MapReduce, Hive, Pig, Oozie, HBase, Flume, Sqoop, HDP);. • Expertise in Apache Kafka administration and support in high-throughput environments; • Experience managing Redis and MongoDB clusters, including replication and sharding; • Hands-on experience with OpenSearch/Elasticsearch and Apache NiFi; • Experience with AWS EMR and good knowledge of AWS Cloud services; • Strong Linux system administration skills; • Proficiency in Shell scripting and/or Python scripting; • Experience with Kerberos authentication, access management, and data security controls; • Proven experience supporting high-volume, low-latency production systems; • Strong troubleshooting, incident management, and performance tuning capabilities; • Excellent communication, analytical, and problem-solving skills. Desired Skill-set • Experience supporting payment systems, banking platforms, trading systems, or financial services environments; • Knowledge of regulatory compliance, audit requirements, and data governance practices; • Experience with disaster recovery planning, high-availability architectures, and resilience engineering; • Exposure to DevOps, automation, and infrastructure monitoring tools; • Experience leading technical discussions, mentoring team members, and driving service improvements; • Understanding of enterprise architecture and large-scale distributed systems; • Familiarity with ITIL processes and production support best practices. Responsibilities • Provide L2 production support and administration for Big Data platforms, ensuring high availability, stability, and performance; • Manage and support Hadoop ecosystem components including HDFS, YARN, MapReduce, Hive, Pig, Oozie, HBase, Flume, and Sqoop; • Administer and optimize Apache Kafka, Apache NiFi, Redis, MongoDB, OpenSearch/Elasticsearch, and AWS EMR environments; • Perform cluster lifecycle management including provisioning, scaling, patching, upgrades, and decommissioning; • Monitor system health, troubleshoot incidents, conduct root cause analysis, and drive resolution of critical production issues; • Ensure data security through Kerberos authentication, access governance, encryption, and compliance with regulatory requirements; • Implement capacity planning, performance tuning, disaster recovery, and failover strategies; • Review technology changes, identify risks, and ensure production readiness of new solutions; • Develop and maintain operational documentation, runbooks, SOPs, and architecture guides; • Collaborate with architects, developers, service managers, and project teams on technology roadmaps and transformation initiatives; • Mentor team members, promote best practices, and contribute to continuous service improvement. Should you be interested in this career opportunity, please send in your updated resume to sandhya.p@sciente.com at the earliest. When you apply, you voluntarily consent to the disclosure, collection and use of your personal data for employment/recruitment and related purposes in accordance with the SCIENTE Group Privacy Policy, a copy of which is published at SCIENTE’s website (Privacy Policy | SCIENTE Confidentiality is assured, and only shortlisted candidates will be notified for interviews. EA Licence No. 07C5639