The Big data engineer will be part of the big data division that applies scientific, mathematical and social principles to design, build, and maintain technology products, systems and solutions. These technology products and solutions provide amazing customer experiences while meeting the needs of the business. Job Duties This position will be responsible for implementation and support of the Enterprise Hadoop environment, including design, capacity planning, cluster set up, performance tuning, monitoring, infrastructure planning, scale up/out and administration. Should work towards highly available and performing within agreed on service levels. The candidate will apply a strong understanding of Hadoop eco system such as HDFS, YARN, Map Reduce, HBase, Zookeeper, Pig, Hadoop streaming, and Hive. The candidate should have experience in installing, administering, and supporting Linux operating systems/hardware in an enterprise environment. System administration and programming skills. Storage, performance tuning and capacity management of Hadoop clusters and Hadoop MapReduce routines. Setup, configuration and management of security for Hadoop clusters using SSL, Kerberos and integration with LDAP/AD at an Enterprise level. Monitor Hadoop cluster connectivity and security. Manage and review Hadoop log files. AWS or Cloud Technology experience preferred. Develop and document best practices.

Join Now