Job Openings

 

Position : Hadoop Administrator  

 

DEPLOYED AWS EMR CLUSTERS WITH AUTO SCALE FEATURE. 

BUILT S3 BUCKETS AND MANAGED POLICIES FOR S3 BUCKETS AND USED LIFE CYCLE MANAGEMENT TO MOVE DATA FROM ONE STORAGE CLASS TO OTHER STORAGE 

CLASSES (GLACIER). 

SPUN AWS EMR AND AWS OTHER SERVICES WITH TERRAFORM CODING. 

IMPLEMENTED KERBEROS ON AWS EMR CLUSTERS LIKE PERMANENT & TRANSIENT CLUSTERS. 

CREATED TERRAFORM MODULES TO SPUN AWS SERVICES USING CI/ CD PIPELINE. 

MIGRATED ON-PREMISE DATA FROM HADOOP TO AWS S3 BUCKETS. 

INSTALLED THIRD PARTY APPLICATIONS LIKE APACHE NIFI, CELEBRUS & THOUGHTSPOT ON AWS. 

CONFIGURED AWS SNS, SQS SERVICES TO RECEIVE NOTIFICATIONS ONCE THE EMR JOBS COMPLETES. 

CONFIGURED AWS CLOUD WATCH AND CLOUD TRAIL TO TROUBLESHOOT ISSUES. 

CONFIGURED CLOUD WATCH LOGS TO BE PULLED INTO SPLUNK FOR ANOTHER LAYER OF MONITORING LOGS. 

RE-CONFIGURED YARN PLACEMENT POLICIES AFTER IN-DEPTH ANALYSIS OF EXISTING JOBS. 

WORKED WITH AWS SUPPORT TEAMS TO TROUBLESHOOT THE ISSUES. 

INVOLVED IN MIGRATING CDH 5.14.2 TO HDP 2.6.5. 

SUPPORTED EXISTING CLOUDERA PROD, DEV & QA CLUSTERS. 

WORKING ON AFTER MIGRATION ISSUES. 

WORKING ON ASKNOW TICKETS TO RESOLVE USER AND PLATFORM RELATED ISSUES. 

SUPPORTING 900+ NODE PRODUCTION CLUSTER AND SOME OTHER PRE-PROD CLUSTERS. 

COMMISSIONING/ DECOMMISSIONING OF DATA NODES AT THE TIME NODE/ DISK FAILURES AND COORDINATING WITH LINUX TEAM TO FIX THEM. 

HELPING USERS IN ALL POSSIBLE WAYS WHILE MIGRATION IN-PROGRESS (SNAPSHOTS, DISTCP, ACCESS AND HDFS QUOTAS) 

PARTICIPATING IN DAILY, WEEKLY ONSHORE/ OFFSHORE TEAM CALLS. 

ACTIVELY INVOLVED IN PROD MAINTENANCES. 

 

The candidate must have: 

 

  • 1 YEAR EXPERIENCE IN HADOOP STACK, SPARK, NOSQL DB , SNOWFLAKE, DOCKER 

  • KNOWLEDGE OF KUBERNETES, AWS CLOUD, RDBMS 

 

  • Related Master’s Degree, and 1 year of related experience 

  • Possibility of unanticipated travel to client sites and relocation as needed. 

  • If offered employment, must have legal right to work in U.S. EOE.  

 

  

JOB SITE: 7220 Trade Street, Suite# 130; San Diego, CA 92121 AND Possibility of unanticipated travel to client sites and relocation as needed.