Skip to main content

Job Description

   Back

Lead - Hadoop Developer

20-12-2024 12:04:25

9 - 12 years

  • Chennai, Tamil Nadu, India (CHN)

Senior Hadoop developer with Spark/Java knowledge. (9 to 12 years)

In depth- hands on experience of developing, testing, deployment and debugging of Impala jobs Scheduled through oozie workflows in Hadoop Platform

In depth knowledge of Impala Optimization Techniques and Best Practices.

Hands on experience of working in Hadoop Environment (HDFS/Hive), Impala, Cloudera

Should have a base understanding of Java and Cluster configurations for troubleshooting

Understanding and exposure to file formats such as AVRO, Parquet

Experience on using GIT, resolving conflicts, working with branches and CI/CD in Azure pipelines

Solve production problems when needed 24x7 Develop and document best practices for data migration.

Excellent analytical skills

Good communication skills

Should have good knowledge of Unix, SQL, RDBMS, Postgres, HiveQL and No SQL database such as memsql.

Willingness to understand the business and participate in discussions about project requirements.

Experience with data modelling, warehousing and building ETL pipelines

Should have knowledge in Sqoop to transfer the data from Source to Hadoop.