brand logo
View all jobs

AWS Senior Data Engineer

Chennai, Bangalore, Hyderabad, Remote
Job Description

About the role:

We are looking for a Senior Data Engineer to be based out of our Chennai office. This role involves a combination of hands-on contribution, customer engagement, and technical team management. As a Senior Data Engineer, you will
● Design and build solutions for near real-time stream processing as well as batch processing on the Big Data platform.
● Set up and run Hadoop development frameworks.
● Collaborate with a team of business domain experts, data scientists, and application developers to identify relevant data for analysis and develop the Big Data solution.
● Explore and learn new technologies for creative business problem-solving.

Job Requirement
Required Experience, Skills & Competencies:

● Ability to develop and manage scalable Hadoop cluster environments
● Ability to design solutions for Big Data applications
● Experience in Big Data technologies like HDFS, Hadoop, Hive, Yarn, Pig, HBase, Sqoop, Flume, etc
● Working experience on Big Data services in any cloud-based environment.
● Experience in Spark, Scala, Kafka, Akka, core or advanced Java and Databricks
● Knowledge of how to create and debug Hadoop and Spark jobs
● Experience in NoSQL technologies like Hbase, Cassandra, MongoDB, Cloudera, or Hortonworks Hadoop                     
● Familiar with data warehousing concepts, distributed systems, data pipelines, and ETL
● Familiar with data visualization tools like Tableau
● Good communication and interpersonal skills
● Minimum 8+ years of Professional experience with 3+ years of Big Data project experience
● B.Tech/B.E from reputed institute preferred