brand logo
View all jobs

GCP Senior Software Engineer

Chennai, Bangalore, Hyderabad
Job Description
As a Senior Software Engineer, you will work on teams building a variety of big data analytics solutions including big data lakes. More specifically, you will work on:
· Scalable data ingestion pipelines to handle real-time streams, CDC events, and batch data
· High-performance data processing for structured and unstructured data, and data harmonization
· Scheduling, orchestrating and validating pipelines
· Exception handling and log monitoring for debugging
· Collaborate with business consultants, data scientists, engineers, and application developers to develop analytics solutions

Job Requirement
Required Experience, Skills & Competencies:
· Hands-on experience with:
Hadoop ecosystem - HDFS, Hive, Sqoop, Kafka, ELK Stack, etc
Spark, Scala, Python, and core/advanced Java
NoSQL databases e.g. Hbase, Cassandra, MongoDB
Relevant GCP components required to build big data solutions
Good to know: Databricks, Snowflake
· Ability to develop and manage scalable Hadoop cluster environments
· Good understanding of data warehousing concepts, distributed systems, data pipelines, ETL
· 3+ years of professional experience with at least 2 years in big data engineering
Designation will be commensurate with expertise/experience. Compensation packages are among the best in the industry.