As a Senior Software Engineer, you will work on teams building a variety of big data analytics solutions including big data lakes. More specifically, you will work on:

· Scalable data ingestion pipelines to handle real-time streams, CDC events, and batch data

· High-performance data processing for structured and unstructured data, and data harmonization

· Scheduling, orchestrating and validating pipelines

· Exception handling and log monitoring for debugging

· Collaborate with business consultants, data scientists, engineers, and application developers to develop analytics solutions

#LI-UNPost

· Hands-on experience with:

Hadoop ecosystem - HDFS, Hive, Sqoop, Kafka, ELK Stack, etc

Spark, Scala, Python, and core/advanced Java

NoSQL databases e.g. Hbase, Cassandra, MongoDB

Relevant GCP components required to build big data solutions

Good to know: Databricks, Snowflake

· Ability to develop and manage scalable Hadoop cluster environments

· Good understanding of data warehousing concepts, distributed systems, data pipelines, ETL

· 3+ years of professional experience with at least 2 years in big data engineering

Designation will be commensurate with expertise/experience. Compensation packages are among the best in the industry.

#LI-UNPost