Pyspark Developer

Remote, Chennai, Hyderabad, Bangalore

Job Description

Tiger Analytics is a global analytics consulting firm. With data and technology at the core of our solutions, we are solving some of the toughest problems out there. Our culture is modeled around expertise and mutual respect with a team first mindset. Working at Tiger, you’ll be at the heart of this AI revolution. You’ll work with teams that push the boundaries of what-is- possible and build solutions that energize and inspire. We are headquartered in the Silicon Valley and have our delivery centers across the globe. The below role is for our Chennai.

About the role:

You will work on teams building a variety of big data analytics solutions including big data

lakes. More specifically, you will work on:

Scalable data ingestion pipelines to handle real time streams, CDC events, and batch data

High-performance data processing for structured and unstructured data, and data harmonization

Scheduling, orchestrating, and validating pipelines

Exception handling and log monitoring for debugging

Collaborate with business consultants, data scientists, engineers, and application developers to develop analytics

solutions

Job Requirement

Required Experience, Skills & Competencies:

Hadoop ecosystem - HDFS, Hive, Sqoop, Kafka, ELK Stack etc

Spark, Scala, Python and core/advance Java

NOSQL databases e.g. Hbase, Cassandra, MongoDB

Relevant AWS or Azure components required to build big data solutions

Good to know: Databricks, Snowflake

Ability to develop and manage scalable Hadoop cluster environments

Good understanding of data warehousing concepts, distributed systems, data pipelines, ETL

3+ years of professional experience with at least 2 years in big data engineering

Designation will be commensurate with expertise/experience. Compensation packages are among the best in the

industry.