brand logo
View all jobs

Pyspark Developer

Remote, Chennai, Hyderabad, Bangalore
Job Description
Tiger Analytics is a global analytics consulting firm. With data and technology at the core of our solutions, we are solving some of the toughest problems out there. Our culture is modeled around expertise and mutual respect with a team first mindset. Working at Tiger, you’ll be at the heart of this AI revolution. You’ll work with teams that push the boundaries of what-is- possible and build solutions that energize and inspire. We are headquartered in the Silicon Valley and have our delivery centers across the globe. The below role is for our Chennai.

About the role:

You will work on teams building a variety of big data analytics solutions including big data
lakes. More specifically, you will work on:
Scalable data ingestion pipelines to handle real time streams, CDC events, and batch data 
High-performance data processing for structured and unstructured data, and data harmonization
Scheduling, orchestrating, and validating pipelines
Exception handling and log monitoring for debugging
Collaborate with business consultants, data scientists, engineers, and application developers to develop analytics

Job Requirement
Required Experience, Skills & Competencies:

Hadoop ecosystem - HDFS, Hive, Sqoop, Kafka, ELK Stack etc
Spark, Scala, Python and core/advance Java
NOSQL databases e.g. Hbase, Cassandra, MongoDB
Relevant AWS or Azure components required to build big data solutions
Good to know: Databricks, Snowflake
Ability to develop and manage scalable Hadoop cluster environments
Good understanding of data warehousing concepts, distributed systems, data pipelines, ETL
3+ years of professional experience with at least 2 years in big data engineering

Designation will be commensurate with expertise/experience. Compensation packages are among the best in the