Spark Scala Developer

from 4 to 8 year(s) of Experience
₹ Not Disclosed by Recruiter

Job Description

Roles and Responsibilities

1.In depth understanding/knowledge of Hadoop & spark Architecture and its components such as HDFS, Job Tracker, Task Tracker,executor cores and memory params.
2.Experience in Hadoop development, working experience on SPARK, SCALA is mandatory and Database exposure is must
3.Hands on experience in Spark and Spark Streaming creating RDD's, applying operations -Transformation and Actions.
4.Experience in code optimize to fine tune the applications.
5.Expertise in writing Hadoop/spark Jobs for analyzing data using Spark, Scala, Hive, Kafka and Python
6.Experienced with streaming work flow operations.
7.Experience with developing large-scale distributed applications and developing solutions to analyze large data sets efficiently.
8.Integration with Hadoop/HDFS, Real-Time Systems, Data Warehouses, and Analytics solutions. Experience in Data Warehousing and ETL processes.
9.Strong database, SQL, ETL and data analysis skills.
10.Knowledge in Maintaining the Log and Audit information in Hive/SQL tables, Experienced in providing Logging, Error Handling
11.Analyzed large amounts of data sets to determine optimal way to aggregate and report on it.
12.Configured Spark Streaming to receive real time data from the Apache Kafka and store the stream data to HDFS using Scala.
13.Experienced Scheduling jobs using Airflow/ESP.

Desired Candidate Profile

1 Right communication skills to be able to work with Business.
2.Good logical reasoning, analytical abilities. Recommend changes to client software       based on information such as client feedback, language changes and new technology.
3.Experience working with remote teams.
4.Work to become the trusted partner of the Architects by regular engagement and proposals on best development practices which can be implemented and would bring change to the process
5.Excellent Performance and Technical Skills, Attend required training and support peers by sharing knowledge and mentoring.
6.Taking up training programs within your team to ensure understanding of BDF.

Role:Software Developer

Salary: Not Disclosed by Recruiter

Industry:IT Services & Consulting

Functional AreaIT Software - Application Programming, Maintenance

Role CategoryProgramming & Design

Employment Type:Full Time, Permanent


UG:Any Graduate in Any Specialization

PG:Any Postgraduate in Any Specialization

Doctorate:Doctorate Not Required

Company Profile


CL is an HR Tech & Consulting firm engaged in Talent management for Analytics & Big Data Organizations. We are passionate career advisers and community builders supporting brands in Predictive analytics, Consulting and IOT.
Company Info
View Contact Details+

Recruiter Name:Shruty Snehal