HADOOP-PYSPARK-PYTHON Architect

From 9 to 14 year(s) of experience
₹ Not Disclosed by Recruiter

Job Description

Roles and Responsibilities

Mandatory Skills: Experience in data engineering and strong data warehousing concepts with understanding of Dimensional Modelling (&Relational).

Experience on RDBMS like MYSQL,Postgresql,Oracle,Teradata Experience in PL/SQL Packages, Procedures, Functions, Triggers, Views and Exception

Working knowledge on SPARK and it's ecosystem : Spark , Spark SQL, Spark Dataframes

Experience in applying HiveQL on tables for data summarization, validation Programming Languages: Python/Java/Scala

Shift Working: 2nd Shift (2pm-11pm)

Job Description: -

To build an end to end data pipelines covering data acquisition from multiple sources, loading it into cloud data warehouses, and performing a wide range of transformations following industry-standard data modeling techniques, such as Star Schema, Snowflake, and Data Vault. –

Incumbents should have 3-8+ years of relevant technical experience and be highly proficient in the latest Cloud enabled

Big Data technologies - Extensive working knowledge of Spark, Hadoop, SQL, No-SQL, and at least one programming language (e.g. Java, Scala, or Python) –

Hands-on experience in implementing ETL/ELT pipelines on at least one cloud platform AWS, Google Cloud, or Azure Experience with Snowflake and Google BigQuery will be a distinct advantage. –

Thorough understanding of data modeling, data architecture, and data warehousing techniques on-prem and cloud. –

A good understanding of Data Quality, Data Security, and Data Governance practices is desirable –

Candidates should be familiar with industry best practices for unit testing and regression testing for all ETL/ELT code. –

Capital Market/ Banking domain experience would be highly desirable




Role:Full Stack Developer

Salary: Not Disclosed by Recruiter

Industry:Analytics / KPO / Research

Functional AreaEngineering - Software

Role CategorySoftware Development

Employment Type:Full Time, Permanent

Education

UG:Any Graduate

Company Profile

CHANGE LEADERS CONSULTING

CL is an HR Tech & Consulting firm engaged in Talent management for Analytics & Big Data
Organizations. We are passionate career advisers and community builders supporting brands in
Predictive analytics, Consulting and IOT.
Company Info
X
View Contact Details+

Recruiter Name:Renu

Contact Company:CHANGE LEADERS CONSULTING

Telephone:9560638567

Website:http://careers.changeleaders.in