• DATA ENGINEER

Industry IT-Software / Software Services / testing
Location Chennai
Experience Range 8 - 18 Years
Expired

Functional IT Software - Application Programming / Maintenance
Job Description
About Us
Shreshtha Business Solutions is a promising Talent Acquisition Solutions company based at Chennai. We are offering a wide range of staffing solutions across different industries and companies of all sizes. We aim at connecting with the best of prospects so that the companies can focus on their core business. We have an experienced and specialized team of professionals who work in accordance with the needs of our client. They deeply understand the requirements of the business and present the most potential prospects who meet the criterion set by the clients effectively.
Roles and Responsibility

 

DATA ENGINEERING

 

Looking for a Software Engineer to join our Customer Data Engineering team. In this role you will play key part developing application/data processes and services for our customer data to support all our production applications, operation processes, data sciences and business intelligent data processing. Our team works with:

 

Microservices and distributed applications in Java, Python, Spark

Relational data modeling and batch processing on SQL databases

Distributed batch and streaming frameworks like Spark, Spark Streaming

Streaming data platforms like Kafka/Kinesis

PaaS offerings on AWS such as S3, RDS, EC2, Glue, EMR, Redshift, Athena

 

 

Primary Responsibilities

 

Design, develop and maintain scalable applications and services to manage customer related data

Design, develop and maintain scalable Java/Python/SQL based ELT/ETL workflows to transform and integrate data into Data Platform/Data Lake/Data Warehouse

Play multiple roles that span data architecture, design, data warehousing, devops, and ELT/ETL processes

Work closely with product management, business, engineers, cross-functional analysts and data scientist to uncover new insights from our data

Enhance scalability, performance and stability of data infrastructure and processes

 

 

Technical Requirements and Desired Skills

 

8+ years of experience with Java with a focus on modern Java development paradigms (Java8+, Spring Boot, ReactiveX)

5+ years expertise in Python, Java, Spark with wrangling structured and unstructured data ? Parquet/CSV/JSON, and SQL databases ? MySQL/Postgres

3+ years of experience working within an Agile/Scrum and CI/CD environment, using TDD/BDD patterns (ex. JUnit, TestNG, PyTest)

Strong knowledge of computer science fundamentals: object-oriented design and programming, data structures, algorithms, databases, networking

Extensive experience working with structured and unstructured data platforms, ELT/ETL processes and platforms, and data/domain modeling

Experience in the design of new systems or redesign of existing systems to meeting business requirements or changing needs, or newer technology

Bonus points for experience with ML and Stats frameworks, NoSQL databases (Mongo, Cassandra), or search (Solr, ElasticSearch)

 

 

Recruiter Name Uthira kumar
Recruiter Number 9790185272
Recruiter Email Id support@shreshtha.in
A+| A| A-