Pratyush Dwivedi

Pratyush Dwivedi

Mentor
Rising Codementor
US$8.00
For every 15 mins
ABOUT ME
Building my expertise on all things data
Building my expertise on all things data

I am a seasoned Big Data professional with 8 years of experience in designing, building, and optimizing scalable data solutions. A proud alumnus of NIT Rourkela, a premier institute in India, I graduated in 2016 with a strong foundation in computer science.

Over the years, I have honed my expertise in cutting-edge Big Data technologies, including Apache Spark, SQL, Kafka, Google Cloud Platform (GCP), and Airflow. My career spans impactful roles at leading global organizations like Walmart and MasterCard, where I have successfully led and contributed to critical technical projects. These projects have involved implementing robust data pipelines, real-time analytics platforms, and cloud-based solutions to solve complex business challenges.

Driven by a passion for innovation and continuous learning, I thrive on mentoring teams, architecting efficient data ecosystems, and delivering insights that empower data-driven decision-making.

Kolkata (+05:30)
Joined December 2024
EXPERTISE
8 years experience
8 years experience
8 years experience
6 years experience
5 years experience
5 years experience

REVIEWS FROM CLIENTS

Pratyush's profile has been carefully vetted and approved as a Codementor. Connect with Pratyush now, and leave a review for them once you're done!
EMPLOYMENTS
Software Development Engineer - III
Walmart Global Tech
2022-10-01-Present

I am developing applications on Spark Streaming, Kafka and Scala for proper processing of data originating from various streaming sour...

I am developing applications on Spark Streaming, Kafka and Scala for proper processing of data originating from various streaming sources. I am involved in developing of streaming and batch processing applications for Marketing and Advertising technology domain. I have developed data pipelines in apache airflow and Python for various applications which consume data from a variety of sources.

Python
Scala
Apache Spark
View more
Python
Scala
Apache Spark
Apache Kafka
Apache Airflow
View more
Software Development Engineer - II
MasterCard Inc
2020-04-01-2022-10-01

I developed an efficient process to load our final tables correctly which is used by a wide range of customers. Also I automated the o...

I developed an efficient process to load our final tables correctly which is used by a wide range of customers. Also I automated the overall feed generation process for our customers which saved us a lot of manual hours.I used Python,Hive, Impala and Spark for data processing. I used PySpark to develop the applications. The automation pipeline was able to haandle hundreds of customer and deliver the data at the time requested by them.

Python
Apache Spark
Impala
View more
Python
Apache Spark
Impala
HiveQL
View more
Backend Software Engineer
JM Financial Products
2019-04-01-2020-03-01

I worked extensively on Java and Google Cloud APIs for building a scalable backend system for one of the web applications which is bei...

I worked extensively on Java and Google Cloud APIs for building a scalable backend system for one of the web applications which is being developed as a part of B2C business model for the organization. I had worked extensively on Google Cloud Platform, NoSQL Google Cloud Datastore for executing the goals assigned to me as a part of my work. I worked on developing a real estate CRM application pertaining to negotiation module. The module captures the details of negotiation between broker and the customer.

Java
Google Cloud Platform
NoSQL Database
View more
Java
Google Cloud Platform
NoSQL Database
View more
PROJECTS
Data Load Process
2020
I was responsible for automation and development of data load process. My task was to develop an efficient and optimized process based on...
I was responsible for automation and development of data load process. My task was to develop an efficient and optimized process based on Hadoop infrastructure which loads the expected data in our final tables and does it in an efficient manner.
Python
SQL
Apache Spark
View more
Python
SQL
Apache Spark
View more
Sales Compensation System
2017
I have worked on a live project for a very reputed client in electronics and computer market. Several Big Data tools like Talend, Spark, ...
I have worked on a live project for a very reputed client in electronics and computer market. Several Big Data tools like Talend, Spark, Oozie and Hive have been leveraged to analyze and validate data for a sales compensation system. Microsoft Azure has been used as a cloud platform to help us build the above processes.
Talend
Apache Spark
View more
Talend
Apache Spark
View more