Sr. Software Engineer
Branch Metrics
2021-06-01-Present
Working with cross-platform linking and attribution platform and helping to provide cross-platform marketing, engagement and measurement ...
Working with cross-platform linking and attribution platform and helping to provide cross-platform marketing, engagement and measurement solutions for over 50k apps using technologies such as Druid, Spark, Flink, Kafka, Airflow, Hive. Our customers generate more than 100 million new URLs, and we process 2.5TB of raw data from over 10B events.
Python
Java
SQL
Apache Spark
Apache Kafka
Apache Flink
Apache Airflow
AWS
View more
Sr. Data Engineer
Capital One
2019-07-01-2021-06-01
● Created data pipeline and API for collecting total inventory data (~200PB) from S3 Inventory Services using EMR so that unregistered da...
● Created data pipeline and API for collecting total inventory data (~200PB) from S3 Inventory Services using EMR so that unregistered datasets can be detected by pattern matching algorithm
● Built an enterprise event processing platform with lambda API that performs real time transformations in streaming data using Scala, Kafka, Terraform and AWS services (DynamoDB, Lambda, CloudWatch, S3)
Scala
API
Amazon S3
View more
Scala
API
Amazon S3
DynamoDB
Apache Kafka
Terraform
AWS Lambda
AWS
View more
Sr. Data Engineer
Optum
2018-04-01-2019-06-01
Built modernized Claim ETL and Reimbursement system in Hadoop platform to make data available in compressed format for data analysis & ML...
Built modernized Claim ETL and Reimbursement system in Hadoop platform to make data available in compressed format for data analysis & ML and have Rest API, Batch & Streaming compatibility using Spark, Kafka, Java, Scala, HBase.
Java
Scala
API
Apache Spark
Apache Kafka
View more