Open for Opportunities

Vikas Pratap
Singh

Associate Technical Architect & Data Engineer building scalable ETL pipelines, distributed data systems, and cloud solutions at o9 Solutions.

Scroll
career

Experience

Apr 2025 — Present
Associate Technical Architect
o9 Solutions Inc. · Bengaluru
  • Architecting scalable distributed ETL frameworks using PySpark, Hive, and Apache Airflow, supporting 5+ enterprise production implementations
  • Designing reusable Spark-based transformation patterns leveraging DataFrame API, lazy evaluation, and optimised execution strategies for large-scale datasets
  • Improved Spark job performance through column pruning, broadcast joins, and repartitioning to handle data skew — reducing shuffle overhead in production pipelines
  • Designed centralised data lineage and pipeline observability framework, improving troubleshooting efficiency and system transparency
  • Providing technical leadership on distributed data architecture, mentoring engineers on Spark optimisation and best practices
  • Leveraged AI-assisted documentation to analyse pipeline architectures, identify design gaps, and standardise TDDs, runbooks, and governance frameworks
Mar 2025
Critical Production Resolution — US Client
o9 Solutions Inc. · Onsite, United States
Onsite Engagement
  • Resolved a critical production escalation in an enterprise planning platform directly impacting business operations
  • Diagnosed data pipeline bottlenecks and optimised Apache Airflow DAG scheduling and Apache Hive transformations — improving platform availability by ~40 minutes per day
  • Led large-scale client data cleanup and validation efforts, aligning stakeholders on data requirements and improving reliability for downstream planning workflows
Apr 2023 — Mar 2025
Senior Technical Consultant
o9 Solutions Inc. · Bengaluru
  • Designed and implemented distributed ETL pipelines using PySpark, Hive, Python, and Airflow
  • Processed and validated 100M+ records per week using distributed transformations
  • Enhanced pipeline efficiency, cutting ETL execution time by ~30 minutes per run through targeted query and workflow optimisations
  • Implemented automated monitoring and alerting, ensuring >99% SLA compliance
  • Improved platform adoption by 25% by resolving recurring data quality issues and optimising workflows
Jul 2021 — Mar 2023
Technical Consultant
o9 Solutions Inc. · Bengaluru
  • Built and maintained batch data pipelines using Hadoop, Hive, Airflow, Python, and SQL
  • Reduced batch processing time by ~55 minutes through distributed query optimisation and workflow redesign
  • Improved data processing efficiency by 30% and reduced infrastructure costs by 20%
  • Resolved 50+ production pipeline failures through root cause analysis and long-term reliability improvements
  • Managed end-to-end lifecycle of enterprise data integrations — ingestion → transformation → validation
Feb 2021 — Jun 2021
Intern
o9 Solutions Inc. · Bengaluru
  • Developed Employee Rating Portal — a high-impact feature enhancing client engagement & satisfaction
  • Built end-to-end solutions using Azure, SQL, SSIS & o9 IBPL across multiple projects
  • Revamped two client workspaces and resolved critical bugs
May 2020 — Nov 2020
Engineering Intern
Cadence Design Systems
  • Supported the Design Engineering team in IC verification — running regressions and generating test cases
  • Worked extensively with System Verilog and Perl
May 2019 — Jun 2019
Research Intern
Intelligent Systems Lab, IIT Kanpur
  • Guided by Prof. Laxmidhar Behara on AIoT concepts and practical IoT applications
  • Developed remote-controlled, obstacle-avoidance bots equipped with multiple sensors
academic

Education

B.Tech — Electronics & Communication Engineering
Indian Institute of Information Technology, Pune (IIIT Pune)
2017 – 2021 CGPA 8.85 / 10
Senior Secondary — AISSCE
Sainik School Tilaiya, Koderma, Jharkhand (MoD)
March 2016 88.00%
Secondary — AISSE
Sainik School Tilaiya, Koderma, Jharkhand (MoD)
March 2014 CGPA 9.2 / 10
tech stack

Skills

Programming & Databases
Python SQL Shell SQL Server
Big Data & Cloud
PySpark Apache Hadoop Apache Hive Apache Airflow Delta Lake Databricks Azure GCP
ETL & Data Engineering
ETL Pipelines Data Modeling Data Transformation Data Ingestion SSIS
Tools & DevOps
Git CI/CD Linux
Coursework
Data Structures Algorithms DBMS OOP Operating Systems Computer Architecture IoT & Sensor Data HCI
side work

Projects

Virtual White Board
Dec 2020 — Jan 2021

Python-based teaching board for virtual environments. Uses gesture detection from a live video stream and renders strokes on a canvas — with dual themes, save functionality, and PDF note generation.

Python OpenCV NumPy
Underwater Image Enhancement
Aug 2019 — Dec 2019

Single-image technique to enhance underwater photography without specialised hardware. Based on white balancing, histogram equalisation, and multi-scale fusion.

MATLAB Image Processing
Animal Monitoring System
May 2019 — Jul 2019

IoT system to detect and deter animals from agricultural fields. Pi-camera on a drone successfully detected dogs on the IIT Kanpur campus during live testing.

Python OpenCV Raspberry Pi IoT
recognition

Awards

o9 Spotlight Award — VP Recognition
o9 Solutions

Recognised by the VP of Client Success for resolving a critical production issue and delivering exceptional client support during a high-stakes onsite engagement.

Centralised ETL Framework — Enterprise Adoption
o9 Solutions

Designed a centralised ETL workflow framework that was adopted across 30+ enterprise projects, becoming an internal standard for pipeline architecture.

o9 Spotlight Award — Engineering Excellence
o9 Solutions

Received multiple spotlight awards recognising consistent engineering excellence, technical leadership, and high-impact contributions across client delivery and internal initiatives.

Jul 2023 Nov 2023 May 2024 Aug 2025
connect

Let's Build
Something Great

Currently open to new opportunities in data engineering and technical architecture. Feel free to reach out — whether it's a role, a collaboration, or just a conversation.

Connect on LinkedIn