Hi, I'm Shanu đź‘‹
13+ Years Building at Scale | Founder @ Anpu AI | Member of Technical Staff @ CloudlyIO | Backend, Data & AI Engineer
SK

About

A pragmatic programmer with a passion for solving problems using technology. I am an accomplished software and data engineer with over a decade of experience architecting and building robust, large-scale distributed systems, data pipelines, and web applications using technologies including Airflow, Spark, Kafka, AWS, Flask, Go, Node.js, and React. My solutions have powered products and platforms handling massive traffic and data volumes.

Work Experience

C

CloudlyIO

January 2026 - Present
Member of Technical Staff
Dehradun, Uttarakhand, India
A

Anpu AI

March 2025 - Present
Founder
Dehradun, Uttarakhand, India
Anpu AI is building Hope, a self-hosted agentic workflow engine for enterprise automation. Hope helps developers, platform teams, operations teams, and business users create, test, validate, and run durable workflows on their own infrastructure. It combines the speed of visual automation with the reliability of event-sourced execution and replay. With Hope, teams can describe a business process, let an AI assistant learn their tools and policies, generate workflow definitions and mocks, validate happy paths and failure paths, and deploy automations that record execution history instead of relying on fragile process memory. Hope is designed for organizations that need private, reliable, AI-native workflow automation across APIs, internal tools, LLMs, cloud events, queues, databases, approvals, and human-in-the-loop processes.
b

bp

December 2023 - March 2025
Senior Data Engineer
Remote
Architected and built robust large-scale distributed systems and data pipelines for bp's energy operations.
B

BairesDev

August 2020 - August 2023
Senior Software Engineer
New Delhi, Delhi, India
Performed code reviews to ensure quality standards were met by development teams. Mentored newly hired software engineers through routine coaching and training opportunities. Developed high-quality, scalable REST APIs using Python, Flask, SQLAlchemy, Postgres, AWS RDS, AWS VPC, and AWS EC2. Optimized database queries and stored procedures for improved performance of AWS Batch Jobs. Designed user interfaces with a focus on usability, accessibility, and responsiveness in React JS (Node JS), Typescript, Redux, and React Query. Developed REST APIs and GraphQL APIs for high-performance microservices using Go lang, GORM, Gin, gqlgen, AWS API Gateway, AWS Cloudwatch, AWS ECS, AWS S3, and AWS Lambda. Developed and implemented data pipelines to ingest, store and process large datasets using Apache Spark, Apache Airflow, AWS Batch, AWS EMR, AWS ECS, Docker, AWS Lambda, AWS Fargate, AWS S3, AWS Cloudwatch, AWS Lambda and Clickhouse DB. Implemented microservices in Python and Golang that uses GitHub Actions for CI and CD to with Pytest for testing and automate deployment processes across different environments using Docker, Kubernetes, AWS Lambda, and AWS S3.
F

Freelancer.com

October 2017 - August 2020
Software Engineer
Dharamshala, Himachal Pradesh, India
Participated in architecture discussions related to product roadmap planning. Created REST API services for clients using Python, Flask, SQLAlchemy, Postgresql, MongoDB, Redis, Celery, and AWS technologies. Managed multiple microservices from concept to completion. Performed code reviews and unit tests to ensure adherence to coding standards in a TDD setting. Hired, trained, and managed a team of 8 software engineers. Implemented responsive design principles to ensure cross-platform compatibility of webpages. Utilized modern frameworks like React JS, React Native and Node.js for developing interactive client-side applications. Setup CI and CD pipelines using Jenkins, Docker, Pytest, unittest, Nose, Cypress, Jest, and AWS.
R

Red Panda Innovation Labs

February 2017 - October 2017
Software Engineer
Pune, Maharashtra, India
Provided support for end users by resolving issues related to the deployed applications. Collaborated with other developers to integrate multiple systems through APIs. Maintained databases by writing complex SQL queries and stored procedures. Built authentication mechanisms using the OAuth2 protocol to protect sensitive information stored within the system's database. Developed API integrations using Django and Flask to connect backend services. Monitored application metrics using monitoring tools like New Relic or Datadog to identify potential problems early on. Created documentation for APIs, databases, and other technical components of the system architecture. Collaborated with frontend developers to integrate user interface elements into applications. Maintained proper coding standards throughout development cycles via linting tools such as ESLint or Flake8 and using TDD for development using Pytest, Jest, and Mocha. Troubleshot issues related to application performance, and availability. Developed and maintained user-facing websites using HTML, CSS, JavaScript, Typescript, and ReactJS.
O

Octro Inc.

August 2015 - February 2017
Member Of Technical Staff
Noida, Uttar Pradesh, India
Participated in Agile and Scrum meetings, sprint planning sessions and retrospectives. Created an in-house distributed build system for our portfolio of mobile games. Used Linux nodes and technologies like Bash, Python, Java, Apache Kafka, Jenkins, Mongo DB, Redis, Apache Casandra, Apache Maven, and C++. Resolved customer issues through debugging and troubleshooting complex problems in production environment. Monitored server logs for errors and took appropriate actions accordingly. Improved performance of a logging microservice written in C by 50%. Changed TCP to UDP with a custom reliability layer, and used Inter-process communication like socket programming and message queues.
A

Aricent

September 2013 - August 2015
Software Engineer
Gurugram, Haryana, India
Used version control systems to track code changes and bug fixes. Participated in regular meetings with stakeholders to discuss progress and plan future roadmap items. Performed debugging and troubleshooting of applications using JIRA and Git. Utilized object-oriented design principles to develop high-quality software components using Python, Django, and MySQL. Resolved many telecommunication related bugs in the SS7 stack application for Oracle Eagle STP using C programming. Wrote unit test cases and functional test cases for multiple applications.

Skills

Google Cloud Platform (GCP)
Domain-Driven Design (DDD)
Electronic Medical Record (EMR)
Distributed Systems
Data Engineering
Backend Engineering
AI Engineering
Python
Go
C
Node.js
React
AWS
Apache Spark
Apache Airflow
Apache Kafka
Docker
Kubernetes
SQL
NoSQL
Microservices
Data Pipelines
LLM Engineering
System Design
Linux
CI/CD
Testing

Certifications

Understanding Data Engineering
Speech Recognition With Python
Agile Scrum
Large Language Models (LLMs) Concepts
Introduction to SQL
My Projects

Check out my latest work

I've worked on a variety of projects, from simple websites to complex web applications. Here are a few of my favorites.

Learn Computer Science from Top Universities for Free

A comprehensive curated list of free computer science courses from top universities around the world. This repository helps students and professionals access high-quality education without cost barriers.

Markdown
Documentation
Curation
Open Source

Akhrot - Machine Learning Library

A super simple machine learning library with batteries included. Built in Python to make machine learning accessible and easy to use for developers and data scientists.

Python
Machine Learning
NumPy
Scikit-learn
Data Science

Asha - Static Site Generator

A static site generator written for lazy developers. Write your posts and pages in markdown and enjoy! Simple, fast, and efficient way to create static websites.

Python
Markdown
Static Site Generation
Jinja2
Web Development

Rangeen - CLI Color Package

A Python 3 package for writing awesome CLI applications with support for ASCII colours and unicode emotes. Makes command-line interfaces more vibrant and user-friendly.

Python
CLI
ASCII Colors
Unicode
Terminal
Blogs

Latest Articles

I write about software engineering, databases, distributed systems, and other technical topics. Here are my latest articles.

Contact

Get in Touch

Want to chat? Just shoot me a dm with a direct question on twitter and I'll respond whenever I can. I will ignore all soliciting.