About Me
Get to know me better
Pawan
Software Engineer
Backend / Platform Engineer with 4.6+ years of experience designing, building, and operating production-grade backend systems using Python, Django, FastAPI, and JavaScript. Strong background in cloud-native architecture on AWS, data engineering with PostgreSQL and Apache Airflow, and enterprise automation including cybersecurity workflows, ETL pipelines, and access control systems (RBAC / ACL).
Hands-on experience building scalable APIs, distributed backend services, and data pipelines, with exposure to Apache Arrow, Control-M, Redis, Kafka, and message-driven architectures. Recently focused on modern AI systems, including Agentic AI, Retrieval-Augmented Generation (RAG), vector search, and tool-augmented LLM workflows, supported by IBM and Coursera certifications. Actively building production-oriented platforms that integrate AI capabilities into reliable backend and platform systems with strong emphasis on system design, observability, security, and operational reliability.
My Story
The journey that shaped who I am
I’ve spent my career working on backend systems where correctness, reliability, and long-term thinking matter. Over time, I’ve learned that good software isn’t defined by how quickly it’s written, but by how well it behaves in production—under load, change, and inevitable failure.
My journey began with backend systems, where I learned early that code doesn’t live in isolation. It lives in production, under real expectations. At Wipro, I worked on cybersecurity automation, building systems for firewall orchestration, phishing response, and gateway protection. Alongside this, I contributed to enterprise ETL workflows using Apache Arrow for efficient in-memory data processing, with Control-M orchestrating scheduled, dependency-driven pipelines. That phase of my career reinforced a lesson that has stayed with me: reliability is not a feature, it’s a responsibility.
At Noveau Labs, the problems changed shape. I moved closer to real-time systems, engineering cloud services that powered video conferencing workflows. Designing and operating systems for recording, storing, and managing sessions at scale pushed me to think beyond requests and responses—to account for concurrency, failure modes, and the quiet complexity behind experiences users expect to simply work.
Later, at ClearTax, I stepped into data engineering and analytics platforms. I built and migrated complex Airflow pipelines and designed an ACL-based authorization system to control access across data tools. Here, correctness mattered deeply. A small mistake didn’t just break functionality—it risked exposing sensitive data. That experience sharpened my respect for system boundaries, governance, and careful design.
Then life intervened.
A family emergency required me to step away from my career fully and without half-measures. It wasn’t a pause I planned, but it was one that changed my perspective. Away from deadlines and deployments, I gained clarity around responsibility, patience, and long-term thinking. When I returned, I did so with a clearer sense of the engineer I wanted to be and the kind of work that genuinely matters.
Today, I’m focused on building production-grade backend and platform systems that integrate modern AI in a disciplined way. I’ve completed IBM and Coursera certifications in Agentic AI and Retrieval-Augmented Generation, and applied them through hands-on projects involving retrieval pipelines, agent orchestration, and tool-based reasoning. My interest lies in using AI as a reliable system component—designed, observed, and operated with the same care as any other critical backend service.
This journey has shaped me into an engineer who values depth, resilience, and thoughtful execution. I don’t just aim to build systems that work—I aim to build systems people can trust.
What I Do
Core expertise and services
Full-Stack Development
Building complete web applications from frontend to backend, with focus on scalability and performance.
Data & Workflow Engineering
Creating ETL and workflow-driven systems for large-scale data processing, scheduling, and dependency-managed pipelines.
Cloud & DevOps
Deploying and managing applications with modern cloud infrastructure and CI/CD pipelines.
API Development
Designing and building robust RESTful APIs with proper authentication and documentation.
AI & Agent Systems
Building agentic and retrieval-augmented AI systems that integrate tools, logs, and knowledge sources into reliable, task-oriented workflows.
Security & Automation
Building security automation and control systems for incident handling, firewall workflows, and policy-driven access enforcement.
Skills & Technologies
Complete technical expertise across the stack
Compute & Application Logic
Writing and structuring the code itself
Languages
Web Frameworks
Frontend & User interface
Data Strategy & Persistence
How data is stored, retrieved, and moved
Relational Databases (RDBMS)
NoSQL Stores
Caching Layer
Event Streaming
Search Engines
Platform Engineering (Infrastructure)
The environment where the code runs
Containerization
Orchestration
Cloud Providers
DevOps & Delivery Automation
The pipeline that moves code to production
CI/CD Pipelines
Version Control
Observability & Reliability (SRE)
Keeping the system healthy and debugging production
Metrics & Monitoring
Visualization
Log Management
All Projects
Complete portfolio of my work
RAG Flashcard Generator
A Retrieval-Augmented Generation (RAG) powered flashcard generator that turns study materials (e.g., PDFs, notes, webpages) into structured flashcards using a pipeline based on LangChain, embeddings,
AEGIS – Autonomous Incident Response Engine
An AI-powered autonomous incident response system that detects production issues, analyzes logs and metrics, identifies root causes, and generates remediation suggestions using a locally hosted large
Local_RAG_Agent
A local Retrieval-Augmented Generation (RAG) agent that loads a .txt or .csv file, embeds its content, retrieves relevant context, and answers user questions using a local language model and vector se
Portfolio Website
A personal portfolio website built with Django and Tailwind CSS to showcase your professional journey, projects, blog posts, and skills with modern UI/UX and responsive design.
Work Experience
My professional journey
Data Engineer
ClearTax
Bengaluru
-Built and maintained 15+ Apache Airflow pipelines to run data ingestion, transformation, and reporting jobs reliably, handling retries, reruns, and failures as part of normal operation.
-Reworked and migrated 25+ older data pipelines into cleaner Airflow workflows, making them easier to debug, monitor, and maintain over time.
-Designed and built a central system to control who can access which data in Metabase, using role-based and table-level permissions
-Developed backend services using Django and Django REST Framework, with PostgreSQL to store permission data safely and Redis to keep permission checks fast and responsive.
-Added self-service access requests, approval flows, and audit logs, making it easy to grant access while keeping a clear records.
-Packaged and deployed the system using Docker, and worked closely with data and platform teams to roll it out smoothly into day-to-day analytics workflows.
Software Engineer
Nouveau LAbs
Bengaluru
-Designed and built backend services for a video conferencing recording system supporting audio-only, video, and hybrid meetings, managing the complete recording lifecycle from initiation to secure download.
-Implemented reliable recording state management using Django and PostgreSQL, ensuring correct lifecycle transitions and data consistency under concurrent and retry-prone conditions.
-Integrated asynchronous processing with Celery and Redis to handle recording finalisation, cloud uploads, and cleanup without impacting live meeting performance.
-Managed large media artifacts using AWS S3 with multipart uploads, while storing recording metadata transactionally in PostgreSQL.
-Secured access to recordings through authenticated APIs and time-limited pre-signed URLs to prevent unauthorized access and data leakage.
Software Developer
Wipro Limited
Bengaluru
-Developed Python-based security automation bots for firewall operations, phishing incident handling, gateway checks, URL/IP reputation validation, and PKI certificate renewal.
-Automated security workflows using ServiceNow Orchestrator and Control-M, reducing manual operational effort and improving response consistency.
-Built reusable orchestration modules and validation layers for reliable, auditable security process execution.
-Designed and delivered a Django-based CRM dashboard with role-based access control and secure authentication.
-Developed a customer onboarding platform and backend services using Django and PostgreSQL on AWS RDS/S3 infrastructure.
Education
My academic background
Integrated M.Sc. in Mathematics & Computing
Birla Institute of Technology (B.I.T.) Mesra, Ranchi
2013 - 2018
Grade: {{ edu.grade }}
Visit Institution
Matriculation in Science
D.A.V. Public School, Simdega
2009 - 2010
Grade: {{ edu.grade }}
Visit InstitutionCertifications
Professional credentials and achievements
IBM RAG and Agentic AI Specialization.
IBM
Issued: Jan 2026
• Built job-aligned GenAI applications including RAG, multimodal, and agentic AI systems through hands-on projects • Designed and chained AI tools using LangChain to create modular, reusable GenAI workflows • Implemented function calling, RAG pipelines, and vector stores for context-aware AI applications • Created autonomous AI agents using LangGraph, CrewAI, and AG2 for real-world use cases
View Credential
Building AI Agents and Agentic Workflows
IBM
Issued: Jan 2026
• Developed agentic AI applications integrating tools, reasoning, and reflection-based performance improvement • Designed AI agents with LangGraph using memory, iteration, RAG, and workflow design patterns • Orchestrated multi-agent systems with CrewAI for coordinated, collaborative workflows • Built conversation-driven agentic assistants using BeeAI and AG2, and evaluated frameworks for real-world applicability
View Credential
AI Agents and Agentic AI in Python: Powered by Generative AI
Vanderbilt University
Issued: Sep 2025
• Built autonomous AI agents in Python to perform independent, API-driven tasks • Mastered core and advanced agent concepts including agent loops, tool integration, and multi-agent design • Optimized AI agents for real-world use with focus on resilience, efficiency, and predictable behavior
View Credential
Generative AI for Software Developers Specialization.
IBM
Issued: Jul 2025
• Identified real-world generative AI use cases and evaluated major GenAI models and tools across text, code, image, audio, and video • Applied prompt engineering concepts and techniques to design effective, high-impact prompts using common tooling • Generated code snippets, scripts, test cases, and small applications using generative AI models • Built software engineering solutions leveraging AI-powered developer tools and LLM platforms
View Credential
Algorithmic Toolbox
University of California San Diego
Issued: Jul 2017
• Applied core algorithmic techniques and patterns • Designed efficient, complexity-aware algorithms • Solved data structure and coding interview problems • Built optimized, reliable solutions
View Credential
Using Python to Access Web Data
University of Michigan
Issued: Jan 2017
• Used regular expressions to extract structured data from text • Understood browser and web protocol fundamentals • Retrieved data from websites and APIs using Python • Parsed and worked with XML data
View Credential
Programming for Everybody
University of Michigan
Issued: Dec 2016
• Configured Python environments and package dependencies using virtual environments and standard tooling • Applied Python language features including dynamic typing, built-in data structures, and modular imports • Implemented stateful logic with variables, collections, and structured data transformations • Developed reusable program logic using functions, control flow, and iterative constructs with error-aware handling
View CredentialLatest Articles
Insights and knowledge sharing
My Philosophy
How I approach work and projects
Quality Over Quantity
I believe in writing clean, maintainable code that stands the test of time. Every line should have a purpose, and every feature should add real value.
Collaboration First
Great solutions come from great teamwork. I value open communication, knowledge sharing, and building together with stakeholders and team members.
Continuous Learning
Technology evolves rapidly, and so should we. I dedicate time to learning new technologies, patterns, and best practices to stay ahead of the curve.
User-Centric Design
Every decision should prioritize the end user. I build with empathy, ensuring solutions are intuitive, accessible, and solve real problems.
Beyond Coding
Life outside the terminal
Reading
Tech blogs & novels
Gaming & Sports
Strategy games & Badminton
Fitness
Running & yoga
Travel
Exploring new cultures
Music
Classical & indie
Photography
Landscape & urban
Cooking
Experimenting recipes
Mentoring
Helping others learn
Currently
What I'm up to right now
Current Projects
- ▸ Building Aegis, an AI-assisted Incident Resolution Engine using RAG and agent workflows
- ▸ Developing a production-grade backend portfolio platform with Django and Tailwind
- ▸ Implementing agentic AI and retrieval pipelines with LangGraph and vector search
Learning
- ▸ Agentic AI systems and agent-based workflow orchestration
- ▸ AWS cloud architecture and DevOps practices
- ▸ System design and system architecture at scale
- ▸ Advanced Python topics for backend and platform engineering
Open to full-time roles, contract work, and interesting collaborations