Siddharth Agarwal

Dr. Siddharth Agarwal

PhD · Cloud Computing & Distributed Systems

I am a cloud researcher and engineer with a PhD in serverless computing optimisation — focusing on cold start reduction, intelligent autoscaling, and dynamic function configuration. My work applies reinforcement learning and ensemble methods to real-world cloud platforms including OpenFaaS and AWS Lambda.

Available

Open to new roles and consulting engagements, based in Melbourne.

Looking for

Postdoctoral Fellow

Lecturer (Level B)

Cloud / Platform Engineer

Cloud consulting →

siddharth13103410@gmail.com

Contributions

Three interlocking problems in serverless resource management — each investigated empirically and validated against industry baselines.

Cold Start Frequency Reduction

RL

Static keep-alive policies cannot adapt to on-demand invocation patterns, causing unavoidable cold starts that spike tail latency.

  • Both on-policy (PPO) and off-policy (Q-learning) RL policies investigated
  • Validated on AWS Lambda & OpenFaaS under diverse workload traces
  • Significantly reduced cold start events vs. keep-warm & reactive baselines

Input-Aware Memory Configuration

ML

Fixed memory limits are chosen conservatively, systematically over-provisioning compute and inflating cost regardless of actual function workload.

  • Multi-output Random Forest trained on function input characteristics
  • 57–87% cost reduction vs. static allocation baselines
  • R² up to 98% for execution time · 96% for memory prediction

Adaptive Autoscaling under Workload Uncertainty

RPPO

Threshold-based HPA cannot anticipate bursty or time-varying workloads, leading to under-scaling, SLA violations, and wasted idle replicas.

  • Recurrent PPO (RPPO) proposes on-policy scaling — outperforms DRQN baseline
  • 22% throughput improvement vs. standard Kubernetes HPA
  • 37% reduction in resource wastage across heterogeneous workloads

Publications

Google Scholar

Under Review · 2 papers

Projects & Tools

Saarthi AI-Powered

Intelligent serverless platform with workload prediction, mathematical optimisation, and automated resource management. Achieves 1.84× cost reduction and 97.2% SLA compliance benchmarked against AWS Power Tuning and standard HPA.

OpenFaaSOpenFaaS PythonPython KubernetesKubernetes
Live Demo
Serv-Drishti Interactive

Interactive visualisation engine for serverless computing internals — request routing, resource management, and performance analytics in real time.

JavaScriptJavaScript Chart.jsChart.js DockerDocker
Live Demo
DRe-SCale RL-Based

Proposes Recurrent PPO (RPPO) for intelligent serverless autoscaling. Outperforms DRQN and standard HPA — achieving 22% throughput improvement and 37% resource wastage reduction. Published at IEEE TSC 2024.

PythonPython KubernetesKubernetes PyTorchPyTorch
GitHub
MemFigLess Cost-Optimised

Input-aware dynamic memory configuration for serverless functions using Random Forest ensemble learning. Achieves 57–87% cost savings and 54–82% memory allocation reduction vs. static baselines on AWS Lambda.

AWSAWS Lambda PythonPython DynamoDBDynamoDB
GitHub
OpenFaaS Tutorial Educational

Comprehensive 8-chapter deep dive into OpenFaaS internals: gateway architecture, watchdog, metrics, and practical implementations with code examples.

GoGo KubernetesKubernetes DockerDocker
GitHub
FaaSTrainGym Serverless RL

Serverless reinforcement learning training platform integrating OpenFaaS with OpenAI Gym for scalable, distributed RL experiment pipelines.

OpenFaaSOpenFaaS PythonPython PyTorchPyTorch
GitHub

Experience

Sep 2021 — Feb 2026

Graduate Research Fellow (PhD)

qCLOUDS Laboratory · University of Melbourne

Led 4+ end-to-end research projects. Designed Kubernetes clusters (5–20 nodes) on Melbourne Research Cloud (NeCTAR) and AWS. Built Saarthi, MemFigLess, DRe-SCale, and Serv-Drishti. Supervised by Prof. Rajkumar Buyya & Dr. Maria Read.

PythonPython AWSAWS KubernetesKubernetes OpenStackOpenStack

Mar 2023 — Present

Sessional Academic — Head Tutor

University of Melbourne

Leading postgraduate tutorials for Distributed Systems (COMP90015, 100+ students/semester) and Distributed Algorithms (COMP90020). Also tutored Cluster & Cloud Computing, Advanced Database Systems, and Statistical Machine Learning.

Mar 2026 — Present

Sessional Academic

Monash University & RMIT University

Postgraduate cloud architecture, distributed systems, and cloud security tutorials at Monash. Weekly algorithm tutorials (25–30 students), assignment feedback, and curriculum collaboration at RMIT.

Aug 2020 — Jun 2021

Research Intern (Vocational Placement)

Telstra / University of Melbourne

Deployed serverless environments on Melbourne Research Cloud; investigated cold-start optimisation; delivered architectural recommendations to Telstra engineering stakeholders.

Apr 2018 — Jun 2019

Associate Systems Engineer

IBM India, Bengaluru

Developed and managed Archer CMS enterprise applications and SQL databases; led automation initiatives; client presentations and team knowledge transfer.

JavaJava SQLSQL

Education

2021 — 2026 · Conferred 31 March 2026

Doctor of Philosophy — Engineering and IT

University of Melbourne

Learning-Centric, Payload and QoS-Aware Function Resource Configuration and Management in Serverless Computing

Supervisors: Prof. Rajkumar Buyya & Dr. Maria Read

Melbourne Research Scholarships (fee offset + stipend) · Melbourne Welcome Grant (2022)

Engineering and IT Conference Travel Grant (2024)

Best Paper Award (Runner-Up), IEEE/ACM CCGrid 2021

2021 · Conferred 30 July 2021

Master of Science (Computer Science) with Distinction

University of Melbourne

WAM: 89.846 · Dean's Honours List, Faculty of Science (2021)

Supervisor: Prof. Rajkumar Buyya

2013 — 2017

B.Tech (Hons) in Computer Science & Engineering

Jaypee Institute of Information Technology, Noida, India

GPA: 8.5 / 10

Skills & Technologies

Cloud & Orchestration

AWSAWS GCPGCP OpenStackOpenStack KubernetesKubernetes DockerDocker OpenFaaSOpenFaaS

Languages & DevOps

PythonPython JavaJava GoGo SQLSQL AnsibleAnsible GitHub ActionsGitHub Actions PrometheusPrometheus GrafanaGrafana

ML & Research

PyTorchPyTorch Scikit-learnScikit-learn NumPyNumPy DynamoDBDynamoDB

Blog Posts

All posts

Contact

I am open to research collaborations, academic discussions, and opportunities in cloud computing and distributed systems. Feel free to reach out.

Stay Updated

Get notified when I publish new posts on cloud computing and distributed systems research.