Associate Team Lead, AI Engineering

I build agentic systems and retrieval infrastructure.

5+ years building production Distributed & AI systems from scratch: GraphRAG retrieval, local LLM inference and search clusters at scale. I publish my research with the failures included.

01 About

I lead an AI engineering team in India. My work sits where LLM applications meet infrastructure: retrieval and memory for agents, local LLM inference, and the queues, search clusters and services that keep them running in production.

On the side I do research and publish it with the failures included. Each experiment has a design doc and a results doc, and negative results stay in.

  • Retrieval for code and agentsBM25, dense, hybrid and graph-based retrieval, and how to measure whether any of it helps
  • Persistent memory for LLM agentsStructured, auditable memory instead of ever-longer context windows
  • LLM infrastructureLocal inference (Ollama, SGLang, vLLM), gateways with caching, fallback and cost tracking
  • Distributed systemsElasticsearch, Kafka, Celery, Redis, PostgreSQL, Kubernetes
  • Privacy-minded AI toolingPII masking, encrypted storage, audit trails, human-in-the-loop design

02 Experience

What I've shipped

Figures in this section are taken from my resume.

9engineers led
170B+records indexed (84TB)
100K+cases analysed per day
20xingestion throughput scaling

Associate Team Lead

Izoologic Inc. · Dark Web Intelligence & AI Systems · India · Sept 2023 – Present

  • Lead a 9-engineer team owning all AI infrastructure and threat-intelligence systems end to end (architecture, execution, production), directly driving 90% of all downstream threat detections and automated client alerting.
  • Architected and operate production Elasticsearch infrastructure indexing 170B+ records across 84TB of intelligence data, with custom analyzers, ILM policies and query optimization for sub-second latency on deep investigations.
  • Engineered a high-throughput AI analysis pipeline processing 100K+ cases/day using local LLM inference (SGLang/Ollama), containerized with Docker and orchestrated through Redis/Celery task queues. Eliminated external API costs, saving $50K–$100K/year, with sub-100ms inference latency per case.
  • Designed an end-to-end GitHub brand-abuse and data-leak detection pipeline for an enterprise client: keyword-driven preprocessing, context assembly (screenshots to S3, code to Qdrant embeddings), a multi-model inference stack (Qwen 7B for vision, Mistral 24B verification, Mistral 7B judge), Kafka topic partitioning, Redis queuing, PostgreSQL state and Kubernetes auto-scaling, reaching over 95% precision on newly leaked repositories.
  • Optimized filtering across 100B+ combo records and 60B+ stealer records, cutting query latency by more than 70% with custom Elasticsearch templates and distributed pre-filtering.
  • Re-engineered distributed Telegram ingestion and scraping workflows for 20x throughput (100–200 to 2K–5K files/day) through Kafka partitioning and worker-pool optimization.
  • Built resilient multi-source monitoring agents for exposed infrastructure, S3 bucket leaks, .onion sites and GitHub repositories, automating dark web threat-surface discovery and client notifications.

Support DevOps Engineer

BBI Pvt. Ltd. · India · Nov 2021 – Sept 2023

  • Orchestrated migrations of on-premise monolithic applications to distributed AWS architectures (EC2, HA RDS, S3, CloudFront), reducing deployment friction and enabling multi-region failover.
  • Reduced average deployment times by 60% through targeted CI/CD automation (GitHub Actions, Docker image optimization).
  • Designed proactive monitoring dashboards (Datadog/Prometheus), alerting strategies and operational runbooks; maintained over 99.5% uptime across production infrastructure.

Education & certifications

B.Tech, Computer Engineering, Poornima College of Engineering, Jaipur, India · Aug 2017 – Oct 2021

03 Research

Experiments, failures included

Every claim below is backed by a results document in the linked repository, including the parts that did not work.

CodeGraph-TACM

Topology-Aware Context Manager · retrieval for coding agents

A resolver that scores files, classes and functions from several graph signals and packs the best ones into a fixed token budget, compared against BM25, dense and hybrid retrieval over six experiments.

  • On 47 SWE-bench Lite and Multilingual Python instances, density-gated personalised PageRank reached Hit@5 36.2% vs 27.7% for a BM25 + MiniLM hybrid, at no ML inference cost.
  • MRR (0.198 vs 0.192) stays inside the confidence intervals, and the write-up says so.
  • Negative results are published too: query-side identifier expansion gave no improvement at any tested scale.

N-Dimensional Memory

An external memory for LLM agents

An LLM extracts entities per turn; a deterministic engine owns identity, time, attribution and what counts as a fact versus a claim, then builds a short question-specific view for the answering model.

  • Strongest where retrieval is weakest: speaker attribution (7/8 vs 5/8 for reading the raw text on false-premise questions) and dates (7/7 temporal questions).
  • At equal size it only tied BM25 retrieval, so the project is documented and closed as a negative result.

04 Projects

Selected projects

gdpr-llm-proxy

Proxy that masks personal data before an LLM call leaves the EU and restores it in the response. Presidio detection, a Fernet-encrypted token store with TTL, 55 tests.

euaiact-compliance

EU AI Act risk-tier classifier: rules decide the tier, retrieved regulation text (Qdrant) justifies it, and every decision is audit-logged.

practice-ops-agent

Multi-tenant back-office assistant for small clinics: scheduling, billing support and triage, with field-level encryption and AI actions that wait for human approval.

LNSBotz

FastAPI platform of AI utilities behind one API: a model gateway with caching, fallback and cost tracking, Celery workers, accounts, plans and payments.

VSCARS

Beta: a cloud relay plus CLI that lets you use your own dev machine, with terminal, files, git and AI chat, from a phone or any browser. This repository holds the docs and the installer.

Declutter

Chrome extension that hides page clutter and remembers your choices per site, with zero network calls.

All repositories on GitHubEach README says plainly what works and what does not.

06 Skills

The toolbox

AI systems
Agentic AI, advanced RAG, GraphRAG, knowledge graphs, retrieval architectures, persistent memory systems, LangChain, LangGraph, LlamaIndex
LLM infrastructure
Model serving (Ollama, SGLang, vLLM), local inference pipelines, KV cache optimization, GPU memory management, continuous batching, prefix caching
Search & retrieval
Elasticsearch (multi-TB scale), FAISS, Qdrant, vector, hybrid and semantic search, BM25, HNSW, ANN search
Backend & distributed systems
Python, FastAPI, Django, Celery, Redis, Kafka, PostgreSQL, Neo4j, Docker, Kubernetes, async I/O
Infra & cloud
AWS, CI/CD, Grafana, OpenTelemetry, distributed architecture, event-driven pipelines

07 Contact

Open to conversations about retrieval, agent memory and LLM infrastructure.

Let's talkpm10182000@gmail.com