Skip to content
View ankit373's full-sized avatar
🎯
Focusing
🎯
Focusing

Block or report ankit373

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
ankit373/README.md

Ankit Jha

What I do

LinkedIn Email Twitter Hydra

views followers total stars Bengaluru

Pac-Man eating my contribution graph

contribution graph · regenerated every 12h by a scheduled Action

   ▼   show more   ▼   
$ whoami --verbose

  ankit373 · Ankit Jha
  ├─ role      Founding Engineer @ Tradomate
  ├─ before    Tiger Analytics · Quantiphi ×2 · Wipro
  ├─ does      platform & cloud architecture · Go · cost engineering
  ├─ cut       40% off AWS · 35% off an LLM product · 27% at Wipro
  ├─ building  Hydra — routes prompts across every model on your machine
  ├─ upstream  grafana/loki · ollama · vllm-project · actions-runner-controller
  ├─ roots     electronics & comms — brain-computer interfaces, fuzzy logic
  └─ where     Bengaluru, India · here since 2015

 ▼  the numbers  ▼ 

3D contribution skyline

1,377 contributions in 2026 296 PRs · 283 issues opened
470 PRs into repos I don't own 200 merged into one platform repo alone
40% / 35% / 27% cloud cost cut across Tradomate, Quantiphi, Wipro
6+ years · 5 roles · 4 companies led a team of 5
on GitHub since May 2015 SOC 2 + HIPAA readiness programs led

 ▼  the stack  ▼ 


LANGUAGES
languages

PLATFORM & CLOUD
platform

OBSERVABILITY & DATA
data

ALSO IN THE TOOLBOX
ClickHouse Karpenter Helm Loki Tempo Teleport SES k6


 ▼  what I'm building  ▼ 

⬢ Hydra

site stars go license

One CLI for every model on your machine.

Finds 13+ CLI tools, 14 API providers and every local server in under 2 seconds, then routes by capability, cost, and a sequential probability ratio test for confidence of correctness — not just whichever model is cheapest. PII is blocked at the dispatch layer, before it ever leaves the machine.

~1.1µs routing overhead · 75–85% cheaper than going all-frontier

brew install ankit373/hydra/hyctl

go last commit

Local inference, one API.

Backend-agnostic inference server speaking OpenAI over pluggable engines — llama.cpp, MLX, Ollama. Build the control plane, not the kernels.


◇ Vyuha

python

Multi-agent orchestration for high-stakes software development.


 ▼  upstream — I patch what I run  ▼ 

If it runs in my production, I read its source — and when it breaks, the fix goes upstream, not into a private fork.

project what I fixed
loki cross-tenant leakage and a marshal panic when querying multiple tenants
ollama upstream status propagation on /api/embeddings, CPU-fallback and input-truncation warnings
vllm honouring enabled on the PII and domain classifiers, API-key forwarding, config version gating
arc duplicate workflow_job completion events, webhook capacity double-counting

merged upstream

49 merged PRs across 9 open-source projects I don't own · refreshed daily by an Action, last 2026-11-14

project license merged latest
grafana/mcp-grafana
★ 3,668
Apache-2.0 21 fix(alerting): page rules until label selectors fill rule_limit
fix: send the docs index fetch and usage stats through the socks5 proxy
fix(cloudwatch): keep series separate when a query returns several
fix: default --grafana-timeout to 30s
+17 more
vllm-project/semantic-router
★ 6,472
Apache-2.0 13 [Feature] Define one versioned selector objective
[Feature] Gate RAG and memory retrieval on request and backend capabilities
[Bug] Reject bodyless inference requests at the header stage
[Feature] Add a locked uv environment for the intent classifier LoRA scripts
+9 more
vllm-project/aibrix
★ 5,186
Apache-2.0 4 [Bug] Scale KPA on the total load, not the per-pod mean
[Bug] Drop pool policy activity records of pods that stopped reporting
[Bug] Chain each block of a multi-block BlockStored event from its predecessor
[Bug] Purge a pod's prefix cache when the engine sleep-state metric shows it went to sleep
Tencent/WeKnora
★ 37,396
MIT 3 fix(storage): use virtual-hosted addressing for Tencent COS through the S3 driver
fix(knowledge): stop synthesizing never-run stages as failed
test(im): close the lifecycle test database and keep its name unique
element-hq/synapse
★ 4,793
AGPL-3.0 3 Fix federated media downloads failing when a multipart response is split across chunks
Fix 500 error when user-interactive auth requests send a null or non-object auth
fix: reject user creation via the admin API when delegating to MAS
shridarpatil/whatomate
★ 1,769
AGPL-3.0 2 docs: link the community Helm chart from the quickstart
perf(contacts): load unread counts for a contact page in one query
grafana/grafana
★ 77,891
AGPL-3.0 1 Folders: Return 404 instead of 500 when a folder is not found
grafana/loki
★ 29,153
AGPL-3.0 1 fix(deps): Update hedgedhttp to v0.9.2 to stop leaking request contexts
actions/actions-runner-controller
★ 6,656
Apache-2.0 1 Release AutoscalingRunnerSet deletion when the GitHub config secret is gone

 ▼  the track record  ▼ 
2025 →Tradomate
Founding Engineer
Own platform & cloud architecture for a fintech trading platform. Cut AWS 40%, tuned ClickHouse to millisecond latency for market data, moved CI to scale-to-zero Karpenter runners, built the observability stack end to end.
2024–25Tiger Analytics
Platform Engineer
Built the GCP practice from scratch — hired the engineers, wrote the standards, shipped a Terraform accelerator, drove adoption org-wide.
2022–24Quantiphi
Senior Platform Eng
Led 5 engineers on a cloud-agnostic Contact Center AI platform. SOC 2 + HIPAA readiness, DR drills, 35% cost cut on an LLM product.
2021–22Quantiphi
Platform Engineer, R&D
NLP-powered search on GKE via Terraform. GitLab CI + SonarQube, AWS chaos engineering.
2019–21Wipro
Cloud Engineer
Day-two GCP ops and incidents. 27% monthly cost cut, Cloud Armor WAF, and a point-in-time recovery of a truncated CloudSQL database — followed by the RCA and the safeguards that kept it from recurring.

 ▼  before all this: brain waves and fuzzy logic  ▼ 

B.Tech in Electronics & Communication, BVM Anand. Everything I built back then had wires coming out of it:

A detour through algorithms & data structures, data analysis and computational thinking followed — worked in public, notebook by notebook — then cloud full-time from 2019.

Finalist, Idea Chaupal '18 (IRMA Anand) · Smart India Hackathon 2018, hardware and software · organizer, Gujarat SIH · "Brilliance Personified" in Quantiphi's Inspire · Group of Talent + Avenger awards, H2 2023 · GCP Associate Cloud Engineer · HashiCorp Terraform Associate


Breakout, played against my contribution graph

back to top


“The best performance improvement is the transition from the nonworking state to the working state.”
— John Ousterhout

Pinned Loading

  1. hydra hydra Public

    The AI control plane for software development. Discovers every model on your machine, routes by capability and cost, enforces PII policy, tracks spend.

    Go 12 2

  2. citegeo citegeo Public

    Open-source, self-hosted GEO and AI visibility tracker. Ask AI models the questions your buyers ask, keep every raw answer, and see the receipt behind every number.

    TypeScript 3

  3. Greenhouse_Climate_Controller Greenhouse_Climate_Controller Public

    In this Greenhouse Climate controller we are using fuzzy logic algorithms to set the actuators for a variable output.

    C++ 4 1

  4. whatomate-helm whatomate-helm Public

    Community Helm chart for Whatomate, the self-hosted WhatsApp Business platform (unofficial)

    Go Template