Skip to content
View Vedant-Agarwal's full-sized avatar
💭
I may be slow to respond.
💭
I may be slow to respond.

Block or report Vedant-Agarwal

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
Vedant-Agarwal/README.md

Vedant Agarwal

ML infrastructure engineer. I build the data and ML platforms that models train and serve on, and fix correctness bugs in the open-source LLM stack.

  • Now: search signal infrastructure at Walmart Global Tech: real-time Flink and Kafka pipelines on GCP, a shared feature platform for ranking and personalization, and drift monitoring across 100+ production signals.
  • Going deep on: LLM inference and agent infrastructure: KV-cache capacity, batching, and long-horizon agent evaluation.

Open source

28 merged pull requests across 13 projects, mostly shared-state, resource-leak and serialization bugs.

Area Merged
LLM pipelines Haystack (6)
Fine-tuning and LLM gateways PEFT (3), LiteLLM (2)
Agent and LLM evaluation Inspect Evals (3), Harbor (3), HELMET, inspect-evals-lint
ML platform and data MLflow (2), Feast, Airflow, Quix Streams
Forecasting NeuralForecast (2), StatsForecast (2)

A few I'm glad landed:

  • PEFT #3774: LoRA merge() on MultiheadAttention applied the out_proj delta twice.
  • LiteLLM #30271: aiohttp connections leaked when a stream ended abnormally.
  • Haystack #11931: deserialization mutated the caller's data dict.

In review: vLLM, TRL, LlamaIndex, LiteLLM, lm-evaluation-harness, lighteval

Built

  • inspect-brokenmath: Inspect AI implementation of BrokenMath (NeurIPS 2025), measuring sycophancy in LLM theorem proving across 451 adversarially falsified olympiad problems.

Pinned Loading

  1. feast feast Public

    Forked from feast-dev/feast

    The Open Source Feature Store for AI/ML

    Python

  2. inspect-brokenmath inspect-brokenmath Public

    Inspect AI implementation of BrokenMath (sycophancy in LLM theorem proving)

    Python

  3. inspect_evals inspect_evals Public

    Forked from UKGovernmentBEIS/inspect_evals

    Collection of evals for Inspect AI

    Python

  4. litellm litellm Public

    Forked from BerriAI/litellm

    Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthr…

    Python

  5. mlflow mlflow Public

    Forked from mlflow/mlflow

    The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while control…

    Python

  6. peft peft Public

    Forked from huggingface/peft

    🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

    Python