Over 500 billion AI tokens pass through Portkey every single day.

Every AI product eventually runs into the same problem. The prototype works, but once it goes live the system has to manage multiple models, rising token costs, unpredictable latency, and infrastructure that was never built for AI workloads.

That is the problem Rohit Agarwal is solving with Portkey, an AI gateway that sits between applications and the models, whether that’s GPT-4, Claude, or Gemini.

With 24,000 companies routing their AI through Portkey, Rohit sits on ground-level data on how AI is actually being used in production. Which models enterprises are betting on. Where costs are quietly climbing. How usage patterns shift as companies move from pilots to real products.

When AI spend surpasses cloud spend, and Rohit believes it will, the infrastructure running underneath it becomes one of the most important bets in tech. This episode explores what it takes to run AI systems at that scale.

00:00 – Trailer
01:05 – 500 billion AI tokens every day
04:05 – First to call an "AI gateway"
07:26 – Where did the Gateway insight come from?
12:08 – How Portkey is winning this space
13:05 – Picking the right gambles over wrong ones
14:16 – What are LLM endpoints?
15:21 – AI will 100% surpass cloud spend
19:00 – Hype is coming from people still in Q&A mode
19:33 – AI employees over humans in customer support?
23:00 – For AI startups, traffic > revenue
24:43 – The bubble is in valuations, not utility
26:05 – How Rohit built his personal automations
28:38 – Costliest model is most used now
33:21 – What's going right and wrong for AI companies
37:49 – Hiring a VP of sales after $15M is possible today
39:57 – What edge does Claude have over other models?
43:35 – Founders need a "why me vs. why Anthropic" story
52:56 – What if Anthropic or AWS builds a gateway?
55:41 – Predictions for the next 12 months
59:40 – How big is the opportunity in Agents?
01:00:48 – Startups now have to prove it's not a weekend project
01:01:54 – Is Build v/s Buy no longer a Debate?
01:03:50 – What would Rohit build if starting up today?
01:05:58 – How Portkey is different from an API gateway
01:08:26 – MCP / tool calling enables agentic workflows
01:12:00 – Portkey's Community-driven early GTM
01:13:34 – Startups have only 2 reasons for Open core

-------------

India’s talent has built the world’s tech—now it’s time to lead it.
This mission goes beyond startups. It’s about shifting the center of gravity in global tech to include the brilliance rising from India.

What is Neon Fund?
We invest in seed and early-stage founders from India and the diaspora building world-class Enterprise AI companies. We bring capital, conviction, and a community that’s done it before.

Subscribe for real founder stories, investor perspectives, economist breakdowns, and a behind-the-scenes look at how we’re doing it all at Neon.

-------------

Check us out on:
Website: https://neon.fund/
Instagram: https://www.instagram.com/theneonshoww/
LinkedIn: https://www.linkedin.com/company/beneon/
Twitter: https://x.com/TheNeonShoww

Connect with Siddhartha on:
LinkedIn: https://www.linkedin.com/in/siddharthaahluwalia/
Twitter: https://x.com/siddharthaa7

-------------

This video is for informational purposes only. The views expressed are those of the individuals quoted and do not constitute professional advice.

Send us Fan Mail

Is the best grocery platform one that decides what it WON’T sell?

That is the bet Ayyappan is making with FirstClub. Fewer products. Stricter rules. While most quick commerce apps are trying to deliver orders faster, he is asking a different question. What if consumers need not “faster or cheaper”, but a retail platform where they can trust every item listed on it?

A place where you do not have to read every label, check multiple reviews, or wonder if the top result is there because a brand paid for it. FirstClub is trying to solve a harder problem. It is trying to define what “quality” means for everyday products we consume, starting with groceries.

India has received the highest quick commerce funding of any country in the world, at $9.24B over the last 10 years. Yet only 1% of Indians use quick commerce services today. With a large market still open for expansion and the possibility of better unit economics over time, FirstClub is building a countertrend to the hype around Indian quick commerce.

Ayyappan brings eleven years of experience at Flipkart, and has also served as SVP at Myntra and CEO of Cleartrip. FirstClub also just raised a $50 million round and doubled its valuation in under six months. This episode is the story till here and the plans ahead for Firstclub.

00:00 – Trailer
01:01 – The Costco of Indian quick commerce
04:32 – Building a counter-trend company
06:15 – What consumers say v/s what they actually want
09:37 – The only retail platform to Ban 200 ingredients
12:34 – Why can’t the big players solve this?
13:21 – A simple rule of thumb for food
16:03 – Brand stories from FirstClub
19:20 – Is the problem access or income?
21:29 – Who are the 20 million FirstClub consumers?
24:14 – Only 1% of India uses quick commerce
26:04 – What does “quality” mean in grocery?
32:34 – How will FirstClub monetize without brand sponsorships?
34:53 – Do consumers behave differently across categories?
39:30 – Why is Myntra so powerful in fashion?
42:24 – What Myntra taught Ayyapan that Flipkart didn’t?
43:53 – Unlearning to build for Quick commerce
48:25 – Why Indian consumers are very experimental today
50:59 – Is India one country when it comes to quality?
52:43 – If Ayyappan was a product, what would he be?
54:47 – The hardest belief to defend while building FirstClub
56:26 – Akshayakalpa & The Whole Truth
57:48 – Not niche, but premium

-------------

India’s talent has built the world’s tech—now it’s time to lead it.

This mission goes beyond startups. It’s about shifting the center of gravity in global tech to include the brilliance rising from India.

What is Neon Fund?
We invest in seed and early-stage founders from India and the diaspora building world-class Enterprise AI companies. We bring capital, conviction, and a community that’s done it before.

Subscribe for real founder stories, investor perspectives, economist breakdowns, and a behind-the-scenes look at how we’re doing it all at Neon.

-------------

Check us out on:

Website: https://neon.fund/
Instagram: https://www.instagram.com/theneonshoww/
LinkedIn: https://www.linkedin.com/company/neon-fund/
X: https://x.com/TheNeonShoww

Connect with Nansi on:

LinkedIn: https://in.linkedin.com/in/nansi-mishra
X: https://x.com/nansi_mishra

-------------

This video is for informational purposes only. The views expressed are those of the individuals quoted and do not constitute professional advice.

Send a text

Will smaller AI models win over large language models?

Sudarshan Kamath grew up in Mumbai, taught himself AI before most Indian companies were even hiring for it, and bought the domain "smallest.ai" for $100 in 2022, two years before the company existed. Today, he runs Smallest AI, a startup focused on real time voice AI.

He started with self-driving cars, training large models and compressing them to run on vehicle hardware in real time. That's where he first saw what small models could do: a hundredth of the size, almost no loss in accuracy.

Two years later he put in his own $150K, got some GPUs, and started training. Eighteen months later he had a seed round, a Series A, a seven-figure enterprise deal, and a $150M acquisition offer he turned down.

Most of the data that goes into large models is noise. Strip it out, train small, and you get a model that matches a giant at a fraction of the size and runs in real time. That insight is what Smallest AI is built on.

00:00 – Trailer
00:51 – Sudarshan's journey before Smallest AI
05:00 – Arjun Jain & Yann LeCun
08:20 – Why build in voice AI in 2024?
15:09 – Why move the company from India to the US?
17:25 – Hiring talent via LinkedIn and X
18:49 – What large US funds actually bring to startups
21:03 – Raising a seed round with zero revenue
26:06 – Strong intros from US VCs
28:23 – What the first enterprise customer teaches you
31:50 – Raising Series A with Seligman Ventures
32:19 – The $150M acquisition offer
34:32 – When should founders sell secondaries?
36:24 – Who are Smallest AI's customers?
38:28 – What are state space models?
40:16 – Are GEPA models closer to AGI?
41:23 – Growing 10× in three months
48:03 – This is not a winner-takes-all market
49:32 – Why this is a trillion-dollar market
50:08 – Why large AI labs are not building in voice
51:26 – What it takes to reach $100M ARR
54:21 – The biggest goal for 2026
57:11 – Voice costs 1000× more than text
01:02:04 – How Smallest AI cracked large enterprises

-------------

India’s talent has built the world’s tech—now it’s time to lead it.
This mission goes beyond startups. It’s about shifting the center of gravity in global tech to include the brilliance rising from India.

What is Neon Fund?
We invest in seed and early-stage founders from India and the diaspora building world-class Enterprise AI companies. We bring capital, conviction, and a community that’s done it before.
Subscribe for real founder stories, investor perspectives, economist breakdowns, and a behind-the-scenes look at how we’re doing it all at Neon.

-------------

Check us out on:
Website: https://neon.fund/
Instagram: https://www.instagram.com/theneonshoww/
LinkedIn: https://www.linkedin.com/company/beneon/
Twitter: https://x.com/TheNeonShoww

Connect with Siddhartha on:
LinkedIn: https://www.linkedin.com/in/siddharthaahluwalia/
Twitter: https://x.com/siddharthaa7

-------------

This video is for informational purposes only. The views expressed are those of the individuals quoted and do not constitute professional advice.

Send a text