Tensormesh

Huge congratulations to AMD on a successful event! It was a great opportunity to connect with the AI community while discussing the future of AI infrastructure. We're especially excited about our recently announced collaboration with AMD, which is focused on helping organizations serve more AI models with fewer GPUs through more efficient inference infrastructure. Thank you to everyone who stopped by to connect with the Tensormesh team. We're excited to continue building what's next in AI infrastructure.

Fewer GPUs. More models. Better AI infrastructure. We're excited to announce our collaboration with AMD to help enterprises get more out of every GPU. Together, we're demonstrating how KV cache technology and AMD Instinct™ GPUs can improve inference efficiency which enables organizations to serve more models while reducing unnecessary compute. As AI workloads continue to grow, the focus isn't just on adding more hardware, it's about using existing infrastructure more intelligently. That's where Tensormesh comes in. Read our latest announcement to learn how we're working with AMD to help make AI inference faster, more efficient, and more cost-effective. 📖 Read the full release: https://lnkd.in/giV85njC #AI #Inference #AIInfrastructure #GPU #AMD #KVCache #LLM #EnterpriseAI #MLOps #Tensormesh

Come visit Tensormesh at AMD Advancing AI 2026 @ Moscone West in SF today (7/22) and tomorrow (7/23) and learn about how we're redefining AI infrastructure with intelligent 𝗞𝗩 𝗰𝗮𝗰𝗵𝗲 technology that accelerates inference at scale. #AMDAdvancingAI #2026 #KVcache

The AI industry keeps betting on bigger models and more GPUs. He made a different bet: make the models we already have run up to 10x cheaper by keeping them from redoing the same work every time. Our next speaker is Junchen Jiang, co-founder and CEO of Tensormesh and co-creator of LMCache Lab. His path runs straight through the frontier of AI systems: the Yao Class at Tsinghua, a PhD at Carnegie Mellon, and a computer science professorship at the University of Chicago, where his research zeroed in on a costly inefficiency in how large models handle memory. That work became LMCache: open-source infrastructure that stores and reuses a model's internal memory (its KV cache) instead of recomputing it from scratch on every request. It cuts inference costs by as much as 10x, and it has spread fast. It now runs inside vLLM and NVIDIA Dynamo, and is used by teams at Bloomberg, Red Hat, Redis, and Tencent. In 2025 he turned that research into Tensormesh, backed by Valley Capital Partners , NVIDIA, AMD, CoreWeave and Laude Ventures to bring the same optimizations to any team running AI at scale. Junchen joins the summit through Valley Capital Partners, platinum partner of the AI Summit @ Stanford and a lead backer of Tensormesh. VCP's founding managing partner, Steve O'Hara, who sits on the company's board, calls KV caching "one of the most consequential and underexplored opportunities in AI infrastructure today." He describes today's AI as a brilliant analyst who reads everything, then forgets it all after each question. He's building the layer that lets it remember. At the AI Summit @ Stanford, that's exactly the layer he'll dig into. He keynotes "The Next Big Data Layer for AI" and joins leaders from NVIDIA on the panel "The Infrastructure of Intelligence: Building the AI Stack." This July, he brings that work to Stanford's campus. 📅 July 30 – August 1, 2026 📍 Stanford Campus, Palo Alto 🎟 Secure your place → https://lnkd.in/gJa4DjG8

On July 17th, the community had the opportunity to attend the GTLC Bay Area Chinese Tech Leaders Summit, organized by TGO 鲲鹏会, and hear from leaders shaping the future of AI infrastructure. One of the standout sessions featured our very own Junchen Jiang, CEO and Co-Founder of Tensormesh, who shared a compelling vision for 𝑲𝑽 𝒄𝒂𝒄𝒉𝒆 as the next major data layer. The discussion went beyond accelerating inference, exploring how KV cache could help us better understand model attention during inference—and even improve inference accuracy without changing the model itself. One takeaway stood out: while the research is moving quickly, the real challenge is making these advanced ideas practical enough to deploy in production. This is just the beginning of the conversation. Follow along as we continue sharing insights on the future of AI infrastructure. #AI #GenAI #LLMs #KVCache #Inference #AIInfrastructure

We're excited to be at AMD Advancing AI 2026 this week at Moscone West in San Francisco! 📍 Visit Tensormesh at Booth #415 to learn how we're helping organizations scale AI inference with platform-scale KV-cache reuse, persistent agent memory, and high-performance LLM serving. Don't miss Samuel Shen's session, "Efficient LLM Serving at Scale with Unified Caching," where he'll share how unified caching improves throughput, reduces costs, and enables more efficient AI infrastructure at scale. 📅 If you're attending, stop by Booth #415, attend the session, and connect with our team—we'd love to talk about the future of AI infrastructure. Learn more about the event: https://lnkd.in/g2uSyBdm Samuel Shen's session: Efficient LLM Serving at Scale with Unified Caching (https://lnkd.in/dCB_yuwm) #AMD #AdvancingAI #AIInfrastructure #LLM #Inference #GPU #KVCache

Interesting piece from SDxCentral on the growing importance of KV Cache in AI infrastructure. As models get longer context windows and AI applications become more stateful, memory is quickly becoming one of the biggest challenges in inference. It's not just about GPUs anymore--it's about efficiently storing, moving and reusing context. At Tensormesh, we believe KV Cache is more than an optimization layer. It's becoming a new class of AI-native data and a foundational part of how AI systems will scale, Thanks to SDxCentral for including Tensormesh as we help shape the future of AI inference infrastructure. #AIAppreciationDay2026 #AIInfrastructure #Inference #KVCache #LLM #GenerativeAI (https://lnkd.in/gUPkZxDN) 

More to unpack in this Tech Beats Unplugged post from the conversation between our CEO, Junchen Jiang, and #Techbeats pod host Kosseila H. Watch the full interview👇

Shipping day at Tensormesh is still my favorite day. 🚀 This week we rolled out GLM-5.2 on Tensormesh Inference — lukealonso/GLM-5.2-NVFP4 is now live for serverless inference, replacing GLM-5.1. Same 128K context window, same NVFP4 quantization for efficient high-throughput inference, but with a real step up in performance. If you were running GLM-5.1, this is a straight upgrade. And because speed claims mean nothing without proof, we also shipped three new observability charts: Time to First Token, Input Throughput, and Output Throughput — live per model, right next to your cache metrics. You shouldn't have to guess how fast your inference is. Now you can watch it. What I love about this release is the pairing: a faster model, and the instruments to see exactly how fast. Try it today — point any OpenAI-compatible SDK at our serverless endpoint and you're running in minutes. Full changelog: https://lnkd.in/gebqKK_p #AI #Inference #LLM #Serverless #SaaS