A recent panel discussion at infra/STRUCTURE 2024 in Las Vegas provided valuable insights into the rapidly evolving landscape of GPU hosting. The “From CPU to GPU Infrastructure” panel, moderated by Philbert (“Phil”) Shih, Managing Director of Structure Research, and featured Jeff Hinkle, CEO of GPU Resources and Zhen Lu, CEO of RunPod. The conversation shed light on their experiences, challenges, and opportunities in this burgeoning sector.

Rapid Growth and Financial Considerations

The GPU hosting market is experiencing explosive growth, reminiscent of the early days of web hosting. Lu shared, “when we launched RunPod, it was entirely free. We built the billing system so that we could eventually charge people”, before adding that they quickly “were doubling revenue every month for the year. We were a two person startup and we were already gearing more than 500 grand a month.”

While this rapid growth is specific to RunPod, Lu’s experience reflects a broader trend of explosive demand in the GPU hosting market. The panelists also alluded to a “land grab mentality” in the industry, as companies rush to capture market share.

Demand Profile and Market Sustainability

Both speakers emphasized the importance of understanding customer segments and ensuring sustainable growth. Hinkle cautioned about the risks of rapid expansion, “The big drawback is you start to worry and make sure you’re not getting a high concentration of revenue into one or two customers as you exhaust your capital and you can’t focus on what you think is the right way to run that business and grow.”

Lu echoed this sentiment, highlighting RunPod’s strategic approach: “We’re making some really deliberate steps to make sure that we’re not following the trap of, for example, building for a single customer or a small subset of customers.”

Overcoming Barriers to Entry

While the barriers to entry in GPU hosting are significantly higher than traditional hosting, both companies found innovative ways to scale their operations:

  • GPU Resources leveraged previous successful exits to finance their entry
  • RunPod started with mining rigs in basements and gradually scaled up through strategic partnerships and investor backing

Looking Ahead

As the GPU infrastructure market continues to evolve, both Hinkle and Lu stressed the importance of balancing rapid growth with sound business principles. The future of GPU hosting looks promising, but careful navigation of market dynamics will be crucial for long-term success.

Attendees of the annual infra/STRUCTURE summit receive a copy of the presentation materials.

Not sure if the event is right for you? Learn more about the different attendees here. To be sure you don’t miss out you can SAVE THE DATE for 2025! The infra/STRUCTURE Summit will return to the Wynn in Las Vegas October 15-16, 2025. We hope to see you there!