A price comparison of on-demand H100 rentals finds a 4.57-fold difference for the same H100 SXM 80GB, depending on provider. RunPod Community lists the GPU at $2.69 per hour, or about $1,964 for a continuously running 730-hour month; RunPod Secure is $3.99, AWS’s p5.48xlarge works out to $6.88 per GPU-hour, and Azure’s ND96isr_H100_v5 costs $12.29, or $8,972 monthly. The comparison deliberately separates H100 SXM, PCIe and NVL models, and uses each vendor’s cheapest route to a given GPU, rather than combining unlike hardware or counting within-vendor options as market differences.
The price gap is not presented as a pure markup: the Azure ND instance includes 400 Gbps InfiniBand and GPU Direct RDMA for multi-node training, as well as enterprise reliability, compliance and capacity offerings. Those features may be unnecessary for single-node fine-tuning but important for large distributed workloads, making the cheapest option unsuitable for some users. The figures use on-demand list prices for one region each - AWS us-east-1 and Azure eastus - and exclude reserved, committed-use and spot discounts, which could narrow the gap. GPU counts are inferred from vendor documentation; availability is not reflected. Lambda is excluded from the headline comparison because its published rates were not yet in effect and current rates require a login.
Summary generated by AI from the linked article. hn.today is not affiliated with Hacker News or Y Combinator.