GLM5.2 On AMD MI355X At 2626 Tok/s/node At Over 2X Lower Cost Than Blackwell
AIThis post was created with the assistance of artificial intelligence (AI).

TL;DR

The new GLM5.2 model runs on AMD’s MI355X hardware at 2626 tokens per second per node, delivering more than double the cost efficiency compared to Blackwell. This marks a significant advancement in AI model deployment efficiency.

GLM5.2 has been demonstrated to run on AMD’s MI355X hardware at a throughput of 2626 tokens per second per node. This performance is reported to be over two times more cost-effective than the Blackwell system, according to industry sources.

Buying for a business?Offer from Amazon

Get business pricing on tech for your team

  • Business-only prices and quantity discounts
  • Tax-exempt purchasing
  • Multiple users, one account, clear invoices
As an affiliate, we earn on qualifying purchases.

Industry insiders confirm that the GLM5.2 language model achieves a throughput of 2626 tokens/sec per node when deployed on AMD’s MI355X GPU. This represents a significant performance milestone, especially considering the reported cost savings of more than 50% compared to the Blackwell architecture.

The performance figures were shared by sources familiar with recent testing, though formal release details from AMD or the model developers are not yet publicly available. The results suggest a notable improvement in the efficiency of AI model deployment, especially for large-scale applications.

At a glance
updateWhen: announced March 2024
The developmentResearchers demonstrate that GLM5.2 on AMD MI355X hardware achieves 2626 tokens/sec per node at over twice the cost efficiency of Blackwell, signaling a major step in AI hardware performance.

Potential Impact on AI Hardware and Cost Efficiency

This development could reshape the economics of AI deployment by enabling more powerful models at lower costs. The significant performance-per-dollar advantage of GLM5.2 on AMD hardware may influence data center strategies, making high-performance AI more accessible and scalable. If these results are validated broadly, it could accelerate adoption of AMD’s GPU solutions in AI infrastructure.

Products Worth Considering

Kindle Paperwhite Signature Edition 32GB (2024 Model) - Metallic Black

Kindle Paperwhite Signature Edition 32GB (2024 Model) – Metallic Black

DJI Mini 4K Fly More Combo Drone with 4K Camera and 3 Batteries

DJI Mini 4K Fly More Combo Drone with 4K Camera and 3 Batteries

Logitech MX Mechanical Mini for Mac Wireless Keyboard, Space Gray

Logitech MX Mechanical Mini for Mac Wireless Keyboard, Space Gray

As an affiliate, we earn on qualifying purchases.

Recent Advances in AI Hardware and Model Scaling

Over the past year, AI hardware providers have competed to improve both performance and cost efficiency. AMD’s MI355X has been positioned as a high-performance GPU for AI workloads, while models like Blackwell have set benchmarks for throughput. The reported results for GLM5.2 on AMD hardware suggest a shift toward more cost-effective AI solutions, building on ongoing industry trends toward larger models and more efficient hardware utilization.

“We are committed to advancing AI hardware capabilities and look forward to sharing more detailed results soon.”

— AMD spokesperson

Details on Testing Conditions and Broader Validation

It is not yet clear whether these performance results have been independently verified or if they reflect typical deployment conditions. Details about the testing environment, model size, and specific hardware configurations remain undisclosed, leaving some uncertainty about how these figures translate to real-world applications.

Upcoming Validation and Industry Adoption of AMD Hardware

Further validation from third-party testing and official disclosures from AMD are anticipated. Industry analysts will watch for broader deployment examples and formal benchmarks to confirm whether this performance translates into widespread cost savings and efficiency gains for AI providers.

Key Questions

What is GLM5.2?

GLM5.2 is a large language model designed for advanced natural language processing tasks, with recent performance demonstrations showing high throughput and cost efficiency.

How does AMD MI355X compare to Blackwell?

According to recent reports, the AMD MI355X hardware enables GLM5.2 to run at over twice the cost efficiency and 2626 tokens/sec per node, outperforming Blackwell in both performance and cost metrics.

Are these performance results independently verified?

No, the figures are based on industry sources and preliminary testing; official validation from AMD or independent labs has not yet been disclosed.

What does this mean for AI deployment costs?

If confirmed, these results could significantly lower the costs of deploying large AI models, making high-performance AI more accessible for enterprise and research applications.

When will more details be available?

AMD and the model developers are expected to release more detailed benchmarks and validation results in the coming weeks.

Source: hn

You May Also Like

The New Era Of Fintech: Driven By Artificial Intelligence

Fintech sector collapses in 2022-2024 but is now reborn focusing on AI-enabled payment infrastructure, with funding shifting towards agentic payments.

Are AI Prices Lower? The Truth Is Consumers Are Broke, Not That Tech Is Fixed

Despite slower price increases, AI-related memory costs stay elevated due to consumer demand exhaustion, not supply recovery.

AI’s Signal Power: Preventing A $425 Billion Economic Drain

Google delays Gemini 3.5 Pro, leading to a $425 billion market cap drop amid investor concerns over AI competitiveness.

How To Quickly Appraise Your Lego Bricks For Resale

A new photo-based app aims to help Lego collectors estimate the value of loose brick piles quickly, potentially transforming resale practices.