Gigabyte Unveils AMD Ryzen Threadripper 7975X-Powered AI Training Rig at $35,000 at Computex2024

Gigabyte Unveils AMD Ryzen Threadripper 7975X-Powered AI Training Rig at $35,000 at Computex2024

Table of content

While most AI models, such as ChatGPT, DALL-E, Gemini, Llama, Copilot, etc., heavily rely on the cloud due to their extremely heavy computational requirements, it’s possible to run AI inference on-premises.

This becomes especially important if you want to train AI models on sensitive data and IP addresses while keeping them local.

It’s possible to train and infer AI models at the edge. Still, consumer-grade devices pose a significant bottleneck in running large models and efficiently processing more distinctive tokens per watt.

Therefore, Gigabyte wants to change that and help you “train your AI on your desktop” through its new AI TOP lineup.

Gigabyte says its AI TOP personal computer devices are built on three structures: AI TOP Utility, AI TOP Hardware, and AI TOP Tutor. The goal is to enable scaling from 8/30 billion parameters to 70/236 billion with the ability to run the system from a shared wall socket.

Gigabyte Unveils AMD Ryzen Threadripper 7975X-Powered AI Training Rig at $35,000 at Computex2024

The AI TOP Utility tool allows monitoring of various system parameters, such as CPU, GPU, RAM, and SSD, with a front-end GUI without requiring coding for AI training tasks.

On the hardware front, AI TOP-enabled computers come equipped with unified and thoroughly tested components from the motherboard to the PSU unit.

The components are designed to be upgradeable and used in a typical home or office environment.

For this reason, the company offers two mainboards designed for AI use:

TRX50 Aero D (priced at $559 on Amazon) AI TOP with dual 10-gigabit LAN, up to 2 terabytes of DDR5, 4x PCIe Gen 5 x16 slots, and 4x NVMe SSDs for use with AMD Threadripper 7000 Series Storm Peak HEDT CPUs.

W790 AI TOP with 2x Thunderbolt 4, up to 2 terabytes of DDR5, 5x PCIe Gen 5 x16 slots, and 6x NVMe SSDs for use with Intel Xeon-W2400 and W3400 Sapphire Rapids HEDT CPUs.

For graphics processing units, Gigabyte AI TOP devices can leverage the Nvidia GeForce RTX 4070 Ti Super AI TOP 16G, four of which can provide 64 gigabytes of VRAM for AI training.

You can also opt for the new AMD Radeon Pro W7900 DS AI TOP 48G or W700 AI TOP 32G and expand their range with up to four cards for a massive VRAM capacity of 192 gigabytes.

Gigabyte Unveils AMD Ryzen Threadripper 7975X-Powered AI Training Rig at $35,000 at Computex2024

Gigabyte also offers the AI TOP 100E NVMe SSD drive with Phison’s aiDAPTIVCache, designed to power Phison aiDAPTIV+ models.

This SSD is rated to deliver up to 7,200/6,500 megabytes per second of sequential read/write speeds and 150x TBW.

Furthermore, the AI TOP computers come with the UD1600PM PG5 80+ Platinum PSU unit, which provides enough power to run four graphics processing units and is rated to last twice as long as traditional PSU units.

Prices for these computers start at $6,499 for 8 billion parameters, $11,999 for 13 billion, $16,499 for 30 billion, and $35,999 for 70 billion parameters, with a maximum model size of 236 billion.

Source

Related Posts

Older Galaxy Watches Can Now Join One UI 6 Watch Beta

Older Galaxy Watches Can Now Join One UI 6 Watch Beta

Reading Time: 0:59 min

Samsung is gearing up for the Galaxy Unpacked event scheduled for July 10th in Paris, where the company is expected to unveil its new Galaxy Watch 7 series. Alongside the…

View post
YouTube

YouTube May Soon Allow You to Upload Custom Thumbnails for Your Playlists

Reading Time: 1:31 min

Google might introduce a new feature on YouTube that allows users to upload custom thumbnails for their video playlists. This update was discovered through code analysis in the latest beta…

View post
iPhone Price Cuts Help Maintain Growth in the World's Largest Smartphone Market

iPhone Price Cuts Help Maintain Growth in the World’s Largest Smartphone Market

Reading Time: 1:36 min

IPhone shipments recovered in the world’s largest smartphone market from the previous month. During the first week of 2024, phone sales fell by 30% year-on-year due to issues with damp…

View post

Leave the first comment