​Introduction & Key Features

The global transformation is rapidly scaling the demands for flexible computer, networking, and storage. Future workloads will necessitate infrastructures that can seamlessly scale to support immediate responsiveness and widely diverse performance requirements. The exponential growth of data generation and consumption, the rapid expansion of cloud-scale computing and 5G networks, and the convergence of high-performance computing (HPC) and artificial intelligence (AI) into new usages requires that today’s data centers and networks evolve now— or be left behind in a highly competitive environment.

7Starlake's AV2000 Conduction Liquid Cooled AI inference GPU Server features 3rd Gen. Intel Xeon Scalable (ICE LAKE) ® Platinum 8380  processor ( 40 Cores, 2.3 GHz, 270W) with 4 x NVIDIA RTX A6000  (48GB GDDR6 , 10,752 CUDA), 2TB RDIMM DDR4-3200MHz and 96TB (Gen 4.0 PCIex4) NVMe, to provide the seamless performance foundation for the data centric era from the multi-cloud to intelligent edge, and back. 

AV2000 enables a new level of consistent, pervasive, and breakthrough performance in new AI inference to implement machine learning and deep learning. Combining stunning inference performance, powerful CPU and expansion capability, it is the perfect ruggedized platform for versatile edge AI applications.

With innovative liquid cooled design, AV2000 is built in most advanced " Gun Drilled ", which with 10 pipes (each pipe 5mm x 5mm x  x 800mm) to dissipate max 15KW heat.

Intel’s 10nm Ice Lake Xeon With 40 Cores , PCIe 4.0

Today’s scientific discoveries are fueled by innovative algorithms, new sources and volumes of data, and advances in compute and storage. Machine learning, deep learning, and AI converge the capabilities of massive compute with the flood of data to drive next-generation applications, such as autonomous systems and self-driving vehicles. Recognising this demand, 7STARLAKE employs 3rd Gen Intel® Xeon® Scalable processors that are built specifically for the flexibility to run complex AI workloads on the same hardware as existing workloads to be the CPU of AV2000.

Intel Ice Lake is based on 3rd Generation Intel Xeon Ice Lake Scalable Processor in LGA4189 Socket with C621A chipset, up to 40 cores, 270W TDP. Intel Ice Lake-SP processors will be based on the 10nm+ process node. The main highlight of Ice Lake-SP processors will be support for PCIe Gen 4 and 8-channel DDR4 memory.

 

 

Conduction Liquid Cooling Plate ( C.L.C.P.)

Most liquid cooling solutions are using close loop design — Direct to Chip (D2C) integrated pump & cold plate in the system. Users may worry about potential risk of liquid leakage.

7Starlake highly values system reliability. In the pursuit of stability and power, our experienced team has successfully optimized the thermal design, bringing out an unprecedented model AV2000. Instead of normal D2C design, 7Starlake innovated an unique heat exchanger integrating Conduction Liquid Cold Plate (CLCP) on the computing system.

 

 

 

 

 

CLCP includes multi-channel cold water inlet/outlet owning high flexibility in adjusting numbers of inlet/outlet (up to 4in 4out) by request. When coolant flows through top sink, liquid can absorb the heat and take it away from the heat sources quickly to the heat exchanger. When heated liquid flushes into the heat exchanger, it will be cooled by 9 units of 12 x 12 cm active fan which can run at 2K~3K RPM.

 

Leveraging both liquid-cooling and air-cooling’s strong points; these features accomplish higher rack density and efficiency, comprehensive reduction in power use, and increase of overclocking potential.

​

How AV2000 Support 96TB NVMe

PCIe Gen 4 is the upper version of PCIe Gen 3, which surpassed PCIe Gen 2 and Gen 1. The bandwidth provided by PCIe Gen 4 is double as compared to PCIe Gen 3. It is backward compatible with prior generations of PCIe. PCIe Gen 4 is expected to satisfy, to a large extent, the requirements of high speed servers, gaming, graphics and data centers, where number of servers and solid-state devices are increasing as per market demand. PCIe Gen 4 is the new evolution over the PCIe Gen 3. The PCIe Gen 4 provides the data rate of 16 G/Ts as compared to 8G/Ts provided by PCIe Gen 3. It’s architecture is fully compatible with all the previous generations of PCIe.

7Starlake is devoted to uncovering the unique way of optimising storage. AV2000 supports 6-slot PCIe x 8 expansions that provide extreme PCIe Gen 4 speed for GPUs at an exceptional value.

AV2000 can make the best use of two PCIe x 8 host connections that associate with four PCIe gen 4 U.2 NVMe. Two extended card are individually installed on A5 and A6 slot (Please refer to the demonstration above); each of them has two ports that can total support 32TB NVMe;(8TB U.2 SSD x 4 Ports x 2 PCIe16 Slot). In other words, one port is able to back 16 TB NVMe. In addition to the 4 x PCIe U.2 NVMe, there are other two on board OCuLink (labelled as A7 and A8) that are capable of offering 16TB each. As a result, AV1000 is able to surmount the limitations of traditional SSDs and supply large data storage.