Search results for:
Training vs Inference – Network Compression
This training versus inference workload series provides platform architects and owners insights about ML workload characteristics. Instead of treating deep neural...
Aug 26, 2022
8 min read
Training vs Inference – Numerical Precision
Part 4 focused on the memory consumption of a CNN and revealed that neural networks require parameter data (weights) and input data...
Jul 26, 2022
9 min read
Training vs Inference – Memory Consumption by Neural Networks
This article dives deeper into the memory consumption of deep learning neural network architectures. What exactly happens when an input is...
Jul 15, 2022
11 min read
vSphere 7 Cores per Socket and Virtual NUMA
Regularly I meet with customers to discuss NUMA technology, and one of the topics that are always on the list is...
Dec 2, 2021
4 min read
Project Monterey and the need for Network Cycles Offload for ML Workloads.
VMworld has started, and that means a lot of new announcements. One of the most significant projects VMware is working on...
Oct 6, 2021
2 min read
PCIe Device NUMA Node Locality
During this Christmas break, I wanted to learn PowerCLI properly. As I’m researching the use-cases of new hardware types and workloads...
Jan 10, 2020
6 min read
Basic Terminologies Large Language Models
Many organizations are in the process of deploying large language models to apply to their use cases. Publically available Large Language...
Aug 18, 2023
10 min read
I’m noticing a trend that more ESXi hosts have Sub-NUMA Clustering enabled. Typically this setting is used in the High-Performance Computing...
Sep 21, 2022
10 min read
Solving vNUMA Topology Mismatch When Migrating between Dual Socket Servers and Quad Socket Servers
I recently received a few questions from customers migrating between clusters with different CPU socket footprints. The challenge is not necessarily...
Mar 11, 2022
3 min read
Home Lab Fundamentals: DNS Reverse Lookup Zones
When starting your home lab, all hints and tips are welcome. The community is full of wisdom, yet sometimes certain topics...
Jun 13, 2016
5 min read