HPE DL380a Gen12 vs DL384 Gen12: x86 or Arm for AI Inference?
HPE's ProLiant Compute DL380a Gen12 and DL384 Gen12 differ by one digit and one letter. It would be reasonable to assume they are close relatives. They are not. One is a conventional x86 server with a lot of GPU slots. The other has no Intel or AMD processor in it at all.
Both are sold for AI inference. Choosing between them is really choosing between two philosophies: many GPUs on a familiar platform, or a few very well-connected GPUs on a new one.
The two servers in pictures
| Compare | DL380a Gen12 | DL384 Gen12 |
|---|---|---|
| ⚙️ Processor type |
x86 Two Intel Xeon 6, up to 144 cores |
Arm NVIDIA Grace, 72 cores per superchip |
| 🧠 GPUs | Up to 10 double-wide |
Up to 2, built into the superchips |
| 🔄 GPU choice |
Wide Several NVIDIA models, including RTX PRO 6000 Blackwell |
Fixed NVIDIA GH200 |
| 🔗 How CPU and GPU share memory | Separate, over PCIe | Tightly coupled: up to 1.2 TB of fast unified memory |
| 📏 Size | 4U |
2U |
| ❄️ Cooling |
AirLiquid Air or direct liquid |
Air |
| 🧑💻 Software familiarity |
High Everything runs on x86 |
Check AI stack is ready; check everything else |
Sources: HPE ProLiant Compute DL380a Gen12, HPE ProLiant Compute DL384 Gen12, HPE DL384 Gen12 QuickSpecs
DL380a Gen12: the workhorse
The DL380a is the server most enterprises picture when they think of AI inference. It is a 4U chassis with two Intel Xeon 6 processors and space for up to ten double-wide GPUs, with air or direct liquid cooling. HPE positions it for generative AI fine-tuning and inference on large workloads that use many GPUs.
Its strength is flexibility. You choose the GPU model to match the job and the budget, start with a few and add more, and run it with tools every infrastructure team already knows. If several teams need to share one machine, ten independent GPUs divide up neatly.
DL384 Gen12: the specialist
The DL384 is a different animal. HPE describes it as its first ProLiant rack server with the NVIDIA GH200 Grace Hopper Superchip. Each superchip combines an Arm-based Grace CPU and a Hopper-generation GPU, joined by a high-bandwidth link, and the server takes up to two.
The point of that design is memory. HPE's QuickSpecs cite up to 1.2 TB of fast unified memory, and position the server for large language model inference that needs large memory capacity, as well as non-AI work such as large-scale simulation, chip design and weather forecasting. HPE also says it delivers the best performance per GPU in the ProLiant portfolio.
Three questions that decide it
1. Are you short of GPUs, or short of memory?
If your workload is many requests against moderately sized models, you want GPU count. That is the DL380a. If your workload is a single model or dataset that struggles to fit in GPU memory, the DL384's coupled CPU and GPU memory is the more interesting answer.
2. Is your software ready for Arm?
This is the question that gets skipped. NVIDIA's AI software runs on Arm, and the major AI frameworks support it. But an enterprise server also runs monitoring agents, security tools, backup clients and licensed applications, and not every vendor ships an Arm version. Before choosing the DL384, list every piece of software that must run on the box and confirm Arm support for each.
3. How long do you want the GPU to stay current?
The DL380a accepts current-generation cards, and the GPUs can be changed. The DL384's GPUs are part of the superchip and belong to the Hopper generation, which has since been followed by Blackwell. That does not make it a bad buy. Performance per GPU remains strong and memory-heavy work suits it well. But it is a fixed design, and buyers should go in knowing that.
The slightly controversial bit
Arm in the data centre has been "about to arrive" for a decade. With NVIDIA's own flagship racks now built on Arm-based Grace and Vera CPUs, it has plainly arrived at the top of the market. The DL384 is one of the few ways to try that architecture at ordinary server scale, in a 2U air-cooled box, without buying a rack.
For most enterprises today, though, the honest recommendation is the boring one. Unless you have a specific memory-bound workload and have checked your software, the x86 server is the lower-risk choice. Being early to a platform shift is valuable for specialists and expensive for everyone else.
Which one, in one table
| Your situation | Lean towards |
|---|---|
| 💬 Chat, RAG and assistants for many users | DL380a Gen12 |
| 👥 Several teams sharing one server | DL380a Gen12 |
| 🔧 Fine-tuning with room to add GPUs later | DL380a Gen12 |
| 🧩 One large model that is memory-bound | DL384 Gen12 |
| 🌦️ Mixed AI and simulation in a small footprint | DL384 Gen12 |
| 🧪 Evaluating Arm before a larger NVIDIA purchase | DL384 Gen12 |
| 🛡️ Strict list of required x86-only agents or applications | DL380a Gen12 |
Related on SourceIT
SourceIT Approved
Researched and verified by the SourceIT team for Singapore buyers.




