Philip Williams
on 22 November 2021
Here at Canonical, we have lots of industry partnerships where we work jointly, hand-in-hand, to produce the best possible outcomes for the open source community. From getting early access to next generation hardware to ensure Ubuntu is fully compatible when it’s released, to creating solution orientated reference architectures for products built on top of Ubuntu like Charmed Ceph, Canonical is committed to engineering the best possible computing experience.
Recently, our product management and hardware alliances teams came together with Dell Technologies to collaboratively define, test, and validate a Dell EMC PowerEdge based Charmed Ceph reference architecture.
Reference architecture
The goal of this exercise was to produce a guide to building a capacity orientated Ceph cluster that could be used for block (RBD), file (CephFS) or object (Swift or S3) workloads, and demonstrate the performance that can be achieved with similar hardware.
We took relatively standard components (four Dell EMC R740xd2 servers with Intel Xeon processors and NICs, a few SSDs, and lots of high capacity NL-SAS disks) and connected them all together with 25GbE networking.
The R740xd2 provides an ideal building block for Ceph clusters due to its highly configurable nature, which allows users to make performance, capacity, and price adjustments as needed. For example, to create a higher performance cluster, the CPUs could be swapped for another model that has more cores and cache, and the disks could be changed to NVMe and/or SSD if required.
Learn more
During this exercise, we tested the performance of the cluster with various different workloads, such as small block and large block, with and without bcache.
We also demonstrated the scalability of Ceph, by adding an extra storage node and re-running the performance tests to show the improvement in cluster performance. We were able to achieve over 75,000 random read IOPs, and over 6 GBps sequential read from a 4 node capacity orientated cluster, as well as demonstrating how our unique OSD deployment approach using bcache can provide up to 2.5x improvement in performance for small block workloads.
All of the test results and detailed hardware architecture information can be found in the whitepaper on Dell Technologies InfoHub, here. We also discussed our findings in this webinar which can be watched back on-demand.