Performance

Peformance comparison

The performance comparison is summarized in the figure below.

  • DNN/CNN/RNN comparison

    • Tensorflow/PyTorch/Horovod

../../_images/benchmark1.png ../../_images/benchmark2.png

  • Embedding model comparison

    • Parallax/TensorFlow/Horovod/HugeCTR

../../_images/benchmark5.png

  • GNN comparison

    • DGL/PYG

../../_images/benchmark6.png ../../_images/benchmark7.png

  • Batch size comparison

    • Swap/Recompute

../../_images/benchmark3.png ../../_images/benchmark4.png

  • AutoML search comparison

  • Pretrain model comparison

    • Pipedream/Gpipe/Megatron-LM

More benchmark results and details are coming soon.