Safety- and Efficiency- aligned Learning
Conference Paper
2024
Democratizing AI: Open-source Scalable LLM Training on GPU-based Supercomputers
| Author(s): | Singh, Siddharth and Singhania, Prajwal and Ranjan, Aditya and Kirchenbauer, John and Geiping, Jonas and Wen, Yuxin and Jain, Neel and Hans, Abhimanyu and Shu, Manli and Tomar, Aditya and Goldstein, Tom and Bhatele, Abhinav |
| Book Title: | International Conference for High Performance Computing, Networking, Storage and Analysis SC (SC24) |
| Pages: | 36-49 |
| Year: | 2024 |
| Month: | November |
| Day: | 17 |
| Series: | Supercomputing |
| Publisher: | IEEE Digital Library |
| Bibtex Type: | Conference Paper (conference) |
| Address: | Atlanta, GA |
| DOI: | 10.1109/SC41406.2024.00010 |
| Event Name: | International Conference for High Performance Computing |
| Event Place: | Atlanta, GA |
| State: | Published |
| URL: | https://www.computer.org/csdl/proceedings-article/sc/2024/529100a036/21HUV5yQsyQ |
BibTex
@conference{singh_2024,
title = {Democratizing AI: Open-source Scalable LLM Training on GPU-based Supercomputers},
booktitle = {International Conference for High Performance Computing, Networking, Storage and Analysis SC (SC24)},
pages = {36-49},
series = {Supercomputing},
publisher = {IEEE Digital Library},
address = {Atlanta, GA},
month = nov,
year = {2024},
slug = {singh_2024},
author = {Singh, Siddharth and Singhania, Prajwal and Ranjan, Aditya and Kirchenbauer, John and Geiping, Jonas and Wen, Yuxin and Jain, Neel and Hans, Abhimanyu and Shu, Manli and Tomar, Aditya and Goldstein, Tom and Bhatele, Abhinav},
url = {https://www.computer.org/csdl/proceedings-article/sc/2024/529100a036/21HUV5yQsyQ},
month_numeric = {11}
}