Shen, G., Delalleau, O., Jian, S., Zhang, J., Zeng, J., Egert, D., Wang, Z., Yan, Z., Dong, Y., Markel, A., Taghibakhshi, A., Tao, L., Hu, J., Yao, X., Liu, H., Aithal, A., & Kuchaiev, O. NeMo-Aligner: a toolkit for model alignment [Computer software]. https://github.com/NVIDIA/NeMo-Aligner