They've open sourced some of the training and inference code: https://github.com/soofi-project

Their work is based on the nemotron arch (so far).

https://github.com/soofi-project/Soofi-Pretraining https://huggingface.co/Soofi-Project/Soofi-S-Base > "The final model will be released openly under a permissive license, without gated access. We will share access details as soon as it is ready."

not open weight yet