SlimPajama: A 627B token cleaned and deduplicated version of RedPajama

Sounds like Cerebras will be training a model soon based on this dataset, will likely rival OpenLLaMa and RedPajamas models – thoughts??