George Hotz: Sam Altman won't tell you that GPT-4 has 220B parameters and is 16-way mixture model with 8 sets of weights

https://youtu.be/1v-qvVIje4Y?t=68