Inside language models (from GPT-3 to PaLM

Różne ciekawostki o AI i ich modelach m.in: Language model sizes. Summary of current models. Increasing dataset sizes 2018-2022. GPT-3’s top 10 datasets by domain/source. Contents of GPT-3 & the Pile v1. Contents of Chinese models. Language model sizes & predictions.