The meme is a humorous image of a graph showing the growth of various AI models' computational requirements over time. The graph starts with a small AI model called "ELMo" in 2018, which requires 94 million parameters. The line then jumps to "ELMo" in 2019, which requires 1.3 billion parameters, and continues to increase, reaching 1.3 trillion parameters by 2022.
2023-12-18T06:50:07+00:00
1000 ot 28 aa _ GPT-3 (175B) ~_ wg nw ~ =" 2 % #100 get Megatron-Turing NLG (530B) E ge S ae &. Megatron-LM (8.3B) A ee %s \ 2g —_— Turing-NLG (17.2B) ) 10 \ on < a. 2 Zi" “75 (118) 3 ee = @ 1 otf ~GPT-2 (1.5B) oO a” = es “__ BERT-Large (340M) 01 © \ “ELMo (94M) 0.01 2018 2019 2020 2021 2022