SCALING UP LANGUAGE MODELS: A LOOK AT 123B

Researchers at Google have presented a novel language model called 123B. This massive model is instructed on a dataset of remarkable size, containing textual data from a diverse range of sources. The goal of this research is to investigate the capabilities of scaling language models to significant sizes and show the benefits that can result from su