GPT 3 stands for Generative Pre-trained Transformer, OpenAI’s latest AI language model. GPT-3 is the most powerful language model ever built. The model has 175 billion parameters. To put that figure into perspective, its previous model, GPT-2, which was considered state-of-the-art and shockingly massive when it was released last year, had 1.5 billion parameters.
It is largely being recognized for its language capabilities, when properly primed by humans, it can write creative fiction. Researchers say that GPT-3 samples are not just close to human level, in fact, they are creative, witty, deep, meta, and often beautiful. They demonstrate the ability to handle abstractions like style parodies, write poems, etc. They also said that chatting with GPT-3 feels very similar to chatting with a human.
It can also generate functioning code. Simply input the text that encapsulates the product’s essence, and the generator will produce the entire code.
GPT-3’s possible uses can only be limited to our imaginations.
At its core, GPT-3 is an extremely sophisticated text predictor. A human gives it a chunk of text as input, and the model generates its best guess as to what the next chunk of text should be. It can then repeat this process by taking the original input together with the newly generated chunk, treating that as a new input, and generating a subsequent chunk until it reaches a length limit.
But how does GPT-3 go about generating these predictions?
It has effectively ingested all of the text available on the internet. The output it generates is the language that it calculates to be a statistically plausible response to the input it is given, based on everything that humans have previously published online. Amazingly rich and nuanced insights can be extracted from the patterns latent in massive data sets far beyond what the human mind can recognize on its own.
This is the first premise of modern machine learning development. Having trained on a data set of half a trillion words, GPT-3 can identify and dazzlingly riff on the linguistic patterns contained therein.
But GPT-3 is not as perfect as everyone thinks it is. It cannot reason abstractly. Basically, it lacks true common sense. The GPT-3 hype is way too much. It’s impressive, but it still has serious weaknesses. AI – Artificial Intelligence app development is going to change the world, and GPT-3 is just an early Glimpse.
