GPT 3 stands for Generative Pre-trained Transformer, an OpenAI’s latest AI language model. GPT 3 is the most powerful language model ever built. The model has 175 billion parameters. To put that figure into perspective its previous model GPT 2 which was considered state-of-the-art and shockingly massive when it was released last year had 1.5 billion parameters.
It is largely being recognized for its language capabilities, when properly primed by humans it can write creative fiction. Researchers say that GPT 3 samples are not just close to human level in fact they are creative, witty, deep, meta, and often beautiful. They demonstrate the ability to handle abstractions like style parodies, write poems, etc. They also said that chatting with the GPT 3 feels very similar to chatting with a human.
It can also generate functioning code. All you have to do is enter the text that captures the essence of the product and the generator dishes out the complete code.
GPT 3’s possible uses can be only limited to our imaginations.
At its core GPT 3 is an extremely sophisticated text predictor. A human gives it a chunk of text as input and the model generates its best guess as to what the next chunk of text should be. It can then repeat this process by taking the original input together with the newly generated chunk treating that as a new input and generating a subsequent chunk until it reaches a length limit.
But how does GPT 3 go about generating these predictions?
It has ingested effectively all of the text available on the internet. The output it generates is the language that it calculates to be a statistically plausible response to the input it is given based on everything that humans have previously published online. Amazingly rich and nuanced insights can be extracted from the patterns latent in massive data sets far beyond what the human mind can recognize on its own.
This is the first premise of modern machine learning development having trained on a data set of half a trillion words GPT 3 is able to identify and dazzlingly riff on the linguistic patterns contained therein.
But GPT 3 is not perfect as everyone thinks it to be. It lacks the ability to reason abstractly. Basically, it lacks true common sense. The GPT 3 hype is way too much. It’s impressive but it still has serious weaknesses. AI – Artificial Intelligent app development is going to change the world and GPT 3 is just an early Glimpse.
