It takes time to understand and take advantage of a new tool, and every major tech company got to work examining what the new era of AI might provide, and what it needed to do so. The capabilities we see in ChatGPT and other large language models today did not immediately follow. There is likely an element of hubris to it as well: Having invented the tech, how could Google fail to best exploit it? This is a prestige play and also a concession to the researchers themselves, who would rather their employer not hide their light under a bushel. You may well ask, why did Google give this wonderful thing away freely? While big private research outfits have been criticized in the past for withholding their work, the trend over the last few years has been toward publishing. You don’t need to know the technical side of it (and indeed I am not the one to teach you), but it has been enormously influential and empowering let it suffice to say that it’s the T in GPT. See, in 2017, Google researchers published the paper “Attention is all you need,” introducing the concept of the transformer and vastly improving the potential capabilities of machine learning models. The irony is it’s all happening because Google thought it had the pitchfork market cornered. After years of singleminded worship of the false god Virtual Assistant, the company is rushing its AI strategy as its competitors join their hands and raise their pitchforks.
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |