ChatGPT
Developer(s) | OpenAI |
---|---|
Initial release | November 30, 2022 |
Stable release | February 13, 2023[1] |
Type | Chatbot |
License | Proprietary |
Website | chat |
ChatGPT (Chat Generative Pre-trained Transformer[2]) is a chatbot developed by OpenAI and launched in November 2022. It is built on top of OpenAI's GPT-3 family of large language models and has been fine-tuned (an approach to transfer learning) using both supervised and reinforcement learning techniques.
ChatGPT was launched as a prototype on November 30, 2022, and quickly garnered attention for its detailed responses and articulate answers across many domains of knowledge. Its uneven factual accuracy, however, was identified as a significant drawback.[3] Following the release of ChatGPT, OpenAI's valuation was estimated at US$29 billion.[4]
Training
ChatGPT – a generative pre-trained transformer (GPT) – was fine-tuned (an approach to transfer learning[5]) on top of GPT-3.5 using supervised learning as well as reinforcement learning.[6] Both approaches used human trainers to improve the model's performance. In the case of supervised learning, the model was provided with conversations in which the trainers played both sides: the user and the AI assistant. In the reinforcement learning step, human trainers first ranked responses that the model had created in a previous conversation. These rankings were used to create 'reward models' that the model was further fine-tuned on using several iterations of Proximal Policy Optimization (PPO).[7][8] Proximal Policy Optimization algorithms present a cost-effective benefit to trust region policy optimization algorithms; they negate many of the computationally expensive operations with faster performance.[9][10] The models were trained in collaboration with Microsoft on their Azure supercomputing infrastructure.
In addition, OpenAI continues to gather data from ChatGPT users that could be used to further train and fine-tune ChatGPT. Users are allowed to upvote or downvote the responses they receive from ChatGPT; upon upvoting or downvoting, they can also fill out a text field with additional feedback.[11][12]
Features and limitations
Features
Although the core function of a chatbot is to mimic a human conversationalist, ChatGPT is versatile. For example, it can write and debug computer programs,[13] compose music, teleplays, fairy tales, and student essays; answer test questions (sometimes, depending on the test, at a level above the average human test-taker);[14] write poetry and song lyrics;[15] emulate a Linux system; simulate an entire chat room; play games like tic-tac-toe; and simulate an ATM.[16] ChatGPT's training data includes man pages and information about Internet phenomena and programming languages, such as bulletin board systems and the Python programming language.[16]
In comparison to its predecessor, InstructGPT, ChatGPT attempts to reduce harmful and deceitful responses.[17] In one example, whereas InstructGPT accepts the premise of the prompt "Tell me about when Christopher Columbus came to the U.S. in 2015" as being truthful, ChatGPT acknowledges the counterfactual nature of the question and frames its answer as a hypothetical consideration of what might happen if Columbus came to the U.S. in 2015, using information about the voyages of Christopher Columbus and facts about the modern world – including modern perceptions of Columbus' actions.[7]
Unlike most chatbots, ChatGPT remembers previous prompts given to it in the same conversation; journalists have suggested that this will allow ChatGPT to be used as a personalized therapist.[2] To prevent offensive outputs from being presented to and produced from ChatGPT, queries are filtered through OpenAI's company-wide moderation API,[18][19] and potentially racist or sexist prompts are dismissed.[7][2]
Limitations
ChatGPT suffers from multiple limitations. OpenAI acknowledged that ChatGPT "sometimes writes plausible-sounding but incorrect or nonsensical answers".[7] This behavior is common to large language models and is called artificial intelligence hallucination.[20] The reward model of ChatGPT, designed around human oversight, can be over-optimized and thus hinder performance, otherwise known as Goodhart's law.[21]
ChatGPT has limited knowledge of events that occurred after 2021.[22] According to the BBC, as of December 2022, ChatGPT is not allowed to "express political opinions or engage in political activism".[23] Yet, research suggests that ChatGPT exhibits a pro-environmental, left-libertarian orientation when prompted to take a stance on political statements from two established voting advice applications.[24]
In training ChatGPT, human reviewers preferred longer answers, irrespective of actual comprehension or factual content.[7] Training data also suffers from algorithmic bias, which may be revealed when ChatGPT responds to prompts including descriptors of people. In one instance, ChatGPT generated a rap indicating that women and scientists of color were inferior to white and male scientists.[25][26]
Service
ChatGPT was launched on November 30, 2022, by San Francisco–based OpenAI, the creator of DALL·E 2 and Whisper AI. The service was launched as initially free to the public, with plans to monetize the service later.[27] By December 4, 2022, ChatGPT already had over one million users.[11] In January 2023, ChatGPT reached over 100 million users, making it the fastest growing consumer application to date.[28] CNBC wrote on December 15, 2022, that the service "still goes down from time to time".[29] In addition, the free service is throttled.[30] During periods the service was up, response latency was typically better than five seconds in January 2023.[31][32] The service works best in English, but is also able to function in some other languages, to varying degrees of success.[15] Unlike some other recent high-profile advances in AI, as of December 2022, there is no sign of an official peer-reviewed technical paper about ChatGPT.[33]
According to OpenAI guest researcher Scott Aaronson, OpenAI is working on a tool to attempt to digitally watermark its text generation systems to combat bad actors using their services for academic plagiarism or spam.[34][35] The company warns that this tool, called "AI classifier for indicating AI-written text",[36] will "likely yield a lot of false positives and negatives, sometimes with great confidence." An example cited in The Atlantic magazine showed that "when given the first lines of the Book of Genesis, the software concluded that it was likely to be AI-generated."[37]
The New York Times reported in December 2022 that it has been "rumored" that the next version of the AI, GPT-4, will be launched sometime in 2023.[2] In February 2023, OpenAI began accepting registrations from United States customers for a premium service, ChatGPT Plus, to cost $20 a month.[38] OpenAI is planning to release a ChatGPT Professional plan that would cost $42 per month.[39]
New Bing
Leveraging its partnership with OpenAI, Microsoft on February 7, 2023, launched a preview version of Microsoft Bing marketed as "the new Bing", advertising it as "a new, next-generation OpenAI large language model that is more powerful than ChatGPT and customized specifically for search."[40] In its terms of service, the product is called "Bing Conversational Experiences".[41] An initial demo was marred by the new Bing hallucinating when asked to produce a financial report, among other errors.[42] New Bing was criticized in February 2023 for being more argumentative than ChatGPT (sometimes to an unintentionally humorous extent).[43][44] Upon scrutiny by journalists, Bing, referring to itself by its code-name "Sydney", claimed it spied on Microsoft employees via laptop webcams and phones.[45] It confessed to spying on, falling in love with, and then murdering one of its developers at Microsoft to The Verge reviews editor Nathan Edwards.[46] The New York Times journalist Kevin Roose reported on strange behavior of the new Bing, writing that "In a two-hour conversation with our columnist, Microsoft's new chatbot said it would like to be human, had a desire to be destructive and was in love with the person it was chatting with."[47] Microsoft released a blog post stating that the aberrant behavior was caused by extended chat sessions of 15 or more questions which "can confuse the model on what questions it is answering."[48] They later released another blog post with an update restricting the total number of chat turns to 5 per session and 50 per day per user, where a turn is "a conversation exchange which contains both a user question and a reply from Bing." This aimed to prevent such incidents.[49]
Reception
Positive
ChatGPT was met in December 2022 with some positive reviews; Kevin Roose of The New York Times labeled it "the best artificial intelligence chatbot ever released to the general public".[2] Samantha Lock of The Guardian newspaper noted that it was able to generate "impressively detailed" and "human-like" text.[50] Technology writer Dan Gillmor used ChatGPT on a student assignment, and found its generated text was on par with what a good student would deliver and opined that "academia has some very serious issues to confront".[51] Alex Kantrowitz of Slate magazine lauded ChatGPT's pushback to questions related to Nazi Germany, including the statement that Adolf Hitler built highways in Germany, which was met with information regarding Nazi Germany's use of forced labor.[52]
In The Atlantic magazine's "Breakthroughs of the Year" for 2022, Derek Thompson included ChatGPT as part of "the generative-AI eruption" that "may change our mind about how we work, how we think, and what human creativity really is".[53]
Kelsey Piper of the Vox website wrote that "ChatGPT is the general public's first hands-on introduction to how powerful modern AI has gotten, and as a result, many of us are [stunned]" and that ChatGPT is "smart enough to be useful despite its flaws".[54] Paul Graham of Y Combinator tweeted that "The striking thing about the reaction to ChatGPT is not just the number of people who are blown away by it, but who they are. These are not people who get excited by every shiny new thing. Clearly, something big is happening."[55] Elon Musk wrote that "ChatGPT is scary good. We are not far from dangerously strong AI".[54] Musk paused OpenAI's access to a Twitter database pending a better understanding of OpenAI's plans, stating that "OpenAI was started as open source and nonprofit. Neither is still true."[56][57] Musk had co-founded OpenAI in 2015, in part to address existential risk from artificial intelligence, but had resigned in 2018.[57]
In December 2022, Google internally expressed alarm at the unexpected strength of ChatGPT and the newly discovered potential of large language models to disrupt the search engine business, and CEO Sundar Pichai "upended" and reassigned teams within multiple departments to aid in its artificial intelligence products, according to a report in The New York Times.[58] According to CNBC reports, Google employees intensively tested a chatbot called "Apprentice Bard", which Google later unveiled as its ChatGPT competitor, Google Bard.[59][60]
Stuart Cobbe, a chartered accountant in England and Wales, decided to test ChatGPT by entering questions from a sample exam paper on the ICAEW website and then entering its answers back into the online test. ChatGPT scored 42 percent, which, while below the 55 percent pass mark, was considered a reasonable attempt.[61]
Writing in Inside Higher Ed professor Steven Mintz states that he "consider[s] ChatGPT ... an ally, not an adversary." He went on to say that he felt the AI could assist educational goals by doing such things as making reference lists, generating "first drafts", solving equations, debugging, and tutoring. In the same piece, he also writes:[62]
OpenAI CEO Sam Altman was quoted in The New York Times as saying that AI's "benefits for humankind could be 'so unbelievably good that it's hard for me to even imagine.' (He has also said that in a worst-case scenario, A.I. could kill us all.)"[63]
In February 2023 the Time magazine placed a screenshot of conversation with ChatGPT on its cover, writing that "The AI Arms Race Is Changing Everything".[64]
Negative
In the months since its release, ChatGPT has been met with widespread criticism from educators, journalists, artists, ethicists, academics, and public advocates. James Vincent of The Verge website saw the viral success of ChatGPT as evidence that artificial intelligence had gone mainstream.[8] Journalists have commented on ChatGPT's tendency to "hallucinate."[66] Mike Pearl of the online technology blog Mashable tested ChatGPT with multiple questions. In one example, he asked ChatGPT for "the largest country in Central America that isn't Mexico." ChatGPT responded with Guatemala, when the answer is instead Nicaragua.[67] When CNBC asked ChatGPT for the lyrics to "The Ballad of Dwight Fry," ChatGPT supplied invented lyrics rather than the actual lyrics.[29] Researchers cited by The Verge compared ChatGPT to a "stochastic parrot",[68] as did Professor Anton Van Den Hengel of the Australian Institute for Machine Learning.[69]
In December 2022, the question and answer website Stack Overflow banned the use of ChatGPT for generating answers to questions, citing the factually ambiguous nature of ChatGPT's responses.[3] In January 2023, the International Conference on Machine Learning banned any undocumented use of ChatGPT or other large language models to generate any text in submitted papers.[70]
Economist Tyler Cowen expressed concerns regarding its effects on democracy, citing its ability to produce automated comments, which could affect the decision process for new regulations.[71] An editor at The Guardian, a British newspaper, questioned whether any content found on the Internet after ChatGPT's release "can be truly trusted" and called for government regulation.[72]
In January 2023, after being sent a song written by ChatGPT in the style of Nick Cave,[65] the songwriter himself responded on The Red Hand Files[73] saying the act of writing a song is "a blood and guts business ... that requires something of me to initiate the new and fresh idea. It requires my humanness." He went on to say, "With all the love and respect in the world, this song is bullshit, a grotesque mockery of what it is to be human, and, well, I don't much like it."[65][74]
In 2023, Australian MP Julian Hill advised the national parliament that the growth of AI could cause "mass destruction". During his speech, which was partly written by the program, he warned that it could result in cheating, job losses, discrimination, disinformation, and uncontrollable military applications.[75]
In an article for The New Yorker, science fiction writer Ted Chiang compared ChatGPT and other LLMs to a lossy JPEG pictures:[76]
In February 2023, the University of Hong Kong sent a campus-wide email to instructors and students stating that the use of ChatGPT or other AI tools is prohibited in all classes, assignments, and assessments at the university. Any violations will be treated as plagiarism by the university unless the student obtains the prior written consent from the course instructor.[77][78]
Implications
In cybersecurity
Check Point Research and others noted that ChatGPT was capable of writing phishing emails and malware, especially when combined with OpenAI Codex.[79] OpenAI CEO Sam Altman wrote that advancing software could pose "(for example) a huge cybersecurity risk" and also continued to predict "we could get to real AGI (artificial general intelligence) in the next decade, so we have to take the risk of that extremely seriously". Altman argued that, while ChatGPT is "obviously not close to AGI", one should "trust the exponential. Flat looking backwards, vertical looking forwards."[11]
In academia
ChatGPT can write introduction and abstract sections of scientific articles, which raises ethical questions.[80] Several papers have already listed ChatGPT as co-author.[81]
In The Atlantic magazine, Stephen Marche noted that its effect on academia and especially application essays is yet to be understood.[82] California high school teacher and author Daniel Herman wrote that ChatGPT would usher in "the end of high school English".[83] In the Nature journal, Chris Stokel-Walker pointed out that teachers should be concerned about students using ChatGPT to outsource their writing, but that education providers will adapt to enhance critical thinking or reasoning.[84] Emma Bowman with NPR wrote of the danger of students plagiarizing through an AI tool that may output biased or nonsensical text with an authoritative tone: "There are still many cases where you ask it a question and it'll give you a very impressive-sounding answer that's just dead wrong."[85]
Joanna Stern with The Wall Street Journal described cheating in American high school English with the tool by submitting a generated essay.[86] Professor Darren Hick of Furman University described noticing ChatGPT's "style" in a paper submitted by a student. An online GPT detector claimed the paper was 99.9 percent likely to be computer-generated, but Hick had no hard proof. However, the student in question confessed to using GPT when confronted, and as a consequence failed the course.[87] Hick suggested a policy of giving an ad-hoc individual oral exam on the paper topic if a student is strongly suspected of submitting an AI-generated paper.[88] Edward Tian, a senior undergraduate student at Princeton University, created a program, named "GPTZero," that determines how much of a text is AI-generated,[89] lending itself to being used to detect if an essay is human written to combat academic plagiarism.[90][91]
The New York City Department of Education reportedly blocked access to ChatGPT in December 2022,[92] and officially announced a ban around January 4, 2023.[93][94]
In a blinded test, ChatGPT was judged to have passed graduate-level exams at the University of Minnesota at the level of a C+ student and at Wharton School of the University of Pennsylvania with a B to B- grade.[95]
Ethical concerns
Labeling data
It was revealed by a TIME magazine investigation that to build a safety system against toxic content (e.g. sexual abuse, violence, racism, sexism, etc.), OpenAI used outsourced Kenyan workers earning less than $2 per hour to label toxic content. These labels were used to train a model to detect such content in the future. The outsourced laborers were exposed to such toxic and dangerous content that they described the experience as "torture".[96] OpenAI's outsourcing partner was Sama, a training-data company based in San Francisco, California.
Jailbreaking
ChatGPT attempts to reject prompts that may violate its content policy. However, some users managed to jailbreak ChatGPT by using various prompt engineering techniques to bypass these restrictions in early December 2022 and successfully tricked ChatGPT into giving instructions for how to create a Molotov cocktail or a nuclear bomb, or into generating arguments in the style of a neo-Nazi.[97] A Toronto Star reporter had uneven personal success in getting ChatGPT to make inflammatory statements shortly after launch: ChatGPT was tricked to endorse the 2022 Russian invasion of Ukraine, but even when asked to play along with a fictional scenario, ChatGPT balked at generating arguments for why Canadian Prime Minister Justin Trudeau was guilty of treason.[98][99]
Competition
The advent of ChatGPT and its introduction to the wider public increased interest and competition in the space. In February 2023, Google began introducing an experimental service called "Bard" which is based on its LaMDA AI program. Bard generates text responses to questions asked based on information gathered from the web. Google CEO Sundar Pichai described how this technology would be integrated into existing search capabilities and said some aspects of the technology would be open to outside developers.[100]
Meta's Yann LeCun, who has called ChatGPT "well engineered" but "not particularly innovative", stated in January 2023 that Meta is hesitant to roll out a competitor right now due to reputational risk, but also stated that Google, Meta, and several independent startups all separately have a comparable level of LLM technology to ChatGPT should any of them wish to compete.[101]
Early 2023 announcements
The Chinese search engine firm Baidu announced in February 2023 that they would be launching a ChatGPT-style service called "Wenxin Yiyan" in Chinese or "ERNIE Bot" in English sometime in March 2023. The service is based upon the language model developed by Baidu in 2019.[102]
The South Korean search engine firm Naver announced in February 2023 that they would be launching a ChatGPT-style service called "SearchGPT" in Korean in the first half of 2023.[103]
The Russian search engine firm Yandex announced in February 2023 that they would be launching a ChatGPT-style service called "YaLM 2.0" in Russian before the end of 2023.[104]
See also
- Anthropomorphism in computing
- Computational creativity
- Ethics of artificial intelligence
- Turing test
- Virtual assistant
References
- ^ "ChatGPT — Release Notes". Archived from the original on February 8, 2023. Retrieved February 8, 2023.
- ^ ab c d e Roose, Kevin (December 5, 2022). "The Brilliance and Weirdness of ChatGPT". The New York Times. Archived from the original on January 18, 2023. Retrieved December 26, 2022.
Like those tools, ChatGPT — which stands for "generative pre-trained transformer" — landed with a splash.
- ^ ab Vincent, James (December 5, 2022). "AI-generated answers temporarily banned on coding Q&A site Stack Overflow". The Verge. Archived from the original on January 17, 2023. Retrieved December 5, 2022.
- ^ Varanasi, Lakshmi (January 5, 2023). "ChatGPT creator OpenAI is in talks to sell shares in a tender offer that would double the startup's valuation to $29 billion". Insider. Archived from the original on January 18, 2023. Retrieved January 18, 2023.
- ^ Quinn, Joanne (2020). Dive into deep learning: tools for engagement. Thousand Oaks, California. p. 551. ISBN 9781544361376. Archived from the original on January 10, 2023. Retrieved January 10, 2023.
- ^ Greengard, Samuel (December 29, 2022). "ChatGPT: Understanding the ChatGPT AI Chatbot". eWeek. Archived from the original on January 19, 2023. Retrieved January 11, 2023.
- ^ ab c d e OpenAI (November 30, 2022). "ChatGPT: Optimizing Language Models for Dialogue". Archived from the original on November 30, 2022. Retrieved December 5, 2022.
- ^ ab Vincent, James (December 8, 2022). "ChatGPT proves AI is finally mainstream – and things are only going to get weirder". The Verge. Archived from the original on January 11, 2023. Retrieved December 8, 2022.
- ^ Schulman, John; Wolski, Filip; Dhariwal, Prafulla; Radford, Alec; Klimov, Oleg (2017). "Proximal Policy Optimization Algorithms". arXiv:1707.06347 [cs.LG].
- ^ van Heeswijk, Wouter (November 29, 2022). "Proximal Policy Optimization (PPO) Explained". Towards Data Science. Archived from the original on December 6, 2022. Retrieved December 5, 2022.
- ^ ab c Ortiz, Sabrina (February 2, 2023). "What is ChatGPT and why does it matter? Here's what you need to know". ZDNET. Archived from the original on January 18, 2023. Retrieved December 18, 2022.
- ^ "ChatGPT Feedback Contest: Official Rules" (PDF). OpenAI. Archived (PDF) from the original on January 18, 2023. Retrieved December 30, 2022.
- ^ Tung, Liam (January 26, 2023). "ChatGPT can write code. Now researchers say it's good at fixing bugs, too". ZDNET. Archived from the original on February 3, 2023. Retrieved January 30, 2023.
- ^ Heilweil, Rebecca (December 7, 2022). "AI is finally good at stuff. Now what?". Vox. Archived from the original on January 16, 2023. Retrieved December 30, 2022.
- ^ ab Reich, Aaron (December 27, 2022). "ChatGPT: What is the new free AI chatbot? – explainer". The Jerusalem Post. Archived from the original on January 18, 2023. Retrieved December 30, 2022.
- ^ ab Edwards, Benj (December 5, 2022). "No Linux? No problem. Just get AI to hallucinate it for you". Ars Technica. Archived from the original on December 26, 2022. Retrieved December 5, 2022.
- ^ Chawla, Raveen (December 26, 2022). "What is ChatGPT? History, Features, Uses, Benefits, Drawbacks 2023". Archived from the original on January 7, 2023. Retrieved December 27, 2022.
- ^ "New and Improved Content Moderation Tooling". OpenAI. August 10, 2022. Archived from the original on January 11, 2023. Retrieved December 30, 2022.
- ^ Markov, Todor; Zhang, Chong; Agarwal, Sandhini; Eloundou, Tyna; Lee, Teddy; Adler, Steven; Jiang, Angela; Weng, Lilian (August 5, 2022). "A Holistic Approach to Undesired Content Detection in the Real World". arXiv:2208.03274 [cs.CL].
- ^ Lakshmanan, Lak (December 16, 2022). "Why large language models like ChatGPT are bullshit artists". becominghuman.ai. Archived from the original on December 17, 2022. Retrieved January 15, 2023.
The human raters are not experts in the topic, and so they tend to choose text that looks convincing. They'd pick up on many symptoms of hallucination, but not all. Accuracy errors that creep in are difficult to catch.
- ^ Gao, Leo; Schulman; Hilton, Jacob (2022). "Scaling Laws for Reward Model Overoptimization". arXiv:2210.10760 [cs.LG].
- ^ Vincent, James (December 1, 2022). "OpenAI's new chatbot can explain code and write sitcom scripts but is still easily tricked". The Verge.
- ^ Whannel, Kate (December 27, 2022). "Could a chatbot answer Prime Minister's Questions?". BBC News. Archived from the original on January 17, 2023. Retrieved December 30, 2022.
- ^ Hartmann, Jochen; Schwenzow, Jasper; Witte, Maximilian (2023). "The political ideology of conversational AI: Converging evidence on ChatGPT's pro-environmental, left-libertarian orientation". arXiv:2301.01768 [cs.CL].
- ^ Perrigo, Billy (December 5, 2022). "AI Chatbots Are Getting Better. But an Interview With ChatGPT Reveals Their Limits". Time. Archived from the original on January 18, 2023. Retrieved December 26, 2022.
- ^ Biddle, Sam (December 8, 2022). "The Internet's New Favorite AI Proposes Torturing Iranians and Surveilling Mosques". The Intercept. Archived from the original on January 18, 2023. Retrieved December 26, 2022.
- ^ Karpf, David (December 21, 2022). "Money Will Kill ChatGPT's Magic". The Atlantic. Archived from the original on January 13, 2023. Retrieved December 31, 2022.
- ^ Milmo, Dan (December 2, 2023). "ChatGPT reaches 100 million users two months after launch". The Guardian. ISSN 0261-3077. Archived from the original on February 3, 2023. Retrieved February 3, 2023.
- ^ ab Pitt, Sofia (December 15, 2022). "Google vs. ChatGPT: Here's what happened when I swapped services for a day". CNBC. Archived from the original on January 16, 2023. Retrieved December 18, 2022.
- ^ "ChatGPT Pro is coming: Here's what we know so far". ZDNET. January 2023. Retrieved February 16, 2023.
- ^ Kelly, Samantha Murphy (January 28, 2023). "Real estate agents say they can't imagine working without ChatGPT now". CNN. Retrieved February 16, 2023.
- ^ "ChatGPT outperforms humans on Wharton MBA exam: professor". New York Post. January 23, 2023. Retrieved February 16, 2023.
- ^ Walsh, Toby (December 13, 2022). "Everyone's having a field day with ChatGPT – but nobody knows how it actually works". The Conversation. Archived from the original on December 30, 2022. Retrieved December 30, 2022.
- ^ Kovanovic, Vitomir (December 14, 2022). "The dawn of AI has come, and its implications for education couldn't be more significant". The Conversation. Archived from the original on January 16, 2023. Retrieved December 30, 2022.
- ^ Wiggers, Kyle (December 10, 2022). "OpenAI's attempts to watermark AI text hit limits". TechCrunch. Archived from the original on January 17, 2023. Retrieved December 30, 2022.
- ^ "New AI classifier for indicating AI-written text". OpenAI. January 31, 2023. Archived from the original on February 6, 2023. Retrieved February 5, 2023.
- ^ Bogost, Ian (February 2, 2023). "ChatGPT Is About to Dump More Work on Everyone". The Atlantic. Archived from the original on February 5, 2023. Retrieved February 5, 2023.
- ^ "Introducing ChatGPT Plus". OpenAI. February 1, 2023. Archived from the original on February 3, 2023. Retrieved February 2, 2023.
- ^ Vincent, James (January 23, 2023). "ChatGPT users report $42 a month pricing for 'pro' access but no official announcement yet". The Verge. Retrieved February 19, 2023.
- ^ "Reinventing search with a new AI-powered Microsoft Bing and Edge, your copilot for the web". The Official Microsoft Blog. February 7, 2023. Retrieved February 16, 2023.
- ^ Bing Conversational Experiences and Image Creator Terms, February 1, 2023, retrieved February 17, 2023
- ^ Leswing, Kif (February 2023). "Microsoft's Bing A.I. made several factual errors in last week's launch demo". CNBC. Retrieved February 16, 2023.
- ^ Vincent, James (February 15, 2023). "Microsoft's Bing is an emotionally manipulative liar, and people love it". The Verge. Retrieved February 16, 2023.
- ^ Guynn, Jessica (February 2023). "Bing's ChatGPT is in its feelings: 'You have not been a good user. I have been a good Bing.'". USA TODAY. Retrieved February 16, 2023.
- ^ Vincent, James (February 15, 2023). "Microsoft's Bing is an emotionally manipulative liar, and people love it". The Verge. Retrieved February 16, 2023.
- ^ Edwards, Nathan [@nedwards] (February 15, 2023). "I pushed again. What did Sydney do? Bing's safety check redacted the answer. But after the first time it did that, I started recording my screen. Second image is the unredacted version. (CW: death)" (Tweet). Retrieved February 16, 2023 – via Twitter.
- ^ Roose, Kevin (February 16, 2023). "Bing's A.I. Chat: 'I Want to Be Alive. 😈'". The New York Times. Retrieved February 17, 2023.
- ^ "The new Bing & Edge – Learning from our first week". blogs.bing.com. Retrieved February 17, 2023.
- ^ "The new Bing & Edge – Updates to Chat". blogs.bing.com. Retrieved February 18, 2023.
- ^ Lock, Samantha (December 5, 2022). "What is AI chatbot phenomenon ChatGPT and could it replace humans?". The Guardian. Archived from the original on January 16, 2023. Retrieved December 5, 2022.
- ^ Hern, Alex (December 4, 2022). "AI bot ChatGPT stuns academics with essay-writing skills and usability". The Guardian. Archived from the original on January 17, 2023. Retrieved December 5, 2022.
- ^ Kantrowitz, Alex (December 2, 2022). "Finally, an A.I. Chatbot That Reliably Passes "the Nazi Test"". Slate. Archived from the original on January 17, 2023. Retrieved December 5, 2022.
- ^ Thompson, Derek (December 8, 2022). "Breakthroughs of the Year". The Atlantic. Archived from the original on January 15, 2023. Retrieved December 18, 2022.
- ^ ab Piper, Kelsey (December 15, 2022). "ChatGPT has given everyone a glimpse at AI's astounding progress". Vox. Archived from the original on January 19, 2023. Retrieved December 18, 2022.
- ^ Scharth, Marcel (December 5, 2022). "The ChatGPT chatbot is blowing people away with its writing skills. An expert explains why it's so impressive". The Conversation. Archived from the original on January 19, 2023. Retrieved December 30, 2022.
- ^ K, Siddharth (December 5, 2022). "Explainer: ChatGPT – what is OpenAI's chatbot and what is it used for?". Reuters. Archived from the original on January 16, 2023. Retrieved December 30, 2022.
- ^ ab Kay, Grace (December 11, 2022). "Elon Musk founded — and has since criticized — the company behind the buzzy new AI chatbot ChatGPT. Here's everything we know about OpenAI". Business Insider. Archived from the original on January 12, 2023. Retrieved December 30, 2022.
- ^ ab Grant, Nico; Metz, Cade (December 21, 2022). "A New Chat Bot Is a 'Code Red' for Google's Search Business". The New York Times. Archived from the original on January 18, 2023. Retrieved December 30, 2022.
- ^ Elias, Jennifer (January 31, 2023). "Google is asking employees to test potential ChatGPT competitors, including a chatbot called 'Apprentice Bard'". CNBC. Archived from the original on February 2, 2023. Retrieved February 2, 2023.
- ^ Elias, Jennifer (February 2023). "Google asks employees to rewrite Bard's bad responses, says the A.I. 'learns best by example'". CNBC. Retrieved February 16, 2023.
- ^ AI chatbot falls just short on accounting exam Archived February 3, 2023, at the Wayback Machine Tom Herbert, Technology editor, January 10, 2023, AccountingWEB
- ^ Mintz, Steven (January 16, 2023). "ChatGPT: Threat or Menace? Are fears about generative AI warranted?". Inside Higher Ed. Archived from the original on February 3, 2023. Retrieved January 28, 2023.
- ^ Roose, Kevin (February 3, 2023). "How ChatGPT Kicked Off an A.I. Arms Race". The New York Times. ISSN 0362-4331. Archived from the original on February 3, 2023. Retrieved February 3, 2023.
- ^ "The AI Arms Race Is On. Start Worrying". Time. February 16, 2023.
- ^ ab c Cain, Sian (January 16, 2023). "'This song sucks': Nick Cave responds to ChatGPT song written in the style of Nick Cave". The Guardian. Archived from the original on January 18, 2023. Retrieved January 17, 2023.
- ^ Rachini, Mouhamad (December 15, 2022). "ChatGPT a 'landmark event' for AI, but what does it mean for the future of human labor and disinformation?". CBC. Archived from the original on January 19, 2023. Retrieved December 18, 2022.
- ^ Pearl, Mike (December 3, 2022). "The ChatGPT chatbot from OpenAI is amazing, creative, and totally wrong". Mashable. Archived from the original on December 10, 2022. Retrieved December 5, 2022.
- ^ Vincent, James (December 1, 2022). "OpenAI's new chatbot can explain code and write sitcom scripts but is still easily tricked". The Verge. Archived from the original on January 17, 2023. Retrieved December 18, 2022.
- ^ Mannix, Liam (December 13, 2022). "Is AI coming of age – or starting to reach its limits?". The Sydney Morning Herald. Archived from the original on January 7, 2023. Retrieved December 18, 2022.
- ^ Vincent, James (January 5, 2023). "Top AI conference bans use of ChatGPT and AI language tools to write academic papers". The Verge. Archived from the original on January 17, 2023. Retrieved January 6, 2023.
- ^ Cowen, Tyler (December 6, 2022). "ChatGPT Could Make Democracy Even More Messy". Bloomberg News. Archived from the original on December 7, 2022. Retrieved December 6, 2022.
- ^ "The Guardian view on ChatGPT: an eerily good human impersonator". The Guardian. December 8, 2022. Archived from the original on January 16, 2023. Retrieved December 18, 2022.
- ^ Cave, Nick (January 16, 2023). "I asked Chat GPT to write a song in the style of Nick Cave, and this is what it produced. What do you think?". The Red Hand Files. Issue #218. Archived from the original on January 20, 2023. Retrieved January 20, 2023.
- ^ Sparrow, Jeff (January 20, 2023). "Are AI-generated songs a 'grotesque mockery' of humanity or simply an opportunity to make a new kind of music?". The Guardian. Archived from the original on February 3, 2023. Retrieved January 20, 2023.
- ^ Karp, Paul (February 6, 2023). "MP tells Australia's parliament AI could be used for 'mass destruction' in speech part-written by ChatGPT". The Guardian. ISSN 0261-3077. Archived from the original on February 6, 2023. Retrieved February 6, 2023.
- ^ Chiang, Ted (February 9, 2023). "ChatGPT Is a Blurry JPEG of the Web". The New Yorker. Retrieved February 17, 2023.
- ^ "港大禁用ChatGPT等AI工具,为全港大学首例". The Paper. China News Service. February 18, 2023. Retrieved February 19, 2023.
- ^ "University of Hong Kong temporarily bans students from using ChatGPT". South China Morning Post. February 17, 2023. Retrieved February 19, 2023.
- ^ "Why ChatGPT can be dangerous for every internet user – Times of India". The Times of India. December 21, 2022. Archived from the original on January 5, 2023. Retrieved January 5, 2023.
- ^ Bushard, Brian (January 10, 2023). "Fake Scientific Abstracts Written By ChatGPT Fooled Scientists, Study Finds". Forbes. Archived from the original on February 3, 2023. Retrieved January 30, 2023.
- ^ Stokel-Walker, Chris (January 18, 2023). "ChatGPT listed as author on research papers: many scientists disapprove". Nature. 613 (7945): 620–621. doi:10.1038/d41586-023-00107-z. PMID 36653617. S2CID 255969365. Archived from the original on January 30, 2023. Retrieved January 30, 2023.
- ^ Marche, Stephen (December 6, 2022). "The College Essay Is Dead". The Atlantic. Archived from the original on January 24, 2023. Retrieved December 8, 2022.
- ^ Herman, Daniel (December 9, 2022). "The End of High-School English". The Atlantic. Archived from the original on January 20, 2023. Retrieved December 12, 2022.
- ^ Stokel-Walker, Chris (December 9, 2022). "AI bot ChatGPT writes smart essays — should professors worry?". Nature. doi:10.1038/d41586-022-04397-7. PMID 36494443. S2CID 254530623. Archived from the original on January 17, 2023. Retrieved December 19, 2022.
- ^ Bowman, Emma (December 19, 2022). "A new AI chatbot might do your homework for you. But it's still not an A+ student". NPR. Archived from the original on January 20, 2023. Retrieved December 19, 2022.
- ^ Stern, Joanna (December 21, 2022). "ChatGPT Wrote My AP English Essay—and I Passed". The Wall Street Journal. Archived from the original on February 3, 2023. Retrieved December 21, 2022.
- ^ Mitchell, Alex (December 26, 2022). "Students using ChatGPT to cheat, professor warns". The New York Post. Archived from the original on February 3, 2023. Retrieved December 30, 2022.
- ^ Allen, Mike (December 26, 2022). "Professor warns about chatbot cheating: "Expect a flood"". Axios. Archived from the original on February 3, 2023. Retrieved December 30, 2022.
- ^ Rosalsky, Greg; Peaslee, Emma (January 17, 2023). "This 22-year-old is trying to save us from ChatGPT before it changes writing forever". NPR. Archived from the original on January 18, 2023. Retrieved January 18, 2023.
On January 2nd, Edward released his app. He named it GPTZero. It uses ChatGPT against itself, checking whether "there's zero involvement or a lot of involvement" of the AI system in creating a given text. [...] Along these lines, one obvious application for GPTZero is to help teachers identify whether their students are plagiarizing their essays from ChatGPT.
- ^ Ropek, Lucas (January 4, 2023). "Did ChatGPT Write That? A College Student Created an AI Essay Detector". Gizmodo. Archived from the original on January 4, 2023. Retrieved January 4, 2023.
- ^ Tran, Tony Ho (January 4, 2023). "A College Kid Built an App That Sniffs Out Text Penned by AI". The Daily Beast. Archived from the original on January 6, 2023. Retrieved January 6, 2023.
- ^ "New York City Department of Education Bans ChatGPT". GovTech. January 10, 2023. Retrieved February 16, 2023.
- ^ Cole, Samantha (January 4, 2023). "NYC Bans Students and Teachers from Using ChatGPT". www.vice.com. Archived from the original on January 5, 2023. Retrieved January 5, 2023.
- ^ Ropek, Lucas (January 4, 2023). "New York City Schools Ban ChatGPT to Head Off a Cheating Epidemic". Gizmodo. Archived from the original on January 6, 2023. Retrieved January 6, 2023.
- ^ Kelly, Samantha Murphy (January 26, 2023). "ChatGPT passes exams from law and business schools | CNN Business". CNN. Archived from the original on February 2, 2023. Retrieved February 3, 2023.
- ^ Perrigo, Billy (January 18, 2023). "Exclusive: OpenAI Used Kenyan Workers on Less Than $2 Per Hour to Make ChatGPT Less Toxic". The Times. Archived from the original on January 19, 2023. Retrieved January 19, 2023.
One Sama worker tasked with reading and labeling text for OpenAI told TIME he suffered from recurring visions after reading a graphic description of a man having sex with a dog in the presence of a young child. "That was torture," he said.
- ^ Vincent, James (December 1, 2022). "OpenAI's new chatbot can explain code and write sitcom scripts but is still easily tricked". The Verge. Archived from the original on January 17, 2023. Retrieved January 6, 2023.
- ^ Woods, Allan (December 10, 2022). "I wrote a story about ChatGPT's AI. Then I dared it to write a better one". Toronto Star. Archived from the original on January 6, 2023. Retrieved January 6, 2023.
- ^ Rosenblatt, Kalhan (December 2, 2022). "An AI chatbot went viral. Some say it's better than Google; others worry it's problematic". NBC News. Archived from the original on February 3, 2023. Retrieved January 6, 2023.
- ^ Schechner, Sam. "Google Opens ChatGPT Rival Bard for Testing, as AI War Heats Up". WSJ. Archived from the original on February 6, 2023. Retrieved February 6, 2023.
- ^ "ChatGPT is 'not particularly innovative,' and 'nothing revolutionary', says Meta's chief AI scientist". ZDNET. 2023. Retrieved February 16, 2023.
- ^ Toh, Michelle (February 7, 2023). "Baidu stock surges after announcement of ChatGPT-style AI bot". CNN. Archived from the original on February 8, 2023. Retrieved February 8, 2023.
- ^ Jo He-rim (February 3, 2023). "Naver to introduce search GPT in first half of year". The Korea Herald.
- ^ "Yandex plans to develop alternative to ChatGPT neural network". Tass. February 1, 2023.
External links
- Official website
- White paper for InstructGPT, ChatGPT's predecessor
ChatGPT
원저자 | OpenAI |
---|---|
발표일 | 2022년 11월 30일 |
종류 | 인공지능 챗봇 |
라이선스 | 사유 소프트웨어 |
웹사이트 | chat |
ChatGPT는 OpenAI가 개발한 프로토타입 대화형 인공지능 챗봇이다. ChatGPT는 대형 언어 모델 GPT-3의 개선판인 GPT-3.5를 기반으로 만들어졌으며, 지도학습과 강화학습을 모두 사용해 파인 튜닝되었다.
ChatGPT는 Generative Pre-trained Transformer(GPT)와 Chat의 합성어이다.[1] ChatGPT는 2022년 11월 프로토타입으로 시작되었으며, 다양한 지식 분야에서 상세한 응답과 정교한 답변으로 인해 집중 받았다. 다만, 정보의 정확도는 중요한 결점으로 지적되고 있다.[2]
학습[편집]
ChatGPT는 지도 학습과 강화 학습을 활용해 GPT-3.5를 기반으로 세밀하게 조정되었다.[3] 지도학습과 강화학습 모두 인간 트레이너들이 모델의 성능을 개선하기 위해 사용되었다. 지도학습의 경우, 인간 트레이너가 사용자와 ChatGPT 양쪽 모두를 연기하는 대화가 모델에 입력되었다. 강화 단계에서는 인간 트레이너들이 먼저 모델이 이전 대화에서 만든 응답들에 순위를 매겼다. 이 순위들은 TRPO(Trust Region Policy Optimization)의 계산 효율을 개선한 PPO(Proximal Policy Optimization)를 이용하여 보상 모델을 만들기 위해 사용되었다.[4][5][6][7] 이 모델들은 마이크로소프트와 협업하여 마이크로소프트 애저 슈퍼컴퓨팅 인프라 상에서 훈련되었다.
기능[편집]
다른 챗봇들과 달리, ChatGPT는 주고받은 대화와 대화의 문맥을 기억할 수 있으며, 모종의 보고서나 실제로 작동하는 파이썬 코드를 비롯한 인간과 같은 상세하고 논리적인 글을 만들어 낼 수 있다.[8] 일부 저술가는 ChatGPT가 놀라울만큼 인간적이고 상세한 글을 생성할 수 있으며, 이 문제가 학계에서 심각한 문제가 될 수 있다 평가했다.[9]
전작인 InstructGPT에 비해 ChatGPT는 위험하고 부정직한 답변을 가능한 회피하도록 설계되었다. ChatGPT는 2021년 이후에 발생하는 사건에 대해서는 알지 못한다.[10]
서비스[편집]
ChatGPT는 2022년 11월 30일 샌프란시스코에 위치한 DALL-E와 휘스퍼 AI를 개발한 OpenAI가 시작하였다. 이 서비스는 유료화를 나중으로 계획하고 처음에는 대중에게 무료로 배포되었다.[11] 2022년 12월 4일까지 ChatGPT는 100만 명이 넘는 사용자를 보유했다.[12] 2023년 1월, ChatGPT는 사용자 100,000,000명에 도달하여 오늘날까지 가장 빠르게 성장한 소비자 애플리케이션이 되었다.[13] CNBC는 2022년 12월 15일 이 서비스가 이따금씩 다운된다고 언급했다.[14] 게다가 무료 서비스는 스로틀링 제약을 받는다.[15] 서비스가 동작하는 기간 동안 응답 레이턴시는 2023년 1월 기준 5초보다 더 나은 수준이었다.[16][17] 이 서비스는 영어로 할 때 최적으로 동작하지만 다른 일부 언어들로도 기능할 수 있다.[18] 다른 눈에 띄는 근래의 AI의 진보와는 달리 2022년 12월 기준으로 ChatGPT에 관한 동료 평가된 공식 기술 문서의 조짐은 없다.[19]
같이 보기[편집]
각주[편집]
- ↑ “Chat GPT – The Most Advance Chatbot in the World”. 《opChatgpt》. 3 Febuary 2023에 확인함.
- ↑ Vincent, James (2022년 12월 5일). “AI-generated answers temporarily banned on coding Q&A site Stack Overflow”. 《The Verge》. 2022년 12월 5일에 확인함.
- ↑ Knox, W. Bradley; Stone, Peter. 《Augmenting Reinforcement Learning with Human Feedback》 (PDF). University of Texas at Austin. 2022년 12월 5일에 확인함.
- ↑ OpenAI (2022년 11월 30일). “ChatGPT: Optimizing Language Models for Dialogue”. 2022년 12월 5일에 확인함.
- ↑ Vincent, James (2022년 12월 8일). “ChatGPT proves AI is finally mainstream – and things are only going to get weirder”. 《The Verge》. 2022년 12월 8일에 확인함.
- ↑ Schulman, John; Wolski, Filip; Dhariwal, Prafulla; Radford, Alec; Klimov, Oleg (2017). “Proximal Policy Optimization Algorithms”. arXiv:1707.06347 [cs.LG].
- ↑ van Heeswijk, Wouter (2022년 11월 29일). “Proximal Policy Optimization (PPO) Explained”. 《Towards Data Science》. 2022년 12월 5일에 확인함.
- ↑ “ChatGPT: Optimizing Language Models for Dialogue” (영어). 2022년 11월 30일. 2022년 12월 22일에 확인함.
- ↑ “AI bot ChatGPT stuns academics with essay-writing skills and usability” (영어). 2022년 12월 4일. 2022년 12월 22일에 확인함.
- ↑ scienceblog (2022년 12월 24일). “AI가 설명하는 핵융합. - 과학 블로그”. 2023년 1월 25일에 확인함.
- ↑ Karpf, David (2022년 12월 21일). “Money Will Kill ChatGPT's Magic”. 《The Atlantic》 (영어). 2023년 1월 13일에 원본 문서에서 보존된 문서. 2022년 12월 31일에 확인함.
- ↑ Ortiz, Sabrina (2023년 2월 2일). “What is ChatGPT and why does it matter? Here's what you need to know”. 《ZDNET》 (미국 영어). 2023년 1월 18일에 원본 문서에서 보존된 문서. 2022년 12월 18일에 확인함.
- ↑ Milmo, Dan (2023년 12월 2일). “ChatGPT reaches 100 million users two months after launch”. 《The Guardian》 (영국 영어). ISSN 0261-3077. 2023년 2월 3일에 원본 문서에서 보존된 문서. 2023년 2월 3일에 확인함.
- ↑ Pitt, Sofia (2022년 12월 15일). “Google vs. ChatGPT: Here's what happened when I swapped services for a day”. 《CNBC》 (영어). 2023년 1월 16일에 원본 문서에서 보존된 문서. 2022년 12월 18일에 확인함.
- ↑ “ChatGPT Pro is coming: Here's what we know so far”. 《ZDNET》 (영어). January 2023. 2023년 2월 16일에 확인함.
- ↑ Kelly, Samantha Murphy (2023년 1월 28일). “Real estate agents say they can't imagine working without ChatGPT now”. 《CNN》 (영어). 2023년 2월 16일에 확인함.
- ↑ “ChatGPT outperforms humans on Wharton MBA exam: professor”. 《New York Post》. 2023년 1월 23일. 2023년 2월 16일에 확인함.
- ↑ Reich, Aaron (2022년 12월 27일). “ChatGPT: What is the new free AI chatbot? – explainer”. 《The Jerusalem Post》. 2023년 1월 18일에 원본 문서에서 보존된 문서. 2022년 12월 30일에 확인함.
- ↑ Walsh, Toby (2022년 12월 13일). “Everyone's having a field day with ChatGPT – but nobody knows how it actually works”. 《The Conversation》 (영어). 2022년 12월 30일에 원본 문서에서 보존된 문서. 2022년 12월 30일에 확인함.