AI’s Dirty Little Secret: Stanford Researchers Expose Flaws in Text Detectors

Malaysia News News

AI’s Dirty Little Secret: Stanford Researchers Expose Flaws in Text Detectors
Malaysia Latest News,Malaysia Headlines
  • 📰 SciTechDaily1
  • ⏱ Reading Time:
  • 57 sec. here
  • 2 min. at publisher
  • 📊 Quality Score:
  • News: 26%
  • Publisher: 68%

In a study recently published in the journal Patterns, researchers demonstrate that computer algorithms often used to identify AI-generated text frequently falsely label articles written by non-native language speakers as being created by artificial intelligence. The researchers warn that the unreli

Researchers have found that GPT detectors, used to identify if text is AI-generated, often falsely label articles written by non-native English speakers as AI-created. This unreliability poses risks in academic and professional settings, including job applications and student assignments., researchers demonstrate that computer algorithms often used to identify AI-generated text frequently falsely label articles written by non-native language speakers as being created by artificial intelligence.

AI tools like OpenAI’s ChatGPT chatbot can compose essays, solve science and math problems, and produce computer code. Educators across the U.S. are increasingly concerned about the use of AI in students’ work and many of them have started using GPT detectors to screen students’ assignments. These detectors are platforms that claim to be able to identify if the text is generated by AI, but their reliability and effectiveness remain untested.

Zou explains that the algorithms of these detectors work by evaluating text perplexity, which is how surprising the word choice is in an essay. “If you use common English words, the detectors will give a low perplexity score, meaning my essay is likely to be flagged as AI-generated. If you use complex and fancier words, then it’s more likely to be classified as human written by the algorithms,” he says.

The team then put the human-written TOEFL essays into ChatGPT and prompted it to edit the text using more sophisticated language, including substituting simple words with complex vocabulary. The GPT detectors tagged these AI-edited essays as human-written.

We have summarized this news so that you can read it quickly. If you are interested in the news, you can read the full text here. Read more:

SciTechDaily1 /  🏆 84. in US

Malaysia Latest News, Malaysia Headlines

Similar News:You can also read news stories similar to this one that we have collected from other news sources.

Utah-based Swig is bringing its 'dirty' sodas to 250 more stores in 7 new statesUtah-based Swig is bringing its 'dirty' sodas to 250 more stores in 7 new statesSwig, Utah's largest soda shop, is expanding, announcing the successful signing of 250 franchise units across seven new states.
Read more »

Utah-based Swig is bringing its 'dirty' sodas to 7 new statesUtah-based Swig is bringing its 'dirty' sodas to 7 new statesSwig, Utah's largest soda shop, is expanding, announcing the successful signing of 250 franchise units across seven new states.
Read more »

Hurricane Idalia forces Biden and Ron DeSantis to get along — at least a little bitHurricane Idalia forces Biden and Ron DeSantis to get along — at least a little bitPoliticians' handling of natural disasters — including their willingness to work with their opponents — can stick with them for years.
Read more »

Mary Ann Little Ph.D.Mary Ann Little Ph.D.Mary Ann Little, Ph.D., a clinical psychologist and adjunct professor at the University of Texas Southwestern Medical Center at Dallas, is the author of Childhood Narcissism: Strategies to Raise Unselfish, Unentitled, and Empathetic Children.
Read more »

30 Products So Unique They’re Worth A Little Extra Splurge30 Products So Unique They’re Worth A Little Extra SplurgeThese cocktail cubes and this levitating plant pot are chanting 'treat yourself, treat 👏 your 👏 self 👏.'
Read more »



Render Time: 2025-02-27 09:45:33