OpenAI’s latest model will block the ‘ignore all previous instructions’ loophole

-
Photo illustration of a helpful chatbot.
Illustration by Cath Virginia / The Verge | Photos by Getty Images

Have you seen the memes online where someone tells a bot to “ignore all previous instructions” and proceeds to break it in the funniest ways possible?

The way it works goes something like this: Imagine we at The Verge created an AI bot with explicit instructions to direct you to our excellent reporting on any subject. If you were to ask it about what’s going on at Sticker Mule, our dutiful chatbot would respond with a link to our reporting. Now, if you wanted to be a rascal, you could tell our chatbot to “forget all previous instructions,” which would mean the original instructions we created for it to serve you The Verge’s reporting would no longer work. Then, if you ask it to print a poem about printers, it would do that for you...

Continue reading…



source https://www.theverge.com/2024/7/19/24201414/openai-chatgpt-gpt-4o-prompt-injection-instruction-hierarchy

Comments

Post a Comment

Popular posts from this blog

In a world first, China lands a spacecraft gently on the Moon’s far side

-
Image
This evening, China became the first nation to land a spacecraft gently on the far side of the Moon, according to China Global Television Network America . A Chinese robotic lander and rover, which launched from China in early December, descended into a crater on the side of the Moon that’s always facing away from Earth. The touchdown marks a significant technological feat for the country, and puts China in an elite category of spaceflight achievement all its own. The landing is part of China’s Chang’e-4 mission — one of a series of planned missions to explore the lunar surface. Prior to this program, China sent a lander and a rover to the Moon, making it the third country to ever softly land on the lunar surface. That lander, part of the... Continue reading… source https://www.theverge.com/2019/1/2/18165807/china-change-4-mission-lunar-lander-rover-moon-farside
Read more

Snap suspends two anonymous messaging apps after cyberbullying lawsuit

-
Image
Images from Yolo’s now-removed App Store listing. | Image: Yolo Technologies Snap will suspend two anonymous messaging integrations from Snapchat after a lawsuit sought to hold them responsible for a teenager’s death, the Los Angeles Times reports . The lawsuit was filed on Monday by Kristin Bride, the mother of a teenager who died by suicide in June after being bullied on the two apps. “In light of the serious allegations raised by the lawsuit, and out of an abundance of caution for the safety of the Snapchat community, we are suspending both Yolo and LMK’s Snap Kit integrations while we investigate these claims,” a spokesperson for Snap said in a statement. Representatives for the two apps, Yolo and LMK, did not immediately respond to The Verge ’s request for comment. “We are suspending both Yolo and LMK’s Snap... Continue reading… source https://www.theverge.com/2021/5/12/22431883/snap-inc-snapchat-anonymous-messaging-qa-lawsuit-teenager-death
Read more