Tag: tool
OpenAI’s New Tool Attempts To Explain Language Models’ Behaviors
To that end, OpenAI’s tool uses a language model (ironically) to figure out the functions of the components of other, architecturally simpler LLMs — specifically OpenAI’s own GPT-2. How? First, a quick explainer on LLMs for background. Like the brain, they’re made up of “neurons,” which observe some specific pattern in text to influence what the overall model “says” next. For example, given a prompt about superheros (e.g. “Which superheros have the most useful superpowers?”), a “Marvel superhero neuron” might boost the probability the model names specific superheroes from Marvel movies. OpenAI’s tool exploits this setup to break models down into their individual pieces. First, the tool runs text sequences through the model being evaluated and waits for cases where a particular neuron “activates” frequently. Next, it “shows” GPT-4, OpenAI’s latest text-generating AI model, these highly active neurons and has GPT-4 generate an explanation. To determine how accurate the explanation is, the tool provides GPT-4 with text sequences and has it predict, or simulate, how the neuron would behave. In then compares the behavior of the simulated neuron with the behavior of the actual neuron.
“Using this methodology, we can basically, for every single neuron, come up with some kind of preliminary natural language explanation for what it’s doing and also have a score for how how well that explanation matches the actual behavior,” Jeff Wu, who leads the scalable alignment team at OpenAI, said. “We’re using GPT-4 as part of the process to produce explanations of what a neuron is looking for and then score how well those explanations match the reality of what it’s doing.” The researchers were able to generate explanations for all 307,200 neurons in GPT-2, which they compiled in a dataset that’s been released alongside the tool code. “Most of the explanations score quite poorly or don’t explain that much of the behavior of the actual neuron,” Wu said. “A lot of the neurons, for example, are active in a way where it’s very hard to tell what’s going on — like they activate on five or six different things, but there’s no discernible pattern. Sometimes there is a discernible pattern, but GPT-4 is unable to find it.”
“We hope that this will open up a promising avenue to address interpretability in an automated way that others can build on and contribute to,” Wu said. “The hope is that we really actually have good explanations of not just what neurons are responding to but overall, the behavior of these models — what kinds of circuits they’re computing and how certain neurons affect other neurons.”
Read more of this story at Slashdot.
FBI Says It Has Sabotaged Hacking Tool Created By Elite Russian Spies
“We assess this as being their premier espionage tool,” one of the U.S. officials told journalists ahead of the release. He said Washington hoped the operation would “eradicate it from the virtual battlefield.” The official said the FSB spies behind the malware, known as Snake, are part of a notorious hacking group tracked by the private sector and known as “Turla.” The group has been active for two decades against a variety of NATO-aligned targets, U.S. government agencies and technology companies, a senior FBI official said.
Read more of this story at Slashdot.
SoundCloud unveils new direct-to-fan messaging tool
This reusable smart notebook is a visual learner’s dream tool
Windows 11 Photos app adds a spot fix tool, slideshows and more
Starting with the new slideshow experience, Microsoft says it was one of the most requested features from Windows 11 users since the Photos app was launched last year. It will enable users to create slideshows with transition effects, animations, and 25 original music soundtracks that users will be able to…
The New Free-To-Use Tool For Creating Instant Paranormal Teams Pages
This $60 tool essentially gives you another pair of hands
Microsoft makes its AI-powered Designer tool available in preview
Today, Microsoft Designer, Microsoft’s AI-powered design tool, launched in public preview with an expanded set of features. Announced in October, Designer is a Canva-like web app that can generate designs for presentations, posters, digital postcards, invitations, graphics and more to share on social media and other channels. It leverages user-created content and DALL-E 2, OpenAI’s […]
Microsoft makes its AI-powered Designer tool available in preview by Kyle Wiggers originally published on TechCrunch
This Eye Massager is the ultimate spa tool — Future Blink
Enjoy a spa-like treatment from the comfort of your couch. Renpho The Eyeris 1 Eye Massager is the ultimate spa tool to relieve eye strain, puffiness, and dry eyes. Pull this futuristic goggle contraption over your eyes and relax. Promoting blood circulation and relieving eye fatigue this device has built-in compression bags and heating pads. Use bluetooth to connect to your phone and listen to your favorite tunes while you relax after a long day.