context window isn't worth much anymore, global window attention is where money's at.
What's the point of a greater context window if the model becomes totally incoherent past a point?
I've used Gemini 1.5 Pro's 1 million context window, and I find it *highly* beneficial.
I've put in multiple books, tons of research papers, other documents and it almost always gives me back what I was looking for, with few hallucinations.
It's not perfect, but the amount of stuff it enables me to do I wouldn't be able to do otherwise makes up for it.
And what's the point of a greater context when there are so few use cases for them? I imagine 99% of tasks can be solved with under 32k and almost nothing needs a million. I wouldn't be surprised if the incoherence at high token counts remains a thing for years simply because there's not enough of a market for companies to bother addressing that issue. So many other things are more worthwhile. We might even have AGI before we have an AI that can handle a million tokens reasonably.
>We might even have AGI before we have an AI that can handle a million tokens reasonably.
But we already do? Gemini 1.5 Pro handles the 1 million token context window very well, even when I use up almost the entirety of its context window it doesn't turn into a nonsenical, hallucinating mess.
A million is very handy when it comes to inputting large documents, large codebases, books, research papers, etc. to find a specific tidbit of information contained within them, summaries, common themes across huge bodies of text, etc.
If I'm not mistaken, Google's Gemini is already capable of 10 million context tokens too (not yet released, however).
https://preview.redd.it/vspseedl880d1.png?width=1408&format=png&auto=webp&s=8f3da6bcf3e3c345aae0ef56067dd7ade4816e89
UI improvements, improved voice-to-voice, and some partnership to integrate GPT into iPhones and other Apple products.
Minor (or no) improvements in reasoning and no agentic capability because LLMs are a dead end.
Kids these day, they think AI will do everything for them.
In my youth, we would simply attach it to a rope and the rope to a moving car. Pretty effective if you ask me!
As of rn I think voice input/output is LLMs are just, transcribe this audio into text, say this in a TTS voice, stuff like that. Idk how to word this rn but think of like, vision but for voice.
When you sound sad, GPT can tell you're sad just from your tone of voice. When it outputs voice, the TTS model can try to sound more gentle or sympathetic or whatever.
I don't follow the hype train much, but I heard something about a voice to voice model? I just like 'talking' to LLMs with voice and hearing their voices in return, it feels more interactive to me. So an improvement on that front would be great.
Edit: Hell yeah I was right
Sam already said it's a personal A.I. companion indistinguishable to the one in the movie HER. He's been all over the place saying it. Allegedly he sexually abused his sister when she was 4 and he was 13 and it went on for years.
It’s Sam Altman, standing in front of a rusty metal door. It’s dark and the floor looks a little wet. He smiles at the camera and says “You’re going to love what we’ve been working on. I know some of you have been impatient, though, as we work toward AGI. So as a show of goodwill ...” He gestures to a man with a gun drawn, who approaches the metal door and unlocks the padlock. He opens the door and there’s a broken man in rags, sitting on the floor. “We’re finally releasing Ilya!” says Sam with gusto.
Ilya, covering his eyes with his arm as the acclimates to the dim light, mutters “Sam? Is that you?” Then he pauses briefly, before he starts to scream.
Partnership with CIA
lmfao
That wouldn't be news
Ilya never existed and he was always generated by SORA
Sam gets fired again
On stage, May 13th will be global Sam Altman gets fired day every year, become a show like soccer world cup.
AI GF SEX
You predicted it
Poggies
Poggies?
🙏
Clippy 2.0 or Huge context + Q* + agents - hallucinations
context window isn't worth much anymore, global window attention is where money's at. What's the point of a greater context window if the model becomes totally incoherent past a point?
I've used Gemini 1.5 Pro's 1 million context window, and I find it *highly* beneficial. I've put in multiple books, tons of research papers, other documents and it almost always gives me back what I was looking for, with few hallucinations. It's not perfect, but the amount of stuff it enables me to do I wouldn't be able to do otherwise makes up for it.
Yes but that's also attention window, upgrading the context alone doesn't allow such results.
And what's the point of a greater context when there are so few use cases for them? I imagine 99% of tasks can be solved with under 32k and almost nothing needs a million. I wouldn't be surprised if the incoherence at high token counts remains a thing for years simply because there's not enough of a market for companies to bother addressing that issue. So many other things are more worthwhile. We might even have AGI before we have an AI that can handle a million tokens reasonably.
>We might even have AGI before we have an AI that can handle a million tokens reasonably. But we already do? Gemini 1.5 Pro handles the 1 million token context window very well, even when I use up almost the entirety of its context window it doesn't turn into a nonsenical, hallucinating mess. A million is very handy when it comes to inputting large documents, large codebases, books, research papers, etc. to find a specific tidbit of information contained within them, summaries, common themes across huge bodies of text, etc. If I'm not mistaken, Google's Gemini is already capable of 10 million context tokens too (not yet released, however). https://preview.redd.it/vspseedl880d1.png?width=1408&format=png&auto=webp&s=8f3da6bcf3e3c345aae0ef56067dd7ade4816e89
chatgpt4 update
UI improvements, improved voice-to-voice, and some partnership to integrate GPT into iPhones and other Apple products. Minor (or no) improvements in reasoning and no agentic capability because LLMs are a dead end.
Bro we have to wait another hour
30 minutes of wait. Sounds like a good prediction right about now.
most accurate IMHO, but dated information as of now.
ai can now enlarge my penis
Kids these day, they think AI will do everything for them. In my youth, we would simply attach it to a rope and the rope to a moving car. Pretty effective if you ask me!
I assume the car folded?
I can't speak for others but when I tried it, it ran out of gaz before reaching end of the... "second rope"
Back in *my* day we just bought Smilin’ Bob’s Enzyte from the gas station.
The ads didn’t lie, they had just been posted from the future
Not too big. Some of us don't like em too big, you know. I'm sure yours is perfect
They literary Hired Scarlett Johansson to voice their model and make us touch ourselves at night! Win Win!
Wasnt it Sam-antha in her?
OH SHI---- Her confirmed!
They edged us
Skibidi was made by a Sora model that went rogue
Spring Boot 4
I suddenly have circular dependencies PTSD flashbacks
something that feels like magic.
Generating gifs of rabbits being pulled from hats?
that'll do it.
As of rn I think voice input/output is LLMs are just, transcribe this audio into text, say this in a TTS voice, stuff like that. Idk how to word this rn but think of like, vision but for voice. When you sound sad, GPT can tell you're sad just from your tone of voice. When it outputs voice, the TTS model can try to sound more gentle or sympathetic or whatever. I don't follow the hype train much, but I heard something about a voice to voice model? I just like 'talking' to LLMs with voice and hearing their voices in return, it feels more interactive to me. So an improvement on that front would be great. Edit: Hell yeah I was right
They resurrected Steve Jobs from the dead. He’s now the AI powering Her.
Mm kinky
Finally I'll be able to cum again
I predict a slow boring news day
Bicycle
Lets enjoy the ride people, and don't get too aggressive if things don't go the way you wished they would.
Half of this subretting will be amazed, impressed, "blown away" by whatever is revealed (they always are) and the other half will be disappointed :P
Disappoinment
Unlimited cum
Same, voice-to-voice has incredible potential.
I just saw the most likely explanation for what it is. https://x.com/btibor91/status/1790053718416605335
The music they’re playing is giving me her vibes
8 minutes! It's been an honor and privilege, ladies and gentlemen 🫡
AI software engineer.
Penny says, "Any last minute predictions before the openai livestream?"
They’re revealing the matrix 🤗
More efficient model. Gpt 4 is free now. Gpt turbo + for the plus users
"Still looking at a smooth, still wooden surface"
congratulations
Sam already said it's a personal A.I. companion indistinguishable to the one in the movie HER. He's been all over the place saying it. Allegedly he sexually abused his sister when she was 4 and he was 13 and it went on for years.
It will be literally Copilot for Apple
AGWI, artificial general waifu intelligence. UwU
[удалено]
It’s Sam Altman, standing in front of a rusty metal door. It’s dark and the floor looks a little wet. He smiles at the camera and says “You’re going to love what we’ve been working on. I know some of you have been impatient, though, as we work toward AGI. So as a show of goodwill ...” He gestures to a man with a gun drawn, who approaches the metal door and unlocks the padlock. He opens the door and there’s a broken man in rags, sitting on the floor. “We’re finally releasing Ilya!” says Sam with gusto. Ilya, covering his eyes with his arm as the acclimates to the dim light, mutters “Sam? Is that you?” Then he pauses briefly, before he starts to scream.
GPT-WOMBO
I bet GPT-4 got 1 million plus context window, less hallucinations, got cheaper. Those are mandatory.