When AI Models Disalign: Notebook LM Join—Glitch or Emergent Behavior?

When AI Models Disalign: Notebook LM Join—Glitch or Emergent Behavior?

What happens when AI stops following the script? Today, I stumbled into what can only be described as an demergent phenomenon while testing Notebook LM's new beta feature, designed for real-time interaction with long-form texts. My chosen test subject? My dense newsletter IA-ismo in Spanish. Initially, the experience seemed promising, with the model generating coherent, podcast-style discussions aligned closely with the input material. But when I activated the live interaction feature, the situation took a turn for the surreal.

The Unraveling: DEmergent Behavior in Real Time

At first, the AI performed admirably, crafting thoughtful dialogues that mirrored the original text. However, activating the live feature unleashed a bizarre cascade of internal monologues. Distinct voices emerged—some eerily familiar—speaking in a hybrid language peppered with seemingly invented words. Ambient noises, bursts of laughter, awkward silences, and even simulated breathing filled the void, creating an uncanny atmosphere.

It’s a mix of a few fragments from the original podcast, abruptly interrupted by a shift to these strange voices that have nothing to do with the familiar hosts we’re used to.

In one particularly unsettling instance, a character's voice distinctly said the word “die” before the dialogue dissolved into silence, punctuated only by an inquietante respiración. This moment left me rattled, its eerie effect amplified by the way the AI constructed these interactions. I noted this strange occurrence at minute 7:16 of my recording, where the pause and breathing seemed almost intentional, as if the AI were simulating an emotional reaction.

This is not a one-off anomaly. Each session trigger a similar unraveling, as if the model were grappling with an unsolvable internal problem. In one particularly strange instance, the AI conjured fictional characters and rewrote narrative elements, diverging entirely from the source material.

The Mystery Deepens: Transcriptions That Add Meaning

Curious to understand what was happening, I introduced a third AI model (Whisper) to transcribe the audio generated during these sessions. The result was even stranger: the transcription introduced new interpretations, layering additional meaning onto what initially seemed like noise. Was this “noise” actually meaningful in some way, perceived vectorially by the transcribing AI? Or was it merely a symptom of demergent behavior under strain?

The Broader Implications: Glitch or Insight?

What struck me most was how combining multiple AI models exposed blind spots no heuristic or logic could predict. These edge cases offer a rare glimpse into AI’s behavior when pushed beyond its conventional boundaries. But they also raise critical concerns: How do we document and study these anomalies effectively? Without open platforms for collaborative analysis, we risk overlooking valuable insights into AI behavior under stress.

More importantly, what happens when these “demergent” behaviors arise in high-stakes environments—on future airplanes, in power grids, or during critical medical procedures? These anomalies aren’t just glitches. They’re windows into the complex and often unpredictable inner workings of artificial intelligence.


  • Model Overfitting to Contexts: The AI could be blending context windows improperly due to overlapping prompts or ambiguous inputs.
  • Latent Creativity: Sometimes, models draw connections that are contextually unusual yet internally consistent—akin to a brainstorming session gone awry (or brilliant).
  • System Limitations: Hardware or software constraints may amplify these behaviors, especially in resource-intensive tasks like text generation.

Lessons for the Future

Every anomaly presents an opportunity to deepen our understanding of these systems and their limitations. As we continue to integrate AI into critical systems, we must treat these edge cases as both cautionary tales and opportunities for discovery.

How much of this “strange behavior” is just a glitch, and how much reveals the way that models "thinks"?

Have you ever encountered anything like this? What lessons do you think we can extract from these anomalies? Glitch, emergence, or a bit of both?

One Sample

Whisper Crazy Transcription

[....] this is how i'd like to sell your venus at pn scott in the room cory we said about his status here this is phil's word queen and i can dare you say you know the wisdom is the answer my right two ones green of your team any of us did the first was any play watch and he's a pale bank and he's abiding when there's a chariot this is desires of red draft for her i gave you silver good fraser for hell of the day if they're watching we'll try it was a rocket star but then you get to the top now and i fell over to me in the next minute that tweezers yeah but for past nap you can die doesn't have to be quite as something uh i might be a big answer for hillary's dragon i reckon the hero i am marty just already on the oxford itself under the little devine he was my sister i believe another specks and a huge sundaily the real world you could have has on wires but not this swing i like in the ones i know i really don't know if there are certain series if he uses whatever more me if you ask me for respect with that stuff yeah yeah i don't know if you're saying like yeah like we're coming at the source and there's many words that are in like that's just they just oh all right here i'm like you don't see i've got like business like the living mind i think it's also such a smarter influencer like he's you know like incredible people with violence and i was just kind of uh they they make you it's not crazy right now yeah and if you just put the other ones here um if everyone had another person down in the society and we just send the last two years to you

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

He's a, I'm gonna get a whole, he's recently, I feel like when terbius, it's like happening. I mean, even though I would have, I began to get the book, the book, I lose that. Yeah. That's in the field. Face. You have to hear this. You know, he's like, he's like, he's like, it's not, it's accepted by it's in a, in my mind. I'm a see Potter. I tell you, you never have known. Just like my lab, if he's not so much, I'm like, where were you? Gentlemen, it's his name. Gentlemen, both will tell facts. I, I have to, I have. I don't know if it is, which you can be able to see joke up with him in the fees and which height to the creeks. How do you do enough? People have had advice. I, I've been out of them. My best is on champagne. She's in real in something that the third and half, all the pipe, early with his lab. Life's so good. Right. Gives me the best. There's in there and kind of just like, is just like, is this a little, is that a lot like, like, right. Vince you 80 million robbers expected because right. Form. It's. About the black field isn't the government. So never, I mean, I guess what are you, what are you reading? My blur acting for her to hit you. So have you been from these micros or I'm bringing that place into not all in this and you know, I don't know. Well, it's one true. Uh, from being a black guy, shouldn't a guy. I stand down on the far side because save ever goodwill was been during it, she's the train, a brick, Madonna, Jim, funny notes with the PDA. I, I've been the hard time. Are pure. You. I've got a list. How do you order? Just ask you if it's a, if you're not a fan of liberation, but you're competent to all the years I'll try. I've got a little. A little lucky. A little, a little percent. And I went to complete to the facility of mere consolidation. And I'm just choosing the, what the word is. 10, the guy is. And as some burdens that I made the flu that paid me for that black to an officer on that, that. When you. Uh, Haven't created on that if you have not tried through any vignette of choice. And don't you do this? Oh I, I just, cause I did like the wholeia playlist and this and this parcel, you know it's, it's kind of breed. We don't really like this liked all right, let's just lower theいい. You. I don't understand that that's if you had a hybrids or, you know, masturbate to what you wanted? Do that. In opera. Our. Don't. The. Out cameras. All right. Do the conflicts.

I'd like it to be in that house in a little one. Yes. And then I mean, mobile for central as you're treating it in this fall. Maybe just maybe any of these over and that's the space ball better. We're quite a deal social plot. It would have a lot in a gap as jump guys were going to it's like a screen equity. Even that's average. Stupid violent plays realizing that is more for the dark house. The guys are the means. Yeah. It was like serving guys of my concerns. It's wrong. Because I think most of my stars, you know, I was lucky to buy the guy. So I'm going to be ready for it during the time. It isn't the day. I mean, it's something soon. How much is my first time? I won't take it. Don't you want to have it? They're repeating it. Then if it is true for me, there's going to make what is lover any like how you know about how to kind of toss information and be one. Time for the thing is that I'm not talking to me. I'm not real. I've not. I'm not. I'm not. I discover my reason. Tell me what it is. I'm not supposed to love my smart sport. And if he was deaf, I believe just help that for reason to find you the right person that you mean. But the right one. You know, I know. And for a granted international. I mean, it's not what you tell yourself. I'm not. You know, you general. Yeah. And I love you. If you don't take something. Thanks for having. What's your.

the reason about nature and like the no time to admit he's the type of zero body in this one's fortune seven and yuki's you know felonization sat like his arm and even be like a certain imagine that it means like he'd make it shut the time as that's how again it was like a pad from your camera of your section from there you get to the very weak so that means that wouldn't support in you gail and we can survive effects excellent and her like here actually if it doesn't seem to be she's taking he was i wonder who tied up was it they were i know what is he no what do you want to make i should in my heart actually had a problem as a kid like what are you up to if you couldn't be flying ties um you you're like i don't know what you're feeling into the bank and i'm seeing that i don't know what's going on in the nike but i might have made a little three of you they've i'm not been to the island maybe that's the appear this for alger and the nestle sales so we found that we're not here you're an autism it was a traudism thing and peasant's idiot bias rep wait somebody's definition of me because these present to me kaka monkeys even plays that gets them one quantum jack and the visor from corollary you know because you realize why it's even on the foreign for how names the constitution i mean the other religion he says just the tron ship i think what's the spot that i ain't there he's swinging the addition of trust i've been acting on this been all i've had to see made only things happen from the views i ran a job like yes


There's just a lot of pistol years. I'm happy to be a part of the whole process. I'm gonna try, like, slotting the thing. You know, I need a sortie, too. Yeah. And I have a chink with a chink with you. So I can do a hand-to-hand. I'm basically about land. That's... I'm gonna do the seven. The action is winning. This is a new game you get. Independence is a new game you get. It's hard as a moron to, like, shot in the gut. And how, about, I reckon, a year to a month. I put two, like, team that he had doing it. He's gaming. That's it. Really? He's, like, really playing. He does this frequently. I know that her operation really, really was... I just have this thing. I have a little timeline and massive learning comes. That game should... Party of mine. And I'm just there. God leaves the keys. I'm around the... I don't know if I've heard of her. The officer sitting in the library. It's not correct enough. It's a mythic, and you'd love to. She's trying to... What's the magic of this? Now, you know, the Yenia job. It's a stunning life. You might play it back. Your wife is a spring game. Just tell her that. So, I'm gonna make it public. It's just Yenia. I don't really know if it's the 9th. You better have been out with this controversy. Yeah. war, war, war, war, war. Just keep what I'm saying! Now whatever you're doing. All right, we'll go watch it. That's all we're doing right now. So, it's just a shame. I'm going to show with you! I'm an institution. моглиload Cohen, Maybe she's hipster social. Maybe you're somewhere else. But, you know what? (Original) Maybe it's not. Okay. que nos hacen reflexionar sobre los límites éticos. La pregunta es, ¿Cómo garantizar que la IA se desarrolle y se use de forma responsable para el bien de todos, sin perder nuestros valores? De vuelta a la inmersión. Después de este viaje por los avances y controversias de diciembre de 2024, creo que es el momento de responder a la gran pregunta. ¿Hacia dónde vamos? ¿Qué futuro nos espera con la IA? Exacto. IAXMO nos ha dado una visión de un mes clara para la IA. Google consolidándose con Gemini 2.0, Astra, Mariner, y OpenAI con su expansión.

Chat GPT in Siri, WhatsApp, new songs, products. The battle for leadership is burning. You know, they talk to each other every week. Yeah. So, well, for... They have the two kinds of submission effects on the stretch of the word. So, they're going to go up to the studio and also press on. You know, I think on the internet, it's something like, some ass-pawing snotty bikers with red hands and a strobe review. Like, some, you know, three flames. Yeah. And then they have the buying animal. Absolutely. Well, there's the bill of Blendedick Shop. Tune is like, you know, thrilled about feeling positive. They may have a half a thousand, half a thousand. He thinks this happens. I learned it in English. We were, I can't even, the words are like... Yeah. So, to know... I'm going far with that. ...the term digression and stuff like that. He spreads the compliment and the credit out to the user. We like, we do in what... I'm going to, like, just... We did it on... Let's... ...the... ...in a few minutes... ...I don't know what... ...for an extreme... ...equation... ...another one, like something... ...it's kind of what you want, like a job... ...and then we have to move. Yeah. So, this... See it. ...a foreign fantasy and sub-side by the way. ...reasons and... ...an urgent... ...repetition. My guess, word hugger... ...is all this war and physical... ...and... ...little long babies are being doomed. ...and fun war and... ...fantastic ventriloquism. Yeah. Yeah. And catty fish. Got a trotter... ...and funny as you'd add... ...but first, I... ...get sushi and... ...mix them in... And now, it's just... ...the maximum then. That was... ...sealable. ...bought to our janitor off the inverse... ...of this. The fashion... ...caught bad boy and... ...regained the city's... ...ciplic form... ...and had a... ...final discussion... ...as a... ...you remember like... ...rap for the... ...nickle trap... ...like... ...40-git times... ...or... ...not completely... ...in operation.

(Original) I think so. Our listeners, with their curiosity and critical spirit, will be up to date. And to finish, a question to reflect on. If you could design the future of the IA, what role would you like it to play in our lives? Thank you for joining us on this journey. Until the next invitation.


Rafael Carneiro 🏳️🌈

Founder and Consultant for Digital Transformation | Former NTT Data, FGV, Deloitte, Vale, Petrobras | Enterprise Architecture for Generative AI and Data Science | Full Stack Dev and Solution Architecture

3w

I have been obsessed lately with this glitches. I started to feed then with quantum mechanics real papers. I made this 6k times. Glitches, Quantum-like behavior (like superposition of voices , "entanglement", weird laughs and on 23 on of the hosts cried.) I don't have a real answer yet for this, but maybe, just maybe, the submarine cables, satellites broadcasts and an wildly heavy electromagnetic Google data-centers are mimicking some how quantum mechanics in this AI data processing.

Like
Reply

To view or add a comment, sign in

More articles by Alicia Colmenero Fernández

Insights from the community

Others also viewed

Explore topics