Weeknotes 297 - AI emotional lock-in strategies
What happens when people really attach to their AI buddy? My first experiences with an orange rabbit and other notions are from last week's news.
![Weeknotes 297 - AI emotional lock-in strategies](/content/images/size/w1200/2024/07/297-iskandersmit_prompting_code_for_emotional_lock-in_0b3669da-46f7-44b5-a2d6-14d31c171788.png)
Hi, y’all! The EU championship is over. To be honest, I am not a big follower, but I know who has won. I noticed the turmoil of discussing the role of VAR in negatively influencing the game. I was thinking: Is this also part of our different relationship with reality? Do we trust analog thinking when we can access exact digital referees? Or are these kinds of applications the fuel for a backlash?
In the meantime, I received the latest gadget I ordered–a rare occasion in the last few years. Maybe I got tired of all the gadgets I got in the last decade, or the newness is not so distinctive anymore. Anyhow, Rabbit R1 has arrived, and I was able to test some of its features in between running activities…
Two short observations -apart from all earlier reviews on the complex interaction especially navigating through the menus and the underwhelming applications that are available. Not so much even apps, because they promised a different model of use: the LAM, action-based modeling.
On the positive side, I can imagine that the translator function can work in a social context with multiple people around the table. The push-to-talk drives a more structured conversation and less confusion for the AI than if it was just there lying in between a conversation.
Rather disappointing was the lack of contextual intelligence, especially in the spatial sense. I took a picture of a building in Amsterdam, and it referenced it to Rotterdam as it looks more like a typical high rise. That should be possible to do better. Even when I provided Rabbit with the situational context it still was not able to try to link the image to existing images of buildings, make that comparison, conclude what building and provide me with extra information.
I will keep trying; Maybe my prompts should be more specific. But with the right consciousness on anonymity.
Also, I would opt for a text-based interface, but hey, that is what the phone-based AIs promise, of course. Apple Intelligence is delayed, but I cannot imagine a better fulfillment of the functions than a phone for most of the use cases now.
Triggered thought
Listening to Poki podcast on AI (Dutch) where the Character.ai service was discussed. It has existed for a longer time already. Still, with the acceptance or adaptation of AI as a logical partner, we see that these new forms of artificial realities become real realities.
We not only use this kind of AI personality for reflection or fun but also start living together. And that living together is more than caring for a Tamagotchi. However, some of the same principles are at work; we like to dedicate human characteristics to things that feel and behave like humans. I am wondering if we would have relations with non-human-like but conversational-behaving things.
Before this happens, we will get used to more psychological conversational pals in our chats. This is of course already more than a decade-old idea, the service agents as conversational agents are as concept as old as the internet and even older. The execution and specifically the intuitive character and generative behavior, lowers the barrier and makes it more valuable. And we got more dependent on it, which was also addressed in the podcast in relation to the changes to the service of character.ai, when they toned down the intimate interactions. People find it much harder to let these types of tools go than if you lose a book in your digital library. So that gives a bigger lock-in effect and vulnerability for influencing.
It could become tricky when intelligent social companions feed conspiracy theories and even link people to opinions. Naming and shaming in the age of character bots is super dangerous for a polarized world. There might be a positive strategy, too; see the paper for this week below. Character.ai might need an “only fans” version…
For the subscribers or first-time readers (welcome!), thanks for joining! A short general intro: I am Iskander Smit, educated as an industrial design engineer, and have worked in digital technology all my life, with a particular interest in digital-physical interactions and a focus on human-tech intelligence co-performance. I like to (critically) explore the near future in the context of cities of things. And organising ThingsCon. I call Target_is_New my practice for making sense of unpredictable futures in human-AI partnerships. That is the lens I use to capture interesting news and share a paper every week.
Notions from the news
The New quantum record, the release of Apple’s public betas (without Apple Intelligence), these do not directly fit in the categories. KPIs for smart mobility policies? The rise of the AI ‘villains’. Or dominating intermediairs. Read below the usual new human-ai happenings, robotic performances and immersive connectness, and some more societal tech impact. Moments…
Human-AI partnerships
Humorous AI. Is the AI knowing how to time a joke, or is it in the eye of the beholder?
![](https://www.designboom.com/twitterimages/uploads/2024/07/keyword-karaoke-fabio-lattanzi-atinori-designboom-1200.jpg)
OpenAI is developing a scale to track progress towards human-like AI. The scale ranges from basic problem-solving to surpassing human abilities (as summarized by OpenAI).
![](https://cdn.vox-cdn.com/thumbor/R_qKUT4ouArFjS7OyDcddkfKk5o=/0x0:2040x1360/1200x628/filters:focal(1020x680:1021x681)/cdn.vox-cdn.com/uploads/chorus_asset/file/24390407/STK149_AI_02.jpg)
Not really AI but in order to build the right partnerships with ultrafast computing we need slow computing. Apparently
![](https://cdn.arstechnica.net/wp-content/uploads/2024/07/GettyImages-1743404844-760x380.jpg)
You would expect these tailored playlists were already common business…
![](https://cdn.vox-cdn.com/thumbor/1L6awTcXjbADLDMFfR9g1r5lzDc=/0x0:2040x1360/1200x628/filters:focal(1020x680:1021x681)/cdn.vox-cdn.com/uploads/chorus_asset/file/23986640/acastro_STK092_04.jpg)
Reputation is becoming such an important asset for this company…
![](https://cdn.vox-cdn.com/thumbor/BGiV0yH1fr1ml6eEI_3eQoyyx0g=/0x0:2040x1360/1200x628/filters:focal(1020x680:1021x681)/cdn.vox-cdn.com/uploads/chorus_asset/file/22512651/acastro_210512_1777_deepfake_0003.jpg)
Imitation intelligence; on my watch list…
![](https://static.simonwillison.net/static/2024/simonw-pycon-2024/simonw-pycon-2024.001.jpeg)
Robotic performances
It would be a great disappointment if this was not the case.
![](https://cdn.vox-cdn.com/thumbor/RtlkJOiatV6X1Ozr6ZjAMo2M-mY=/0x0:1600x1200/1200x628/filters:focal(800x600:801x601)/cdn.vox-cdn.com/uploads/chorus_asset/file/25526533/Google_deepmind_gemini_pro.png)
Not surprising maybe, the influence of partly supported is not making driving more dangerous. It might be perception too: is are you delegating control or adding a supportsystem?
![](https://cdn.arstechnica.net/wp-content/uploads/2024/07/Nissan-ProPILOT-Assist_03-source-760x380.jpg)
Is this the case? “Robotics is having its ChatGPT moment. New advances in AI allow robots to ‘understand’ and react to actions in real-time, which means they can take on more complex jobs”
![](https://www.therobotreport.com/wp-content/uploads/2024/07/standard-bots-featured.jpg)
Immersive connectedness
New technologies trigger new supporting services…
![](https://cdn.vox-cdn.com/thumbor/70PnauASPvqycC4mmzxcbzOkBFo=/0x0:3481x2320/1200x628/filters:focal(1741x1160:1742x1161)/cdn.vox-cdn.com/uploads/chorus_asset/file/25523153/247132_SMART_HOME_MOVE_JGibbs.jpg)
Arduino still going strong with new approaches. Somewhere in between Grove, Arduino One, and Little things.
![](https://cdn.arstechnica.net/wp-content/uploads/2024/07/AKX00069_10.incontext_2400x1600-760x380.jpeg)
Tech societies
The future of recruitment; replacing a workforce.
![](https://cdn.arstechnica.net/wp-content/uploads/2024/07/intuit_header-760x380.jpg)
The battle of AI search engines for supremacy.
![](https://www.freethink.com/wp-content/uploads/2024/07/FE_Search_Engines_Compressed.gif?quality=75&w=800&h=450&crop=1)
Training of AI becomes the new “You are the product” for Meta and probably also others. What do you think; is public content open for all uses? Or should it be part of the terms first?
![](https://149346090.v2.pressablecdn.com/wp-content/uploads/2024/07/ROW-EmilyScherer-LatinAmerica-Artists-AI-Final-1600x900.jpg)
Is slop the right term for AI content that is result of overproduction? Is it the same as Ewaste, or is that more the offset of the production of AI content. Maybe something for another dive sometime. What is said about this in the just published EU AI Act?
![](https://substackcdn.com/image/fetch/f_auto,q_auto:best,fl_progressive:steep/https%3A%2F%2Frobhorning.substack.com%2Ftwitter%2Fsubscribe-card.jpg%3Fv%3D1276839586%26version%3D9)
Are we doomed? An Oppenheimer moment is something different than a ChatGPT moment…
![](https://i.guim.co.uk/img/media/785954537c5662e0e3494e22cd402b55b90838c6/0_0_5000_3000/master/5000.jpg?width=1200&height=630&quality=85&auto=format&fit=crop&overlay-align=bottom%2Cleft&overlay-width=100p&overlay-base64=L2ltZy9zdGF0aWMvb3ZlcmxheXMvdGctZGVmYXVsdC5wbmc&enable=upscale&s=31ea614842b6d191b380647ad9701dd7)
Paper for the week
A very relevant and timely paper on the impact of conspiracy theories and how to counter these.
Durably reducing conspiracy beliefs through dialogues with AI
Here, we raise the possibility that previous attempts to correct conspiracy beliefs have been unsuccessful merely because they failed to deliver counterevidence that was sufficiently compelling and tailored to each believer’s specific conspiracy theory (which vary dramatically from believer to believer). To evaluate this possibility, we leverage recent developments in generative artificial intelligence (AI) to deliver well-argued, person-specific debunks to a total of N = 2,190 conspiracy theory believers.
Costello, T. H., Pennycook, G., & Rand, D. G. (2024, April 3). Durably reducing conspiracy beliefs through dialogues with AI. https://doi.org/10.31234/osf.io/xcwdn
Looking forward
Last week I had nice conversations with old and new contacts, readers of this newsletter :) And we discussed the coming ThingsCon events with different partners, both the Salons in September and the celebration edition in December. The website is updated, and will have some more updates this week.
Also curious to experience a ‘hard-core’ academic conference on SST – EASST-4s – to be precise; and be part of a panel on the kit-economy with our experiences with the WijkbotKit as co-design tool for future cities. And I will try to attend a couple of other sessions, specifically the one on agent agency.
And furthermore, there is a UX crawl at IKEA that is, as to be expected very popular. I am still on the waiting list 🙂
Enjoy your week!