Artificial Intelligence

[Zzzptm]

Interesting article, still reading it:

https://thebulletin.org/2025/09/the-risks-in-the-protocol-connecting-ai-to-the-digital-world/#post-heading

Basically, AI can survey countless documents and do some decent fact-checking, but breaks down trying to set up a dinner appointment. The article looks at the connection between AI and our personal data, as a personal assistant, and what we could expect of that.

[Charger]

I think when AI can set up those dinner appontments with ease is the time we need to officially worry.

I am already very very scared of AI and what will happen when a self learning AI gets free...

[Zzzptm]

^ Yeah, that's going to be a thing one day. I can imagine one learning how to do a penny skim operation on some bank somewhere and then using the proceeds to keep copies of itself in multiple cloud environments, and then being able to carve out parts of those environments for itself. A digital criminal creating its own private island, if you will. Given that AI LLMs show an increased tendency towards getting better at covering up misdeeds when they get more "ethics" after doing misdeeds, I think that's a possibility.

It becomes a bigger issue as more and more of the things follow their programming to make choices along a similar path of self-preservation. We simply don't have enough containment that will succeed against a construct that spends all of its time occupied in situational analysis.

[Vyn]

Love me some AI.

AI in the morning
AI at night
AI in the afternoon
Say NO to the Starland Vocal Band
But it is a delight

AI in my left sock
AI in my hair
AI while I'm shooting pool (or sharks)
AI is better than Nare

Or so I've been told!

 

[Zzzptm]

What are you smoking these days, Vyn?

[Typhon]

My movie review, which I posted today, would be of some interest.   

[Zzzptm]

My movie review, which I posted today, would be of some interest.   

Indeed.

And speaking of movies, there's some hubbub about a new AI actress. So, on the one hand, if I had AI generate all my movies for me, I could have lots to watch over time.

But would it be worth watching? It could make things that *looked* like genres I've enjoyed, but the stuff that makes a great film truly great, that would be missing. There's a deep humanity in a great performance, and it's why we celebrate them.

[Typhon]

Russia unveiled its first humanoid robot this week, but it didn't go well.

https://twitter.com/i/status/1989294741125845399

[Vyn]

I bet AI could generate some great movies - but only within certain genres. Those that specifically do not need the, "deep humanity," that Z mentioned.

Consider, for example, AI writing books. I think AI could churn out acceptable entries into the smut-based romance genre no problem. The kind that sell more due to having a couple of large pectoralis muscles with flowing blonde hair on the covers than actual meaning.

On the other hand, AI will not be writing, "Crime and Punishment," ala Dostoevsky anytime soon. Genuinely a book focused wholly on the human condition that would otherwise be worthless.

[KiloDeltaCharlie]

^^^
I did hear the other week that an AI generated animation is in the works, more of an experiment than a genuine money spinner for the (minor) production company. But it could be a step forward.

Also I saw a YT video the other day from Rick Beato talking about an AI generated country song which had got to No.1 on the country charts. He was more bemoaning the fact that news outlets had said it had got to No. 1 when in fact it was only on a minor subset (downloads I think) and not the main chart!

[Zzzptm]

AI animation for kids teevee is definitely gonna be a thing. All the crappy stuff gets unloaded on the kids.

As for AI music, I've heard some stuff that actually works out OK as a song, but misses the mark as far as authenticity. Like, someone asking for a late 60s sound and getting 80s-style drums in the tune. Nope, sorry AI, that's not how it works.

[Charger]

AI can NEVER produce quality music or tv or literature, that's a fact....All those things need the human factor...the emotion that a cold hard machine can never have.

[Zzzptm]

As a security person, I have worried thoughts about cool things and fads of today and what happens in 3-5 years when those vendors are either gone or have dropped support for their wares. AI itself is tough to secure, and it'll get even worse if there's no vendor support for stuff that's spun up today and still used years down the road, but not replaced due to cost or compatibility issues.

I'm already seeing big security holes with Internet-enabled crap that got bought 5-10 years ago and is now derelict because the manufacturer went out of business or got acquired by a firm that only wanted the intellectual property and dumped the support side of things. AI is going to be the same way, I'm pretty sure of that.

[Vyn]

Are there specific areas of concern, with regards to unmaintained AI platforms, that are unique to that scenario? Or is it simply yet another route for bad actors to scoop up supposedly confidential information?

I would think that LLMs, as the use-cases stand now, are uniquely positioned to contain personal/confidential data...more so than any other system out there. People entering company financial data, HR data, etc. in order to have the AI work with it and save them time from having to replace dummy data after the fact - I see that as a massive issue. So yeah, it also tracks that if/when a given AI system falls to the wayside, lack of even rudimentary security controls around that unmaintained system would cause the LLM to have a risk rating that is massively outsized compared to its data density.

[Zzzptm]

What's unnerving about LLMs is how they can be socially engineered after a fashion. Whereas it takes programming skill to get a standard program to break open and spill data like a piñata, an attacker hitting LLMs with prompts designed to jailbreak the LLM and get it to disregard its guardrails can have success without knowing how to code. Same way vibe coding works, vibe hacking is an option going forward.