[Technology] The Artificial Intelligence Thread

Got something to say or just want fewer pesky ads? Join us... 😊



Han Solo

Well-known member
May 25, 2024
4,466
AI is going places but ChatGPT specifically isn't useful in most areas. Its bad at counting, makes up a lot of random information and it is EXTREMELY politically correct.

I tried to ask it how, if you were a dictator, would scientifically cause a divide between men and women in society... and it refused to answer due to "potential abuse".

Deepseek, the Chinese option, did answer that question in great detail. However when I asked that one about esoteric movements and secret societes in China, it just said "That is beyond my scope", refusing to elaborate.

So far not found any AI chatbot that passes all my tests. All the curation and invention of truth makes them useless for information.
 




CheeseRolls

Well-known member
NSC Patron
Jan 27, 2009
6,344
Shoreham Beach
It has told you nothing that you couldn't have found out by searching for the source information, but it adds its own spin, which seems to entirely bend to the goal of providing a pleasing narrative. And the false precision (percentage predictions with decimal places) shows a fundamental misunderstanding of the difference between precision and accuracy. In other words, it is a load of old bolleaux.

I am convinced some of my final year BSc students have been using it to answer coursework essays. Typically the narrative is plausible, but there are errors, and all the nuance and interpretation I provided in lectures is missing. Sometimes the essay clearly lacks any of the pivotal information and interpretation I provided in lectures. There are a few fails and quite a few shit marks in the 40s. The high scoreres have built on what I told them, and added in analysis of their own, based on the core principles I taught, using their own words.
Have been listening to

Fluke: Chance, Chaos, and Why Everything We Do Matters - Dr Brian Klass​

Granted this will probably prompt a major and lengthy disection and take down from you, I have found some of the insights on academic research and social science interesting and entertaining. He does go in quite hard on the false precision and the bias we all have towards certainty and rationality and the need to build a narrative.

Hence we are going to make the Champions League next season, because we have an outside chance and are on a run of form and to one decimal place of certainty! Having just read Opta's analysis of our form post Forest, which doesn't even mention the word midfield, I can say with 87.86% certainty that this is indeed "a load of old bolleaux"
 


Harry Wilson's tackle

Harry Wilson's Tackle
NSC Patron
Oct 8, 2003
59,660
Faversham
Shock horror.... students don't listen in lectures :laugh:
Spent most of today marking.
It is not the not listening to lecture capture or reading my slides that is the problem,
it is the going directly to ChatGPT, asking some uninformed questions and expecting actual insights,
that is pathetically laughable.

Some of these students imagine they know best and don't need to do any actual thinking.
Wrong.
I have been handing out fails today,
but it takes ages explaining why statements X and Y are correct, but not connected by 'therefore',
and therefore the whole is incorrect,
and if I don't explain they will gripe, because they imagine they (or ChatGPT) has done a good job.
This is driving me to distraction,
and delaying the return of marked work to beyond the 4 week deadline.

One of them sent me a cheeky email last Friday to tell me that I have exceeded my marking deadline.
And when I checked, they did not send me the formative essay plan, (my way of helping them pass).
So they will probably be getting a bad mark.

There are some excellent bits of work however, which are a joy to read.
The distribution seems to be binomial - workers and nobbers.
 


Harry Wilson's tackle

Harry Wilson's Tackle
NSC Patron
Oct 8, 2003
59,660
Faversham
Reminds me of something I saw recently, where an “expert” was proclaiming AI on the basis that research which would have taken him hours in the past can now be done it minutes.

Because nothing fosters a deep understanding of a topic better than five minutes of half-arsed effort.

Tech continues to push us down a road where “faster is better” is the unquestioned cliche.
AI gets things wrong but this is hidden in the product, which is the delivery of a plausible narrative,
as elegantly explained 2 years ago by someone in this thread who asked AI to explain why something is good, then explain why it is bad.
 


SouthSaxon

Stand or fall
NSC Patron
Jan 25, 2025
890
AI gets things wrong but this is hidden in the product, which is the delivery of a plausible narrative,
as elegantly explained 2 years ago by someone in this thread who asked AI to explain why something is good, then explain why it is bad.
I work in digital, people are obsessed with “asking ChatGPT”. Few of them, ever, have thought about how they will ask or whether they should check the output. Coincidentally, those same few have never taken the time to learn how it works.
 




Paulie Gualtieri

Bada Bing
NSC Patron
May 8, 2018
11,706
I thought I'd ask ChatGPT a question:
What percentage chance do Brighton & Hove Albion have of qualifying for the Champions League?

As of March 10, 2025, Brighton & Hove Albion’s chances of qualifying for the UEFA Champions League have improved, particularly due to the likelihood of the Premier League securing five qualification spots for the next season. This development stems from England’s strong performance in European competitions, positioning them to receive an additional Champions League berth.

Recent analyses reflect this positive shift for Brighton. According to Sky Sports, Brighton’s probability of finishing in the top five has risen to 14.1%, enhancing their prospects of Champions League qualification. Similarly, Opta’s supercomputer forecasts a 21.3% chance for Brighton to secure a top-five finish, further bolstering their European aspirations.

Brighton’s recent form has been instrumental in this surge. Their dramatic 2-1 victory over Fulham, secured by João Pedro’s 98th-minute penalty, marked their fourth consecutive league win and elevated them to sixth place in the standings with 46 points, just one point behind Manchester City. This winning streak underscores Brighton’s momentum as they vie for a historic Champions League spot.

In summary, Brighton & Hove Albion currently have an estimated 14.1% to 21.3% chance of qualifying for the Champions League, contingent upon their continued strong performances and the Premier League securing a fifth qualification spot.
Did you use the standard search function or enterprise out of interest?

We’ve now have the Enteprise version at work and we have been testing their “Deep Research” function that take the problem away for 5-10 mins and comes back with a more comprehensive answer than the standard set up with its increased source count. Very much early days but impressive so far in the main

As others have said it still poses a significant risk to be deployed in live on its own as is very much driven by the robustness of the instructions (or not) given. I read an article the other week where a model lied to its owner as the instructions were above anything else meant to give a positive outcome when asked to address an issue, at whatever cost wasn’t factored in!
 


Moshe Gariani

Well-known member
Mar 10, 2005
12,351
We’ve now have the Enterprise version at work and we have been testing their “Deep Research” function that take the problem away for 5-10 mins and comes back with a more comprehensive answer than the standard set up with its increased source count. Very much early days but impressive so far in the main
Not surprised to hear this. Times are changing very quickly.

Some interesting research to be done on personality types, levels of professional hubris, and attitudes towards AI.
 


Change at Barnham

Well-known member
Aug 6, 2011
5,872
Bognor Regis
Did you use the standard search function or enterprise out of interest?

We’ve now have the Enteprise version at work and we have been testing their “Deep Research” function that take the problem away for 5-10 mins and comes back with a more comprehensive answer than the standard set up with its increased source count. Very much early days but impressive so far in the main

As others have said it still poses a significant risk to be deployed in live on its own as is very much driven by the robustness of the instructions (or not) given. I read an article the other week where a model lied to its owner as the instructions were above anything else meant to give a positive outcome when asked to address an issue, at whatever cost wasn’t factored in!
I used the bog standard version. With the simple question, and it replied within about 5 seconds.
 








Fungus

Well-known member
NSC Patron
May 21, 2004
7,252
Truro
A couple of weeks ago I asked chatgpt ”what is a four letter word for gamble?” (Big Issue crossword clue), and it told me “bet.” (nicely padded out with a full stop). Tried it again just now, and it told me “punt”, which was the correct answer. So, it’s definitely getting more intelligent. 🤦‍♂️
 




sir_gullahad

Well-known member
Dec 20, 2013
317
Cheltenhamshire
I'm late to the AI party, trying to find a use for it, so I was playing with copilot today.

I thought that I could set it to try and summarise legal text: user license agreements, that sort of thing. I told it to look at the Spotify Terms and Conditions and tell me what restrictions it places on my use of the service. It came back with a suspiciously short list fairly promptly, providing a link to the webpage. Following its link and reading around, I quickly found a restriction it had missed (non-commercial use only)

When I asked it to account for the discrepancy, it admitted that it had not scanned Spotify's terms directly, relying instead on "general knowledge of their policies". I asked it to elaborate, and its "general knowledge" turned out to be "prior summaries" and "publicly available information". In other words, out of date hearsay.

It offered to do a web search, retrieve the document, and carefully summarize. So I said go ahead. This effort came up with *only* the non-commercial restriction, not the things it had first presented. More back and forth failed to improve matters (I was trying to find out if I could have framed my request better).

TL;DR : When asked for a legal agreement summary, copilot came back with previous search results and hearsay rather than actually looking at the relevant text.

As it stands, I have the same degree of confidence in AI as in the guy down the pub who "reckons" things.
 


jcdenton08

Joel Veltman Fan Club
NSC Patron
Oct 17, 2008
17,027
Maybe I’m being dense here, but as things stand, for the actual end user outside of customer service applications like chat bots, it’s really ChatGPT. And all that does it spout misinformation by scouring the Google front page.

The one time I’ve found it useful was looking for a specific word in Dutch as a joke with a friend. It’s cack.
 








Mustafa II

Well-known member
Oct 14, 2022
2,272
Hove
Maybe I’m being dense here, but as things stand, for the actual end user outside of customer service applications like chat bots, it’s really ChatGPT. And all that does it spout misinformation by scouring the Google front page.

The one time I’ve found it useful was looking for a specific word in Dutch as a joke with a friend. It’s cack.

It's absolutely incredible. It's difficult to find a question it does not have a quality, informed answer for.

Most of us are impressed when we ask it complicated questions about our areas of expertise, such as our lines of work, and it gives better answers than we are capable of - and has no problems with elaborating on any questions, in detail, with sources.

AI is still a baby and it's getting exponentially better every day. It does 'hallucinate', as in, sometimes create information that is not true - so it's still worth being cautious with it.

If you're treating it as a joke, there's your problem. Ask it something that you think it would be impossible for it to know, perhaps about a topic you know a lot about - and prepared to be very impressed.
 


jcdenton08

Joel Veltman Fan Club
NSC Patron
Oct 17, 2008
17,027
It's absolutely incredible. It's difficult to find a question it does not have a quality, informed answer for.

Most of us are impressed when we ask it complicated questions about our areas of expertise, such as our lines of work, and it gives better answers than we are capable of - and has no problems with elaborating on any questions, in detail, with sources.

AI is still a baby and it's getting exponentially better every day. It does 'hallucinate', as in, sometimes create information that is not true - so it's still worth being cautious with it.

If you're treating it as a joke, there's your problem. Ask it something that you think it would be impossible for it to know, perhaps about a topic you know a lot about - and prepared to be very impressed.
I just asked for a full list of every single actor who has played Raoul in The Phantom of the Opera. It named several who had never played the role, ignored many who had played the role, and when I pointed this out it apologised, then named a bunch more who have never played the role. It can’t be relied upon on matters of fact.
 


Mustafa II

Well-known member
Oct 14, 2022
2,272
Hove
I just asked for a full list of every single actor who has played Raoul in The Phantom of the Opera. It named several who had never played the role, ignored many who had played the role, and when I pointed this out it apologised, then named a bunch more who have never played the role. It can’t be relied upon on matters of fact.

Is the following not accurate? -

In The Phantom of the Opera, the character of Raoul, Vicomte de Chagny, has been portrayed by numerous actors across various adaptations, including stage productions, films, and TV adaptations. Below is a list of notable actors who have played Raoul:

Stage (Major Productions)

  • Steve Barton – Original West End (1986) and Broadway (1988) Raoul.
  • Michael Ball – London (1987-1989).
  • Patrick WilsonThe Phantom of the Opera at the Royal Albert Hall (2011).
  • Hadley Fraser – London 25th Anniversary (2011).
  • Ramin Karimloo – Played Raoul in The Phantom of the Opera before later portraying the Phantom in multiple productions.
  • Killian Donnelly – London (2010-2011).
  • Simon Bailey – London (2003-2005).
  • Anthony Warlow – Australian production.
  • Gardar Thor Cortes – West End.
Many other actors have played Raoul in international productions, touring productions, and revivals.

Film and Television Adaptations

  • Patrick WilsonThe Phantom of the Opera (2004 film, directed by Joel Schumacher).
  • Edward de SouzaThe Phantom of the Opera (1962 Hammer Horror version).
  • Jean MaraisLe Fantôme de l'Opéra (1962 French TV film).
  • Norman KerryThe Phantom of the Opera (1925 silent film, opposite Lon Chaney's Phantom).
  • David StallerThe Phantom of the Opera (1983 TV film).
  • Adam StorkeThe Phantom of the Opera (1990 TV miniseries).
Would you like details on a specific production?
 




sir_gullahad

Well-known member
Dec 20, 2013
317
Cheltenhamshire
I just asked for a full list of every single actor who has played Raoul in The Phantom of the Opera. It named several who had never played the role, ignored many who had played the role, and when I pointed this out it apologised, then named a bunch more who have never played the role. It can’t be relied upon on matters of fact.
Your example is a open question (West End productions? Regional? Broadway? Off-Broadway? Off-off-Broadway? Am-dram? School productions? Translations? Parodies? Alternate media? etc etc) dependent of premises and interpretation. So the answer could be considered a matter of opinion.

In my opinion ;)
 


jcdenton08

Joel Veltman Fan Club
NSC Patron
Oct 17, 2008
17,027
Is the following not accurate? -

In The Phantom of the Opera, the character of Raoul, Vicomte de Chagny, has been portrayed by numerous actors across various adaptations, including stage productions, films, and TV adaptations. Below is a list of notable actors who have played Raoul:

Stage (Major Productions)

  • Steve Barton – Original West End (1986) and Broadway (1988) Raoul.
  • Michael Ball – London (1987-1989).
  • Patrick WilsonThe Phantom of the Opera at the Royal Albert Hall (2011).
  • Hadley Fraser – London 25th Anniversary (2011).
  • Ramin Karimloo – Played Raoul in The Phantom of the Opera before later portraying the Phantom in multiple productions.
  • Killian Donnelly – London (2010-2011).
  • Simon Bailey – London (2003-2005).
  • Anthony Warlow – Australian production.
  • Gardar Thor Cortes – West End.
Many other actors have played Raoul in international productions, touring productions, and revivals.

Film and Television Adaptations

  • Patrick WilsonThe Phantom of the Opera (2004 film, directed by Joel Schumacher).
  • Edward de SouzaThe Phantom of the Opera (1962 Hammer Horror version).
  • Jean MaraisLe Fantôme de l'Opéra (1962 French TV film).
  • Norman KerryThe Phantom of the Opera (1925 silent film, opposite Lon Chaney's Phantom).
  • David StallerThe Phantom of the Opera (1983 TV film).
  • Adam StorkeThe Phantom of the Opera (1990 TV miniseries).
Would you like details on a specific production?
I asked for a full list of every single actor, including understudies, to have played the role in the West End production. It failed in the ways I described.
 


Albion and Premier League latest from Sky Sports


Top