Is AI Creative?

March 31, 2023      Kevin Schulman, Founder, DonorVoice and DVCanvass

Creativity is often defined by three criteria,

  • The idea or product is novel (original) and,
  • Has value or utility (usefulness),
  • Within a specific context or task (task appropriateness)

AI can certainly devise novel works of music, art and writing.  It’s true AI has no cognition, emotions or experiences and therefore, its originality is limited to the patterns and structures learned from the data.

But the Old Testament reminds us, “What has been is what will be, and what has been done is what will be done; and there is nothing new under the sun.

The meek borrow, genius steal and in this way perhaps, AI is genius and also, creative.

A more quantitative measure of creativity is called the Alternative Uses Test that prompts humans or AI to generate multiple, original uses for five everyday objects (pants, ball, tire, fork, toothbrush).

This test is used frequently to measure human creativity and has good predictive validity.  This chart shows how AI stacked up against humans.

Here are the take-aways:

  • Green line: This is the top humans, the most creative per the AUT.
  • Yellow line: The average for all humans
  • Light blue line:  This is yesterday’s AI, GPT 3 that is slightly above the average human
  • Pink line: Today’s AI, GPT 4. Much better than yesterday’s AI and only slightly worse than the best humans.

Many jobs will be lost from AI, more will be enhanced with productivity and efficiency boosts.

Today’s version of AI is still a 3 yr old on a tiny bike with training wheels.  The future is flying cars by comparison.  And the future is moving at an exponential rate.

There is an upcoming book recounting the experience of a person who’s both a data scientist and endocrinologist.  This doctor was given six months of pre-release, hand-on’s time with GPT-4 to trial it in medical use cases.  Recognize, medical students and residents routinely do Google searches now.

Among the many findings;

  • GPT-4 gave a correct genomic diagnosis for a condition that occurs in one in one million people
  • GPT-4 was used to write pre-authorizations, discharge summaries to edit and approve, recommendations for a clinical trial and review care plans for patients
  • And last but not least, this quote from the doctor, “I’ve thought it would be pretty darn difficult to see machines express empathy, but there are many interactions that suggest this is not only achievable but can even be used to coach clinicians to be more sensitive and empathic with their communication to patients.”

Empathy?  Creativity?  If it walks like a duck and quacks like a duck…And remember this is a tiny bike with training wheels and GPT-4 wasn’t trained for the medical domain.

The training bit brings me to a final point for now but one we’ll continue to expound on; you have to train AI on your use case.  The seemingly endless recommendations and Top 10 lists of prompts to give GPT to achieve X, Y or Z are a distraction, at best.

It’s like giving me instructions on how to cook instead of a step-by-step recipe to make beef wellington.  The former will never get me there.

Same for asking GPT to write for you.  It needs to be trained on your style to start matching it.

Kevin

2 responses to “Is AI Creative?”

  1. This is so wise Kevin. As a writer and synthesizer, I wish it wasn’t so good at doing my job. As someone who might be misdiagnosed with a rare illness, I’m excited that it may be able to find out what’s wrong with me. As a human who fears it may be able to simulate empathy, up to the moment it decides the planet is better off without us, I’m scared for our future as a species. But whatever the AI future, we certainly can’t bury our heads in the sand. It’s imperative to figure out where/how it can be helpful, and equally important to be cautious where it may cause real harm. Let’s hope we’re up to the task..
    Thank you for continuing to push us forward.

    • Kevin says:

      Thank you, Claire, for reading and commenting. I’m fine having AI take on lots of tasks where it is better, faster, smarter. That is what good companies do with humans. Lots of research showing A players hire A (and B players), never C. C players never hire A players. I want to hire all A players and have them replace me. If it’s a robot, so be it.