Update 6 - BOOM we did it! AI Twins will change how we learn!

This is Update 6 to the "Kids build their own AI" series

• Kickoff post here: My kids are building an AI
• Update 1: Hallucination vs Memory
• Update 2: Reinforcement Learning with human feedback
• Update 3: AI Evolution through Natural Selection
• Update 4: Providing the AIs a Voice and Avatar
• Update 5: Dynamic Emotional States and Dream Factories

Accompanying Video:

In just 6 weeks, my kids built their own Digital twin AIs and now they are starting a new mission, to help everyone build their own! But before we go there, one final update to this project:

What were the goals?

6 weeks ago we started this project with a goal. Can my kids build their own Digital Twin AI that knows everything about them: Their strengths, their weaknesses, their history, their likes and dislikes... everything. Now, first things first, we need this to be totally private, we did not want to share personal information with anyone, so privacy was key. But assuming we could figure that out, could we build our own Digital twin AIs?

Assuming we could, at the start of the project we set up the success requirements we would be aiming for:

1. Will they be able to answer questions we have trained them on?
2. Will they be able to answer novel questions that reflect how we think?
3. Can we learn more about ourselves through training our digital twins?

If we could accomplish these goals we could consider it a success. so off we went.

Quick recap

Kickoff post here: My kids are building an AI

My kids learned how to set up their own Private AI, they learned how to troubleshoot, and then learned how to provide their AIs data about themselves and start training it to become their twin.

Update 1: Hallucination vs Memory

We tested our digital twin AIs to assess the suitability of the training data. We discovered the difference between Hallucination and Memory, as well as the importance of accuracy in information. We learned that the AI has a short-term memory, necessitating careful question formulation. Long-term memory is powerful, so crucial information should be documented and ingested to ensure retention. We also realized the significance of versioning data for tracking accuracy improvements.

Update 2: Reinforcement Learning with human feedback

We focused on optimizing the AIs by implementing Reinforcement Learning with Human Feedback (RLHF).

We also delved into the concept of hallucinations and creativity, realizing that they might be two sides of the same coin. While accuracy in data is crucial to avoid hallucinations, we discovered that the AI's generation of new information could also be considered creative if it aligns with our preferences.

Update 3: AI Evolution through Natural Selection

This was a side quest for the project, as it sparked the idea of using a natural selection process to evolve and improve these AIs.

We are currently experimenting to figure out ways to merge the finetuned AI models.

Update 4: Providing the AIs a Voice and Avatar

We focused on more natural communication by including a voice and avatar for the AIs.

We provided some step-by-step instructions for how to do this and then showcased how it all works.

Update 5: Dynamic Emotional States and Dream Factories

We focused on making the digital twin AIs more human-like by providing their AIs with emotions.

We then explored building a "Dream Factory" to allow AI to learn and set emotional states at the beginning of a new session based on past interactions and desired outcomes.

The Final update:

For context, let's quickly cover why you may hear the AIs respond to questions with unique personalities:

My daughter set her AI with the below character traits and set her AI to have a dynamic emotional state, which means that you will see her get board with some questions like the Math questions :)

You will also notice that she answers her questions with sarcasm and dark humor, which is just like my Daughter :)

My Son also set his AI up with a dynamic emotional state and then the below character traits. You will notice that his AI keeps mentioning random Military history facts. This is because that's what my son does too :)

Now let's check out how the AIs faired at meeting the success criteria:

Video Clip 1

We don't want the AI to just repeat exactly what we trained it on, It needs to incorporate it into its responses. Here my daughter asks about her exoskeleton. This is described in multiple different ways throughout the training data. Can the AI pull all the information into a suitable answer?

Video Clip 2

In this question, we ask the AI to recall some personal data about what books my son likes, then to come up with suggestions of some other books he may like:

Video Clip 3

here my son asks his AI to help him code his Roblox game. Notice how his AI keeps bringing in random military facts. This is what my son does too, and it's part of the personality my son gave his AI.

Video Clip 4 + 5

Here we wanted to see how well their AI twins could help them with things like their schoolwork. Could these AI twins be any good at Tutoring? AND WOW, CHECK THIS OUT!

There is so much more!

There is so much more that I cannot show you because it is soo personal. These AIs know so much about my kids, their likes and strengths, their struggles and dreams, and this information is incorporated in all the AI's responses.

A simple question about a book resulted in the AI highlighting how the character's fear and anxiety had a root cause similar to that of my son's anxiety and how the character's story progression is a good model for how he could overcome his own anxiety. THIS BLEW MY MIND and brought us to tears

Without a doubt we not only met our success criteria but in just 6 weeks we blew right past them!

✅ Incorporating trained data into conversations

✅ Answer novel questions how my kids would

✅ Teaching my kids about themselves and the world

Every child can build their own AI

So now at the end of this project, we start the next!

I've received SO MUCH support and enthusiasm for this summer project not just for people in my network but for kids all around the world that I've met and worked with, including those from East Africa, India, and East Asia. So my kids have decided that they want to start a company and help all kids build their own AIs like theirs! A unique company

• A company that sees the world through the eyes of a child, a world of opportunity, beauty, and exploration!

LAUNCHING SOON!