Isn’t It (AI)ronic: Lessons from an AI Misinformation Expert's AI Misstep

In this edition, we're diving into the world of AI integration in professional settings, sparked by a recent incident involving a renowned expert on misinformation. It's a tale of technology, trust, and the tightrope we walk when embracing AI in our work. So, grab your digital dancing shoes, and let's tango with the complexities of human-AI collaboration.

Welcome to another edition of the best damn newsletter in human-centric innovation.

Here's what we're covering today:

→ The Professor Hancock AI affidavit incident

→ Key insights for responsible AI integration

→ Strategies for maintaining transparency and accountability

→ The importance of ongoing dialogue in AI adoption

Let's get to it! 👇

Picture this: Stanford's Jeff Hancock, a communication professor and renowned expert on misinformation, with an hourly rate of $600 (great work if you can get it), tasks ChatGPT-4o with drafting a legal affidavit. The result? A declaration riddled with inaccuracies and "hallucinated" citations. Ironically, some of these errors pertained to misinformation itself. It's a plot twist worthy of a courtroom drama—and not the good kind. When the expert on misinformation ends up inadvertently spreading it, the stakes couldn’t be higher, especially in a case involving deepfakes, the poster child for digital deception.

Hancock's affidavit, submitted in a Minnesota court case regarding the state’s 2023 ban on using deepfakes to influence elections, intended to illustrate how deepfakes amplify misinformation and erode trust in democratic institutions. Yet, plaintiffs’ attorneys pointed out that the statement included citations to two articles that simply didn’t exist. Another error misattributed authorship in an existing study—a scholarly faux pas that’s hard to overlook.

Hancock later admitted to the oversight, explaining in a court filing that he had used GPT-4o and Google Scholar to assist with research and drafting. He’d included placeholder tags (“[cite]”) in his initial draft to remind himself to add correct references but inadvertently allowed GPT-4o to generate its own fabricated citations. “I express my sincere regret for any confusion this may have caused,” he wrote, clarifying that he stood firmly behind the substantive points in the affidavit. Despite the apology, the episode highlights the ethical tightrope we walk when integrating AI into critical workflows.

And let’s not miss the irony here: a misinformation expert’s affidavit—about deepfakes, no less—undermined by misinformation itself.

As we navigate the uncharted territory of AI-human collaboration, it is crucial to pause and reflect on the lessons we can glean from Professor Hancock's experience. By examining the key insights from this incident, we can begin to develop a framework for responsible AI integration in professional settings.

Tip #1: Transparency is Paramount

When utilising AI in the drafting of authoritative documents, such as legal affidavits or expert reports, it is essential to maintain complete transparency. Clearly disclosing the involvement of AI not only upholds ethical standards but also allows for a more accurate assessment of the document's credibility.

Tip #2: Trust, but Verify

While AI can be an invaluable tool in streamlining research and drafting processes, it is crucial to remember that its outputs are not infallible. As demonstrated in Professor Hancock's case, AI-generated citations and information should always be thoroughly verified before inclusion in final documents.

Tip #3: Collaboration, Not Abdication

AI should be viewed as a collaborative partner in professional workflows, not as a substitute for human expertise and judgment. By maintaining an active role in reviewing and refining AI-generated content, professionals can harness the benefits of the technology while mitigating its potential drawbacks.

Tip #4: Ethical Guidelines and Accountability

As AI becomes more deeply embedded in professional contexts, the development of robust ethical guidelines and accountability measures is imperative. This may include mandatory disclosure policies, AI literacy training for professionals, and the establishment of oversight committees to ensure responsible AI usage.

Tip #5: Ongoing Dialogue and Adaptation

The landscape of AI integration in professional settings is constantly evolving, and as such, it is crucial to maintain an ongoing dialogue among stakeholders. By sharing experiences, best practices, and concerns, we can collectively navigate the challenges and opportunities presented by this transformative technology.

As we continue to explore the potential of AI in our professional lives, I invite you to join the conversation. Share your own experiences, insights, and concerns regarding AI integration in your field. Together, we can work towards developing a framework for responsible AI usage that upholds the highest standards of transparency, accountability, and ethical conduct.

The tango of trust between humans and AI is a delicate dance, one that requires constant communication, adaptation, and a willingness to learn from our missteps. By approaching this partnership with a spirit of openness, curiosity, and caution, we can unlock the transformative potential of AI while safeguarding the integrity of our professional endeavours.

Our digital capabilities are reshaping the world—are you confident enough to lend your voice to shape the future? The story of Professor Hancock’s affidavit serves as a stark reminder of the challenges and opportunities in human-AI collaboration. It underscores why we must navigate this dance with care, transparency, and accountability.

That’s why I created Netropolitan Academy—your gateway to mastering AI, automation, and the skills that truly matter. This isn’t just about understanding technology; it’s about leading the conversations, shaping best practices, and ensuring that your voice is heard in the evolution of innovation.

Don’t let the future unfold without you. Join the waitlist today using this link and secure your place at the forefront of the AI revolution. Together, let’s shape a world where technology works for us, not against us.