The Block Republic’s Post

The Compendium, a full argument about extinction risk from AGI | AI Alignment Forum | LessWrong We (Connor Leahy, Gabriel Alfour, Chris Scammell, Andrea Miotti, Adam Shimi) have just published The Compendium, which brings together in a single place the most important arguments that drive our models of the AGI race, and what we need to do to avoid catastrophe. We felt that something like this has been missing from the AI conversation. Most of these points have been shared before, but a “comprehensive worldview” doc has been missing. We’ve tried our best to fill this gap, and welcome feedback and debate about the arguments. The Compendium is a living document, and we’ll keep updating it as we learn more and change our minds. https://lnkd.in/eMwsJ5Xx The Compendium | thecompendium.ai Humanity faces extinction from AGI. AI progress is converging on building Artificial General Intelligence, AI systems as or more intelligent than humanity. Today, ideologically motivated groups are driving an arms race to AGI, backed by Big Tech, and are vying for the support of nations. If these actors succeed in their goal of creating AI that is more powerful than humanity, without the necessary solutions to safety, it is game over for all of us. There is currently no solution to keep AI safe. In order to do something about these risks, we must understand them fully.  The Compendium aims to present a coherent worldview explaining the race to AGI and extinction risks and what to do about them, in a way that is accessible to non-technical readers who have no prior knowledge about AI. You can read this end-to-end or a-la-carte. Each section is standalone. The Compendium is a living document, and we will update it over time as the landscape changes. We welcome your feedback, which you can provide by email or by commenting directly on the content. https://lnkd.in/efxZBvDf #AI #genAI #LLMs #AGI #arms #race #xrisk #risk #alignment #Compendium

What happens when we build an AGI 10x smarter than humans? This profound question posed by Ben Goertzel, founder of SingularityNET, invites us to reflect on the trajectory of Artificial General Intelligence (AGI) and its potential impact. An AGI with intelligence vastly exceeding human capabilities could redefine the boundaries of problem-solving, creativity, and innovation. It could address challenges we consider insurmountable today, from curing complex diseases to reversing climate change. However, this possibility also raises critical questions: How do we ensure alignment with human values? What frameworks do we need to govern such a transformative entity responsibly? As we edge closer to AGI, it’s not just about building it but about co-evolving with it, ensuring that such intelligence amplifies human potential rather than undermines it. What are your thoughts on humanity’s next steps in this journey? #ArtificialGeneralIntelligence #AI #Innovation #FutureOfWork #EthicsInAI Fateh Amroune Aleksandra Amroune Liubomyr Bregman Vlad Centea Casius Morea Roberto De Gori Diwei LIU Amarilda Koka Shubham Kumar Olivia Scalmato Loise Wandera Elchin Mammadov Rodrigo Fernandez Tamayo Papi Debebe Kidane Mariam Lelashvili Tatjana Drobina,CFA,CIA,CAMS Magda Klegere Oxana Lavuschina Garamjav Bat-Amgalan Volodymyr Sabadin Stefan Jovanović Munmun K.

Is Is there a middle golden rational path for AI and Humanity, between the false utopia of #TESCREAL sci-fi super-human AGI inspired fanatics vs the false dystopia of an AGI led judgement day for humanity, ie., #DOOMERS? Consider… 1/ Short term AGI “doomers” imagine imminent existential threats with AGI asserting control, perhaps by a judgement day like doomsday. Hence doomer’s dystopia. BAD thinking 2/ On the other extreme polarity there’s the #TESCREAL AGI fan-boys who believe AGI at Super Intelligence is also imminent, bringing on a transcendent utopia (for a few or all that choose compliance perhaps). BAD thinking As in Romeo and Juliet “a curse on both houses”! I take a middle “golden” path. Factoring: Thesis: Short-term risk exist in pre-AGI bad actor attacks, and if used by the military, escalate to MAD levels. But that is not direct intention by AI to end the world of man. REAL SHORT TERM RISK Antithesis: However, I also think AGI is hard to deliver and harder to make safe and responsible. The later is the priority development need therefore. The former if rushed could be a #molochtrop in a couple of decades. Long term it’s a problem to align AGI to varied hunan values, and it risk huge socio-economic displacement in terms of no viable human employment. REAL LONG TERM RISK Solution/Synthesis: I think AI in narrow well defined use cases can be used to solve clear and present #ai4good. Sustainable ANI Integrated with humans-in-the-loop, ie., #SANITI. Being a distributed infrastructure with silos of intelligence, with humans in control it provides a human future supported with AI tools. REAL SHORT-LONG TERM OPPORTUNITY. I think that’s rational. NOTE it’s not a symbiotic position of Human/AI cyborgs, rather a Cooperative relationship with Humanity supported by AI tools. PS: if you need a sci-fi reference to catch my suggestion, think of us all having access to Dune-like “Mentat” capabilities, we’re still human, but educated to have Savant-like critical thinking faculties and intuition, supported by a network of domain-specific, super-smart information/knowledge/logic/statistical processing tools. Ie., #SANITI This the way to the evolution of a complex of consciousness — a human one. Cc: Ronald Cicurel

I attended the Phenom AI Day event today, and with it being over 4 hours long, multitasking was inevitable. Thankfully, Phenom has the replay on YouTube, so I can catch up on the parts I missed. If you've ever thought about using AI to "modernize" your Talent Acquisition or HR departments but aren't sure where to begin, this video is a must-watch. #ai #airecruiting #aihr #Phenom

📢 Event Alert! On November 21st and 22nd, join us at the Milano LUISS Hub for the highly anticipated Italian Insurtech Summit, organized by the Italian Insurtech Association - IIA We’re thrilled to announce that our very own Pasquale will be speaking about the evolving challenges and threats in the industry, including the impact of #Generative AI. Don’t miss out on this insightful event! 🔗 Register now: https://bit.ly/3YYRt3J #IIASummit #Insurtech #InnovationLeadership #GenerativeAI #InsuranceTransformation

I started reading the problem profile of preventing AI-related catastrophe from 80000 Hours (https://lnkd.in/eMDjc6AR) What I find interesting is that the alignment problem (that is, creating AI systems that do what we actually want them to do) is also relevant to other systems, such as companies or governments. We often use metrics to measure how an organization is performing. But more often than not, these metrics are only proxies - things that correlate with the goal of the organization, but they are not the goal themselves. This distinction is important. Because the metrics only approximate the goal, their blind maximization often leads to unexpected negative consequences.

Is the Artificial General Intelligence (AGI) project an inexorable race to the bottom ( https://lnkd.in/giWUdMey )? Despite the valiant efforts of thought leaders like Dr. Max Tegmark, who has thoughtfully expressed the need for collaborative and cautious advancement in AGI, the phenomenon of a 'Race to the Bottom' remains a daunting possibility. Tegmark's advocacy, detailed in his statement to the AI Insight Forum (https://lnkd.in/gHQPdw9X), underscores the critical need for global cooperation and rigorous oversight to navigate the AI development landscape safely. However, the relentless pace of technological competition, coupled with the aspirations of nations and developers to claim supremacy in the AGI arena, poses significant challenges to these ideals. The competitive drive to achieve breakthroughs in AGI not only fuels innovation but also propels a scenario where the desperation to lead can result in compromising safety and ethical considerations. The possibility of rogue nations ( https://lnkd.in/g39W_xig ) or developers operating outside the established regulatory frameworks amplifies global security concerns, making the race to the bottom a reasonable, albeit concerning, expectation. The alignment problem and the risks of human error further complicate the path to safe AGI development, highlighting the need for a unified international effort that prioritizes safety, ethical alignment, and transparent practices. In this precarious journey towards AGI, the collective actions and decisions of the global community will determine whether we can harness the potential of artificial intelligence to augment humanity's capabilities without succumbing to the pitfalls of unchecked competition and ethical oversight. As we push the boundaries of what's technologically possible, let us, the human society, not lose sight of the foundational principles that safeguard our collective future. #ai #artificialgeneralintelligence #racetothebottom

The Hopium Wars: the AGI Entente Delusion | by Max Tegmark | Lesswrong As humanity gets closer to Artificial General Intelligence (AGI), a new geopolitical strategy is gaining traction in US and allied circles, in the NatSec, AI safety and tech communities. Anthropic CEO Dario Amodei and RAND Corporation call it the “entente”, while others privately refer to it as “hegemony" or “crush China”. I will argue that, irrespective of one's ethical or geopolitical preferences, it is fundamentally flawed and against US national security interests. (...) Above I have argued that the “entente" strategy is likely to lead to the overthrow of the US government and all current human power centers by unaligned smarter-than-human bots. Let me end by proposing an alternative strategy, that I will argue is better both for US national security and for humanity as a whole. (...) Here is what I advocate for instead of the entente strategy. The tool AI strategy:  Go full steam ahead with tool AI,  allowing all AI tools that meet national safety standards. (...) In conclusion, the potential of tool AI is absolutely stunning and, in my opinion, dramatically underrated. In contrast, AGI does not add much value at the present time beyond what tool AI will be able to deliver, and certainly not enough value to justify risking permanent loss of control of humanity’s entire future. If humanity needs to wait another couple of decades for beneficial AGI, it will be worth the wait – and in the meantime, we can all enjoy the remarkable health and sustainable prosperity that tool AI can deliver. https://lnkd.in/ef6XSZh7 #US #China #AI #AGI #entente #delusion #race #tech #war #hegemony #national #security #geopolitics #strategy #MIC

🎬 James Cameron's Warning on Artificial General Intelligence (AGI)!!! What do you think about what he said? At a recent AI+Robotics Summit, legendary director James Cameron shared concerns about the potential risks of artificial general intelligence (AGI). Known for The Terminator, a classic story of AI gone wrong, Cameron now feels the reality of AGI may actually be "scarier" than fiction, especially in the hands of private corporations rather than governments. Cameron suggests that tech giants developing AGI could bring about a world shaped by corporate motives, where people’s data and decisions are influenced by an "alien" intelligence. This shift, he warns, could push us into an era of "digital totalitarianism" as companies control communications and monitor our movements. Highlighting the concept of "surveillance capitalism," Cameron noted that today's corporations are becoming the “arbiters of human good”—a dangerous precedent that he believes is more unsettling than the fictional Skynet he once imagined. While he supports advancements in AI, Cameron cautions that AGI will mirror humanity’s flaws. “Good to the extent that we are good, and evil to the extent that we are evil,” he said. Please share your opinions on AGI. #AI #ArtificialIntelligence #JamesCameron #TechEthics #AGIRisks #DigitalSurveillance Watch his full speech: https://lnkd.in/gvT8VzrK

This week, I had the opportunity to participate in a panel discussion hosted by CXO Inc., where we explored the intersection of Artificial Intelligence (AI) and Security in today’s organizational landscape. It was a pleasure to join a fantastic panel, expertly moderated by Arash Madani, with insightful contributions from Sameer Hasham (VP, Information Systems, YMCA Calgary) and Doug Doran (Chief Information Officer, Red Deer Polytechnic). Together, we delved into the evolving challenges and opportunities AI brings to security and how organizations can position themselves to succeed. During the discussion, I highlighted how various stakeholders view AI as a cornerstone for organizational success and the collective responsibility we all share in building and democratizing AI at scale. We also explored how AI agents are driving security innovation, enabling organizations to rethink and reshape their security practices. At Constellation, we are at the forefront of this transformation—developing state-of-the-art AI solutions to disrupt and redefine the Automotive and Life Sciences industries. Kudos to the organizers and participants for organizing such an engaging event. Finally, I’d like to give shoutout to a few notable individuals I had the chance to connect with: Gentry Petrescu Brent Harvey James Teetzel Cameron Fernihough Andre Delaney Mo Nezarati Igor Gifrin Melissa O'Brien #cio #chiefaiofficer #datascience #ai #disruption