#7 Society and Technology Bulletin

^{Society and Technology (KÜME Foundation)}

The human voice has begun to lose its unique quality that no other living being could ever replicate. Our voices can now be mimicked so accurately that they are nearly indistinguishable from the real thing. Consumer Reports recent research reveals that leading artificial intelligence models offer almost no protection against the cloning of human voices without the individuals’ knowledge or consent.

In daily life we use our voices with little restraint. Because speech is one of our most fundamental abilities it has become encoded as the representative medium of all our public expression. In the modern era voices are recorded and processed in countless ways. For example, calls with customer service are recorded “to improve service quality.” Digital assistants are increasingly exposed to our voices. When we post audio or video content on social media we rarely consider the consequences.

Yet our voice is far more than a communication tool—it is an inseparable part of our personal identity. We externalize many aspects of our existence—our actions, commands, ideas, and recommendations—at the level of our voice. The use of our voice is a form of performing our very being.

In recent years voice cloning technology has become possible thanks to AI-powered systems that require only a few seconds of audio sample. What was once considered science fiction is now being used across many fields—from marketing to political propaganda. Last year in the United States a fake voice of Joe Biden was used to discourage voters from casting ballots, exposing the potential for abuse of this technology.

Today in many places no special permission or certification is required to use voice cloning technology. With open-source models or commercial applications anyone can take a social media video, extract the person’s voice within minutes, and generate synthetic speech to make it say anything desired. There is almost no legal framework to distinguish whether such use constitutes parody, art, or fraud. Thus voice security is left to the goodwill of companies and the discretion of users.

This situation has triggered a serious crisis of privacy and authenticity. Cloning someone’s voice, speaking in their place, representing them, and instrumentalizing their influence can all be achieved. At this point the fundamental question we must ask is whether privacy is merely a violation of physical distance. With the capabilities offered by AI, every environment where we give our voice becomes a ground upon which we surrender our privacy.

A common reflex in the tech world to address privacy crises is to solve the problem with the same technology that caused it. Emerging systems aim to detect whether a voice is original or synthetic by embedding digital authenticity markers into audio files. Like security features used to identify counterfeit currency, these invisible signatures are being developed to help detect AI-generated voices.

A more advanced proposal is to link blockchain technology with voice identities. In this system a person’s unique vocal “fingerprint” is recorded on a distributed ledger, and every voice production is verified against this record. This approach opens up a new kind of digital identity: a cryptographically secured public and immutable record of who spoke.

The appeal of this approach lies in its promise to rebuild trust. But we cannot avoid asking: Should we seek the solution to privacy in greater traceability? Are we legitimizing more surveillance in the name of security? Does documenting that a voice truly belongs to its owner impose a new order that restricts the voice’s inherent freedom to exist? This path constructs the infrastructure of a world where humans are defined as data owners. The more we entrust security to technology the more we tie trust not to intent but to traceability.

Another reflex is to believe nothing.

As in the “Zero Trust” principle of cybersecurity, no user, device, or access request should be trusted by default; continuous verification is required. If we constantly keep in mind the possibility that a voice could be fake, this may make us not only more cautious individuals but also more suspicious, more isolated, and more emotionally detached. Does approaching every voice with caution erode the minimal trust that makes social life possible?

Do we want to live in such a world? In a society where every video is fake, every voice artificial, and every piece of information manipulable, how possible is public communication, emotional connection, and authentic dialogue?

Alongside the rise of artificial intelligence digital data centers have transformed into energy giants comparable to the iron and steel factories of a bygone era. According to the International Energy Agency’s 2025 report the electricity demand of data centers alone will quadruple by 2030. Projections suggest this demand will exceed Japan’s annual energy consumption.

This phenomenon can be interpreted as AI’s “invisible body.” Every computation performed for large language models image processing systems or autonomous vehicle algorithms requires substantial energy on server racks. Behind every “virtual” command lies a physical energy cost.

While AI competition has long been defined by algorithmic superiority data volume and model capacity this framework is now inadequate. High-performance AI applications such as large language models image processing systems and autonomous decision networks demand not only cognitive resources but also physical ones.

An increasingly decisive factor: energy. Progress in artificial intelligence is becoming increasingly dependent on energy infrastructure. This transforms the AI race from a purely technical competition into a comprehensive energy rivalry with geopolitical and ecological dimensions.

In the AI race between the United States Europe and China energy sources to power these systems have become strategic assets. It is known that the United States must expand its electrical grid by 20 percent to sustain its data center infrastructure. The Stargate project led by OpenAI Oracle and SoftBank signals this kind of growth. Meanwhile France is positioning its nuclear energy infrastructure as the cornerstone of its AI strategy.

As in the past energy continues to play a strategic and decisive role in global power competition. We will see whether an energy supply crisis brings about a classic geopolitical reckoning.

Arms control experts activists and some representatives of major tech companies argue that a kind of “ethical brake” must be applied to the breakneck pace of the AI race. At the AI Security and Ethics Conference organized by UNIDIR (United Nations Institute for Disarmament Research) in Geneva this call became even clearer: Artificial intelligence is approaching its Oppenheimer moment..

Robert Oppenheimer’s role in developing the atomic bomb and his subsequent remorse represent a historical turning point showing how technological genius without moral boundaries can lead to devastation. The analogy of an “Oppenheimer moment” for AI suggests we are now at a similar threshold: a point where the gap between what is technologically possible and what is morally permissible has opened wide.

UNIDIR officials emphasize the need to strictly limit AI-driven military technologies such as autonomous weapons systems to ensure compliance with human rights international law and the ethics of war because unchecked AI can make inhuman decisions..

Europe’s stance in the AI race is a striking example in this context. Influenced by Europe’s intellectual heritage the “normative thinking tradition” sometimes seeks to set direction even at the cost of slowing technological momentum.

This creates serious decisions for Europe. Particularly in the face of AI’s military applications Europe faces a clear dilemma: On one hand it opposes the moral risks of autonomous weapons systems on the other hand the rapid progress of actors such as the United States China and India creates a risk of Europe falling behind in terms of national security and strategic capacity.

A decision paradox emerges here:

• Either slow technological advancement due to ethical concerns
• Or set aside ethical concerns and enter the race for military superiority

This is not merely a state-level dilemma but an epistemological quandary faced by individuals as well.