The Pitfalls of Focusing Solely on Technology

Misinterpretation of AI Regulation

Jan W Veldsink MSc, Narrative Shaper in AI and Ethics. Date: 24 July 2024


In recent discussions surrounding the regulation of artificial intelligence (AI), a significant trend has emerged: the overemphasis on technology itself, often at the expense of understanding its implications and effects on society. As highlighted in an article from NRC, a survey conducted by the Dutch Data Protection Authority (AP) revealed a troubling reality among local governments. These entities are increasingly utilizing AI technologies, yet many find themselves grappling with their complexities and unintended consequences.

The Local Government Context

Local governments across the Netherlands are beginning to integrate AI into various routine processes, from facial recognition checks at passport applications to the automated issuance of parking fines based on license plate recognition. However, this trend raises critical questions about the role of supervision and the factors that regulators consider when developing regulations for AI systems.
The Misclassification of AI Technologies
One of the primary errors that supervisors make is mistakenly categorizing certain technologies as fully autonomous AI systems capable of learning and making decisions. For instance, when municipalities employ facial recognition technology for local passport applications, this technology is often misconstrued as an autonomous decision-making system. In reality, it functions similarly to a simple local check, akin to the facial recognition capabilities found on smartphones. The government can legally use biometric data from passports for this purpose, yet this does not involve the deep learning capacities commonly associated with AI.
Similarly, when municipalities apply AI for issuing parking fines, the technology in use often involves limited image recognition capabilities. The AI that scans license plates typically operates under strict regulations, where if a vehicle is not in compliance, a fine is automatically issued. This system does not encapsulate the broader issues of AI ethics and accountability; rather, it relies on rigid rules that dictate outcomes without room for nuanced, intelligent decision-making.
The Dangers of Autonomy in AI
The potential for harm becomes significant when we consider scenarios where AI systems are deployed to assess welfare benefits applications. If such systems were to incorporate facial recognition as part of their evaluation process, this could lead to severe ethical issues, including biased decision-making and a lack of transparency. Here we encounter the core argument: we should be focusing not solely on the technology itself but on the effects it has on individuals and communities.
The Need for a Shift in Focus
To effectively regulate AI, it is essential to shift the conversation from technology-focused discussions to examining the societal effects of these tools. A framework that prioritizes Fairness, Accountability, Transparency, and Ethics (FATE) serves as a foundational philosophy toward responsible AI deployment. By evaluating AI systems through the lens of FATE, regulators can better understand the implications of data use while ensuring that the interests of those affected are safeguarded.

Data as a Resource with Ethical Implications

In the realm of AI, data serves as the raw material upon which these technologies depend. As such, it is crucial to analyze how the data used in AI systems is sourced, handled, and maintained. Are ethical considerations embedded in the process? Are there measures in place to ensure fairness and accountability in the data that informs algorithmic decisions?
By applying FATE principles to the data utilized for AI, we can cultivate a more nuanced understanding of its impact. This approach enables regulators to not only hold developers accountable but also ensure that ethical considerations are woven into the fabric of AI technology from the outset.

Conclusion

The regulation of AI technologies requires a fundamental rethinking of priorities. Supervisors must move beyond a narrow focus on technology as the core aspect of regulation and instead center discussions on the effects of AI on society. By embracing an ethical framework and scrutinizing data practices, we can create a regulatory environment that promotes responsible AI use—one that protects individuals while fostering technological innovation. The task is not just about managing technology; it is about ensuring that advancements in AI contribute positively to society as a whole.


References

  1. NRC, 19 juli 2024, https://www.nrc.nl/nieuws/2024/07/18/regelgevers-en- toezichthouders-proberen-achter-de-innoverende-ai-bedrijven-aan-te-racen- a4860120

Associative memory as driver for innovation

Understanding Large Language Models: Thoughts on Their Creation, Functionality, and the Rise of Smaller Models
bb688d0c-74b6-489d-bf5f-50d8841f1662
Large language models (LLMs) have primarily been created using brute force approaches, leveraging vast amounts of data and computational power. Their emergent capabilities have surprised many within the field, prompting organizations such as OpenAI to release their models publicly at an early stage, responding to the unexpected effectiveness of these systems.
Despite their success, our understanding of LLMs' internal workings remains incomplete. I posit that these models operate analogously to the associative memory processes inherent in the human brain. Just as our brains form connections based on experiences and knowledge—where one idea or concept can evoke another—neural networks, through their architecture and training on vast datasets, mimic this associative thinking. The underlying mechanisms of LLMs enable them to draw inferences and generate text based on patterns recognized during training, akin to how humans recall related memories or concepts when prompted with a stimulus.
This analogy not only illustrates the potential for processing language but also highlights gaps in our comprehension of how these models function. Accepting that LLMs mirror some aspects of human associative memory opens numerous avenues for exploration. It suggests that there is significant potential for improvement—this includes optimizing larger models and, importantly, developing smaller, more efficient architectures that can achieve similar degrees of performance.

In recent trends supporting this shift, OpenAI has released GPT-4o mini, a smaller variant of GPT-4o. This model has made headlines as the best small model available, even surpassing competitive models like Anthropic's Claude 3 Haiku and Google's Gemini Flash on some benchmarks. Remarkably, this efficiency comes at a fraction of the cost, priced at just 15 cents per million input tokens and 60 cents per million output tokens, demonstrating a powerful trend towards creating AI models that are not only smaller but also faster and cheaper.

The movement towards smaller models reflects the reality that early AI systems were underoptimized, leading to excessively high operational costs. As noted, GPT-4o mini is more than 60% cheaper than its predecessors while delivering significantly improved performance. This rapid evolution reaffirms that the AI industry can produce models that, once considered exorbitantly priced, could have been optimized much earlier.

The associative memory aspect of these models may play a crucial role in their efficiency. By drawing on a vast web of relationships between data points, LLMs can respond more swiftly and accurately, reflecting the way human memory retrieves relevant information based on associative links. This capability allows smaller models to take advantage of increased efficiency, focusing on the most relevant connections rather than necessitating the sheer computational weight of their larger counterparts.

As we consider these advancements, we must acknowledge a changing landscape wherein a few key players—often referred to as FAANG (Facebook, Apple, Amazon, Nvidia, Google) plus Microsoft—control not only the most powerful models but also the essential distribution channels through which these technologies reach consumers. This reality highlights a critical aspect of today's AI market: it is not a democratization of technology that is emerging, but rather a consolidation of power among a select few companies.

OpenAI, the primary developer of models like GPT-4o, operates within this ecosystem, standing alongside competitors such as Google and Anthropic, who similarly control both large and smaller AI models. Their dominance raises questions about the future of competition in the AI field. While many hoped for a shift that would allow smaller companies to unseat these giants, the reality is that these established entities have proven resilient in maintaining their positions.

The mechanisms through which AI is now integrated into everyday technology further cement this trend. Major companies like Microsoft and Google are capitalizing on their existing distribution channels, seamlessly incorporating AI models into widely used services like Office and Workspace. As such, consumers are unlikely to turn to alternative, smaller providers for AI solutions; instead, they will engage with the technology offered by the leading players, reinforcing the oligopolistic structure of the market.

I conclude that LLMs signify a remarkable convergence of technological advancement and market dynamics. While there remains a path for innovation and optimization— which includes the development of powerful yet cost-efficient smaller models like GPT-4o mini—the surrounding industry landscape is increasingly dominated by large corporations. The real challenge moving forward will be navigating these complexities, ensuring that advancements in AI technology reflect the associative processes of human cognition, and ultimately providing benefits to a broader array of stakeholders, rather than perpetuating existing hierarchies.

Embracing Vulnerability and Softness

Embracing Vulnerability and Softness in the Era of Gen/AI Developments with a Socio- Ethical and Socio-Technical Lens
My unwavering commitment to embracing vulnerability and softness in modern organizational life extends beyond personal growth and innovation to encompass a broader socio-ethical and socio-technical perspective on Gen/AI developments. In navigating the complex landscape of advancing technologies and evolving social structures, I hold firm to the belief that integrating principles of authenticity, empathy, and inclusivity is fundamental in shaping the responsible and human-centric use of AI technologies.
In the realm of Gen/AI developments, where algorithms and intelligent systems blur the lines between human cognition and machine intelligence, a socio-ethical viewpoint underscores the importance of considering the societal implications and ethical considerations of AI applications. By infusing AI systems with the values of vulnerability, transparency, and ethical decision-making, we can create technologies that not only enhance efficiency but also prioritize human well-being, fairness, and social justice.
From a socio-technical perspective, the integration of vulnerability and softness in AI design and implementation acknowledges the intricate interplay between technology and society. Recognizing that technology is embedded within social contexts, I advocate for a holistic approach that considers the diverse needs, values, and perspectives of individuals and communities impacted by AI innovations. By fostering collaborations between technologists, ethicists, policymakers, and community stakeholders, we can co- create AI solutions that address complex sociotechnical challenges and foster trust and transparency in AI deployment.
The philosophy of "vanuit kracht kies ik voor kwetsbaarheid en zachtheid" guides my actions in engaging with Gen/AI developments through a socio-ethical and socio- technical lens. By engaging in critical dialogues, advocating for responsible AI practices, and promoting diversity and equity in AI development, I strive to contribute to a more inclusive and human-centered technological ecosystem that empowers individuals and communities while upholding ethical standards and societal values.
In embracing vulnerability and softness within the realm of Gen/AI developments, I invite you to join me in exploring the intersection of technology, ethics, and society, and charting a path towards a future where technology serves as a force for positive social change and collective well-being.
Visit www.grio.nl to delve deeper into my perspectives on vulnerability, softness, and the socio-ethical dimensions of AI technologies in modern organizational life.

About Cybernetics

I think in the developing era of AI it needs a broader view. We need to become Systems Thinkers to keep up with the newest developments. We need to opt our educational system and rethink the needed competences.

Cybernetics is an interdisciplinary field of study that focuses on the theory, design, and application of communication, control, and feedback mechanisms in both natural and artificial systems. It was first introduced by Norbert Wiener in his 1948 book "Cybernetics: or Control and Communication in the Animal and the Machine."

The core concepts of cybernetics include feedback loops, information theory, communication, control systems, and self-organization. These ideas are applied across various fields such as engineering, biology, psychology, sociology, economics, and computer science. Cybernetics aims to understand how complex systems maintain stability or adapt over time by analyzing the flow of information within these systems.

Some key areas in cybernetics include:

1. Control Systems: The study of feedback mechanisms that help regulate a system's behavior towards achieving a desired outcome, such as thermostats and autopilots.
2. Communication Theory: Understanding how information is encoded, transmitted, and decoded within systems, which forms the basis for modern communication technologies like telephones, radios, and computers.
3. Artificial Intelligence (AI) and Robotics: Applying cybernetic principles to create intelligent machines capable of learning, adapting, and making decisions based on their environment or input data.
4. Biological Systems Analysis: Studying how living organisms maintain stability and adapt through feedback mechanisms in physiological systems like the human body's homeostasis regulation.
5. Social Cybernetics: Examining social systems, organizations, and societies using cybernetic principles to understand their structure, communication patterns, decision-making processes, and self-regulation capabilities.

Cybernetics has had a significant impact on the development of modern technology and our understanding of complex systems. It has contributed to advancements in fields such as artificial intelligence, robotics, computer science, engineering, and even influenced social theories like systems thinking and complexity theory.

seanfielding_Cybernetics_is_an_interdisciplinary_field_of_study_30eb1a4c-2108-48b6-a9eb-bbafc58547c3

Tale of two organizations

The Paradox of Complexity: A Tale of Machine Learning in Tech Giants

In the bustling metropolis of Silicon Valley, nestled among the giants of technology, there existed a world of relentless innovation and fierce competition. In this world, the biggest players – Facebook, Google, Amazon, and others – were engaged in a constant battle to outdo each other in the realm of artificial intelligence and machine learning.

At the heart of this quest was a fundamental dilemma: the allure of building custom, intricate machine learning models versus the pragmatic need for standardization and simplicity. This story unfolds in two contrasting organizations, each representing a different approach to this quandary.

The Labyrinth of Complexity

In one corner stood Organization A, a composite of tech giants renowned for their custom-built AI solutions. They prided themselves on their ability to craft sophisticated, bespoke models tailored to each nuanced problem. Their corridors buzzed with the talk of the latest algorithms and cutting-edge techniques.

However, this pursuit of complexity came at a cost. The more intricate the models became, the heavier the burden they carried in terms of technical debt. Each custom solution was a masterpiece, but together, they formed an intricate labyrinth that few could navigate. The lack of standardization led to a chaotic environment where traceability, reproducibility, and transparency were often sacrificed.

The Perils of Innovation

Organization A's obsession with custom models began to show cracks. Projects that initially promised revolutionary outcomes stumbled under their own complexity. The pursuit of the perfect algorithm often led to overlooking the broader picture, resulting in solutions that were brilliant in theory but faltered in practice.

In the highly regulated realms of finance, healthcare, and public services, the absence of clear, reproducible methods began to raise concerns. The inability to trace decisions made by these AI systems became a significant liability, leading to mistrust and skepticism among stakeholders.

The Alternative Path

Meanwhile, Organization B, representing the other side of the tech giants, approached the problem differently. They understood the allure of custom models but recognized the pitfalls of excessive complexity. Their philosophy was grounded in finding a balance between innovation and pragmatism.

Organization B embarked on a journey to experiment with a variety of tools and methods. Their goal was not to build the most intricate models but to find algorithms and workflows that could be standardized, ensuring minimal technical debt. This approach fostered an environment where innovation was encouraged, but not at the expense of clarity and manageability.

The Rise of Standardization

As time passed, the merits of Organization B's approach became evident. Their AI solutions, while not always as bespoke as those of Organization A, were robust, traceable, and reproducible. They could easily adapt to regulatory changes and were more transparent in their decision-making processes.

The tech community began to take note. The narrative shifted from glorifying complexity to valuing efficiency and reliability. Organization B's AI systems were not just tools for the present; they were sustainable solutions for the future.

The Lesson Learned

The tale of these two organizations served as a parable in the world of AI and machine learning. It highlighted the crucial balance between innovation and practicality. While the allure of building custom, complex models was undeniable, the long-term success in the tech world required a thoughtful approach to standardization and simplicity.

In the end, the giants of Silicon Valley learned that in the intricate dance of technology, sometimes the most powerful step is the one taken with caution and foresight.
July 2024
April 2024
January 2024
April 2023
January 2020