By Rachel Magaji
Technology makes work simpler and more convenient. That has been the mantra of many startups seeking to streamline work processes through emerging technologies like AI. We envision a future filled with automation, artificial intelligence, and biotechnology because, in the right hands, the possibilities seem limitless.
Product designers have been on the front lines, creating interfaces that connect people to these technologies. As Mike Monteiro mentions in his book “Ruined by Design,” designers are more than just a pair of hands; we are gatekeepers. Nothing should pass through without our labor and counsel. As a product designer, I enjoy solving problems and finding creative ways to navigate complex business challenges for African startups.
A win for designers is understanding that, as humans, we are part of a social contract to impact the people who interact with our work. However, with the recent launch of new AI products, it feels as though the world may be embracing a dystopian future, where product designers wield significant influence.
The Black Mirror Effect: Unintended Consequences
I recently began watching the Black Mirror series by Charlie Brooker on Netflix. I felt a chill when I recognized some of its fictional technology as something emerging in real life. Could this be a glimpse into the future of our inventions? Black Mirror is often seen as a cautionary tale, highlighting the dangers of an unethical relationship between humans and technology. Yet, whenever an AI startup unveils a new product, it’s hard not to wonder if the show serves as a warning or an inspiration.
The line between science fiction and reality is continuously fading as new products hit the market daily. Autonomous vehicles are being developed by companies like Tesla and Google, and soon, scientists may solve the final puzzle for uploading human consciousness to the cloud.
As interesting as this progress is, a sublime fear remains. Will we face an AI apocalypse? Will the wealth gap widen? What ethical boundaries will emerge around data privacy? How will we handle issues like information manipulation and misinformation?
Throughout history, we’ve designed solutions that eventually return to haunt us, causing new problems. Internal Combustion Engines (ICE) revolutionized transportation, yet now we face climate change as a consequence. Similarly, while AI brings about countless benefits, it also raises the potential for unintended outcomes.
In the Black Mirror episode Joan is Awful, the character Joan discovers Salma Hayek portraying her in a show based on her real life, illustrating the dangers of deepfakes. As AI technology advances, misinformation’s potential impact on the economy, society, and politics grows. For instance, in early 2023, a fake image of an explosion near the Pentagon went viral online, briefly causing the stock market to plummet.
Ethical Foresight in Product Design
In his blog, Carlos González De Villaumbrosia defines a designer as "the mastermind behind how a product looks, feels, and works." We play a crucial role in shaping behaviors and mindsets. However, dark patterns are becoming more frequent, making it increasingly difficult to define the designer’s role in preventing a dystopia.
We don’t take an oath like doctors, but it’s essential to follow a personal code of conduct in our work. We need to adopt strong moral standards and take responsibility for what we design. Empathy is a fundamental part of our identity, but many designers trade empathy for speed to iterate quickly.
Our primary role as designers is to remember our humanity and respect others. We owe it to ourselves to leave the world better than we found it. This means carefully considering the potential ramifications of our designs, even imagining worst-case scenarios. In 2016, Microsoft’s chatbot Tay, trained on Twitter to engage in casual conversation, and began posting offensive tweets within 24 hours. While we can’t predict every use of our innovations, strategic foresight can help us anticipate and mitigate potential issues.
A term that gained popularity in the Nigerian design community on Twitter is “Oga-centered design.” This happens when startup founders, often with little knowledge of user experience, shape product strategy and design without adequate research or external input. As designers, we have a duty to offer counsel, and evaluate the potential impact of our work. It’s okay to ask more clarifying questions and my favorite is saying NO! Because once a product is out there, the responsibility ultimately rests with the designer, not the employer.
Conclusion
A product designer is like Spider-Man, carrying the wisdom of Uncle Ben’s adage: “With great power comes great responsibility.” The reality we must confront is that AI is here to stay and will continue evolving. If used wisely, it could bring us closer to a utopian future. However, given human traits like greed, it’s also possible we’re already living in a dystopian reality. Designers have an ethical duty to ensure that our work avoids harm for both present and future generations.
© Rachel Magaji, 2024
Driven by a passion for design and innovation, Rachel Magaji is dedicated to helping businesses succeed through sustainable and user-centric solutions. With over four years of experience in the startup ecosystem, Rachel brings a unique blend of skills in empathy-driven design, human-computer interaction, and behavioural psychology. Currently, she is enhancing her expertise in business strategy and entrepreneurship through an MBA program at Quantic School of Business and Technology, to become a leader in the intersection of technology, foresight, and sustainability.
Comments