31
trillion dollars each year in lost productivity. At the same time, digital tools, including AI, can be accessed anywhere, by anyone. We need to be careful that the speed of innovation does not eclipse reality. Overpromising on benefits while downplaying risks can erode trust in AI’s potential and, more importantly, cause real harm if regulators fail to step in. There is risk of clinical dangers of unregulated products that may mishandle vulnerable users, and wider societal consequences of growing reliance on tools where safety standards are set by private companies rather than by governments or regulators. AI will undoubtedly play a role in the future of mental health care. The question is not whether it should be used, but how. Without clear standards, transparent regulation, and a focus on solving
While AI could transform mental health care for the better, there are significant risks, both in terms of the relevant capabilities and efficacies of the products and models themselves, and the wider cultural shifts towards an over- reliance on AI without rigorous ethical oversight. Studies and individual accounts show chatbots inventing false qualifications and mishandling disclosures of suicidal thoughts. Research has also linked heavy chatbot use with greater loneliness and even cognitive decline, as over- reliance on algorithmic responses erodes critical thinking. This underlines the dilemma we face with AI in mental health: the same tools that could transform mental health for the better, could also cause harm if left unchecked. The challenge is to balance ambition with responsibility, to harness AI as a tool for solving real problems while putting safeguards in place for risks, both known and emerging. What is Kooth doing to address these challenges? We aim to set a strong example so that high standards of safety, ethical development, and responsibility become the norm across AI development and digital mental health. We’ve demonstrated that digital mental health services can make a positive impact at scale. Our digital services offer moderated peer-support, self- guided tools, and professional
care – available free at the point of access to entire populations – with safeguards in place to ensure we can support people that need extra help. Importantly, our on-the-ground teams work closely with trusted local leaders in education, healthcare, not-for- profit and community settings to ensure that our services are trusted, equitable and reach those that need our help the most. Independent evaluation demonstrates that this approach works, with the ripple effects of improved wellbeing stretching beyond the individual to reduce pressure on other public services and address social challenges. We’re proud that Kooth is a clear example of how digital innovation can be delivered responsibly, at scale, and with measurable impact – putting the safety and wellbeing of our service users first, in everything we do.
real problems, enthusiasm risks outpacing evidence.
The eMHIC community is a great example of how we can work together to make the next technological revolution safer and more inclusive. We need action across borders, in partnership with citizens alongside public and private sector collaboration to ensure we harness the power of technology to build mentally healthier populations, leaving no-one behind.
The time is now to shape a technological revolution where safety comes first.
What do you see as the most important next steps? The demand for mental health support is rising everywhere, and so are the risks. The World Health Organization estimates that depression and anxiety cost the global economy around one
Made with FlippingBook Digital Publishing Software