Do Generative Artificial Intelligence Company Strategies of ‘Moving Fast and Breaking Things’ in Civil Society Cancel Their Social Licence to Operate? A Nurse’s Evaluation of Chatbot Impacts

Authors

  • Tracey McDonald International Nursing Review, Sydney, NSW, Australia

DOI:

https://doi.org/10.60099/prijnr.2024.268964

Keywords:

Artificial intelligence, Chatbot, Corporate citizenship, Environmental sustainability, Generative artificial intelligence, Machine learning, Nursing values, Nursing, Social institutions, Social license to operate, Social well-being, Trust deficit

Abstract

A rapid expansion of the computer technology industry, particularly in the field of artificial intelligence, has ignited a global concern that warrants our immediate action. As nurses, our professional values frameworks compel us to protect public health and address national and global health issues. When industry activities adversely affect the social wellbeing of civil society and social institutions, it is important to evaluate them against their industry’s ‘social license to operate, which is a measure of public trust, credibility, and the legitimacy of their industrial and corporate citizenship status. The central question is, do computer technology companies continue to have a social license to operate in civil society? Nurses are encouraged to evaluate the computer technology industry’s recent ‘generative artificial intelligence’ chatbot activities against its tacit undertaking to be good corporate citizens in return for social acceptance of their operations and behaviour. An evidence-based overview of chatbot impacts on societies, environmental sustainability and human rights provide a basis for evaluation. Basic computer technology terminology and relevant concepts are explained.

This article is a direct call to action for clinical nurses and those involved in research, education, management, and policy. We have a duty to critically assess the claims made by chatbot technology vendors in both practice and social contexts. If these vendors integrate chatbot technologies with existing machine learning used in nursing and healthcare technologies it could result in detrimental effects beyond user control. By influencing decisions on technology adoption, we can ensure the implementation of safeguards, protect patient safety and social well-being, and uphold the integrity of nursing values. A closing discussion of impacts of computer industry trust deficits on healthcare and research reflects the author’s concerns and conclusions about the central question. Readers may draw other conclusions and perhaps use the issues and evidence presented here to stimulate further investigations.

References

Clarke-Darrington J, McDonald T, Ali P. Digital capability: an essential nursing skill for proficiency in a post-COVID-19 world. Int Nurs Rev. 2023 Sep;70(3):291-6. doi: 10.1111/inr.12839. DOI: https://doi.org/10.1111/inr.12839

McDonald T, Russell F. Impact of technology-based care and management systems on aged care outcomes in Australia. Nurs Health Sci. 2012;14(1):87–94. doi: 10.1111/j.1442-2018.2011.00668.x. DOI: https://doi.org/10.1111/j.1442-2018.2011.00668.x

The Ethics Centre (Australia). Ethics explainer: social license to operate [Internet]. 2018 Jan 23 [cited 2024 Apr 25]. Available from: https://ethics.org.au/ethics-explainersocial-license-to-operate/

Komnitsas K. Social license to operate in mining: present views and future trends. Resources. 2020;9(6):79. doi:10.3390/resources9060079. DOI: https://doi.org/10.3390/resources9060079

Kenton W, Potters C. Social license to operate (SLO): definition and standards. Investopedia, Dotdash Meridith [Internet]. 2023 Sept 26 [cited 2024 Apr 25]. Available from: https://www.investopedia.com/terms/s/sociallicense-slo.asp

Leone N, Batey S. Generative AI and the legal landscape: evolving regulations and implications. VentureBeat [Internet]. 2023 Oct 14 [cited 2024 Apr 25]. Available from: https://venturebeat.com/ai/generative-aiand-the-legal-landscape-evolving-regulations-andimplications/

Dickson B. How generative AI is making robots smarter, more capable, and more ready for the mainstream. VentureBeat [Internet]. 2023 Oct 24 [cited 2024 Apr 25]. Available from: https://venturebeat.com/ai/how-generative-ai-is-making-robots-smarter-more-capable-and-more-ready-for-the-mainstream/

Bratton L, Nguyen B. AI has a lot of terms. We’ve got a glossary for what you need to know. Generation AI [Internet]. 2024 Apr 21 [cited 2024 Apr 25]. Available from: https://qz.com/ai-artificial-intelligence-glossary-vocabulary-terms-1851422473

Thillainathan A. The AI frenzy could fall flat as companies hoard chips without enough data centers to host them. Fortune [Internet]. 2024 Apr 25 [cited 2024 Apr 27]. Available from: https://fortune.com/2024/04/24/the-ai-frenzy-could-fall-flat-as-companies-hoard-chips-without-enough-data-centers-to-host-them/

Beres D. The languages AI is leaving behind. The Atlantic [Internet]. 2024 Apr 19 [2024 Apr 27]. Available from: https://www.theatlantic.com/newsletters/archive/2024/04/the-languages-ai-is-leaving-behind/678125/?utm_source=apple_news

Shaik T, Tao X, Higgins N, Li L, Gururajan R, Zhou X, Acharya UR. Remote patient monitoring using artificial intelligence: current state, applications, and challenges. WIREs Data Mining Knowl Discov. 2023;13(2):e1485. doi: 10.1002/widm.1485. DOI: https://doi.org/10.1002/widm.1485

Tursunbayeva A, Renkema M. Artificial intelligence in healthcare: implications for the job design of healthcare professionals. Asia Pac J Hum Resour. 2023;61(4):845-87. doi: 10.1111/17447941.12325. DOI: https://doi.org/10.1111/1744-7941.12325

Taplin J. Move fast and break things: how Facebook, Google, and Amazon cornered culture and undermined democracy. New York: Atlantic/Little, Brown; 2017. 320 p. Available from: https://dl.acm.org/doi/abs/10.5555/3154007

Spitznagel E. The Internet never forgets. Popular Mechanics [Internet]. 2019 Nov 1 [2024 Apr 25]. Available from: https://www.popularmechanics.com/culture/web/a29656205/internet-public-shaming/

Vanian J, Leswing K. ChatGPT and generative AI are booming, but the costs can be extraordinary. CNBC [Internet]. 2023 Apr 17 [cited 2024 Apr 25]. Available from: https:// www.cnbc.com/2023/03/13/chatgpt-and-generative-ai-are-booming-but-at-a-very-expensive-price.html

Vanliew J. These prisoners are training AI. WIRED [Internet]. 2023 Sept 11 [cited 2024 Apr 25]. Available from: https:// www.wired.com/story/prisoners-training-ai-finland/

Duffin M. Exploring the role of labelled data in machine learning. VentureBeat [Internet]. 2023 Oct 29 [cited 2024 Apr 25]. Available from: https://venturebeat.com/ai/exploring-the-role-of-labeled-data-in-machine-learning/

Albergotti R. New synthetic data techniques could change the way AI models are trained. Semafor [Internet]. 2023 Nov 4 [cited 2024 Apr 25]. Available from: https://www.semafor.com/article/11/03/2023/new-synthetic-data-techniques-could-change-the-way-ai-models-are-trained

Goldman S. MIT, cohere for AI, others launch platform to track and filter audited AI datasets. VentureBeat [Internet]. 2023 Oct 23 [cited 2024 Apr 25]. Available from: https://venturebeat.com/ai/mit-cohere-for-ai-others-launch-platform-to-track-and-filter-audited-ai-datasets/

Heikkilä M. This new data poisoning tool lets artists fight back against generative AI. MIT Technol Rev [Internet]. 2023 Oct 23 [cited 2024 Apr 25]. Available from: https://www.technologyreview.com/2023/10/23/1082189/data-poisoning-artists-fight-generative-ai/

Harrison M. Google’s SGE search AI is devouring false AI-generated info and saying it’s true. Futurism [Internet]. 2023 Aug 16 [cited 2024 Apr 25].Available from: https://futurism.com/google-sge-false-ai-generated-info

Van Hautte J. The race for human-AI interaction usage data is on—and the stakes are high. Fortune [Internet]. 2024 Apr 25 [2024 Apr 25]. Available from: https://fortune.com/2024/04/24/artificial-intelligence-ai-interaction-usage-data-big-tech-advantage/

Masse B. Canadian government seeks input on voluntary code of practice for generative AI. VentureBeat [Internet]. 2023 Aug 16 [cited 2023 Nov 16]. Available from: https://venturebeat.com/ai/canadian-government-seeks-input-on-voluntary-code-of-practice-for-generative-ai/

Samuels M. Companies aren’t spending big on AI. Here’s why that cautious approach m akes sense. ZDNET [Internet]. 2023 Oct 29 [cited 2023 Nov 16].Available from: https://www.zdnet.com/article/companies-arent-spending-big-on-ai-heres-why-that-cautious-approach-makes-sense/

Rosenberg S. Generative Ai is still a solution in search of a problem. AXIOS [Internet]. 2024 Apr 24 [cited 2024 Apr 26]. Available from: https://www.axios.com/2024/04/24/generative-ai-why-future-uses

Tangermann V. Report: Thanks to AI, China’s data centers will drink more water than all of South Korea by 2030. Futurism [Internet]. 2024 Apr 20 [cited 2024 Apr 26]. Available from: https://futurism.com/the-byte/chinas-ai-centers-drink-water-south-korea-2030

Claman J. A wake-up call for sustainable AI data centers. Crunchbase news [Internet]. 2024 Apr 25 [cited 2024 Apr 26]. Available from: https://news.crunchbase.com/ai/sustainable-data-centers-semiconductors-claman-accelsius/

Tangermann V. AI’s electricity use is spiking so fast it’ll soon use as much power as an entire country. Futurism [Internet]. 2023 Nov 10 [cited 2024 Apr 25]. Available from: https://futurism.com/the-byte/ai-electricity-use-spiking-power-entire-country

Hetzner C, Badani A. AI could gobble up a quarter of all electricity in the US by 2030. Fortune [Internet]. 2024 Apr 16 [cited 2024 Apr 25]. Available from: https://fortune.com/2024/04/16/ai-chatgpt-sora-large-language-models-arm-chips-semiconductors-electricity/

Abnett K, Jessop S. UN climate chief says two years to save the planet. Reuters. 2024 Apr 10 [cited 2024 Apr 25]. Available from: https://www.reuters.com/world/un-climate-chief-says-two-years-save-planet- 2024- 04-10/

Atwoli L, Baqui, AH, Benfield T, Bosurgi R, Godlee F, Hancocks S, Horton RC, Laybourn-Langton L, Monteiro CA, Norman I, Patrick K, et al. Call for emergency action to limit global temperature increases, restore biodiversity, and protect health. Nutr Rev. 2021;79(11):1183-5. doi: 10.1093/nutrit/nuab067. DOI: https://doi.org/10.1093/nutrit/nuab067

Al-Sibai N. ChatGPT is consuming a staggering amount of water. Futurism [Internet]. 2023 Apr 20 [cited 2024 Apr 25]. Available from: https://futurism.com/the-byte/chatgpt-ai-water-consumption

Coldewey D. Too many models. TechCrunch [Internet]. 2024 Apr 20 [cited 2024 Apr 25]. Available from: https://techcrunch.com/2024/04/19/too-many-models/

World Economic Forum. The future of JOBS report [Internet]. 2023 Apr 30 [cited 2024 Apr 25]. Available from: https://www.weforum.org/reports/the-future-of-jobs-report-2023/

Browne R. Calls for AI regulations to protect jobs rise in Europe after ChatGPT’s arrival. CNBC [Internet]. 2023 Oct 11 [cited 2024 Apr 25]. Available from: https://www.cnbc.com/2023/10/11/most-europeans-want-government-restrictions-on-ai-says-study.html

Peterson J. AI companies are running out of Internet. LifeHacker [Internet]. 2024 Apr 4 [cited 2024 Apr 26]. Available from: https://www.lifehacker.com.au/2024/04/ai-companies-are-running-out-of-internet/

Grothaus M. Is the ‘Dead Internet’ theory suddenly coming true? This could be a sign. Fast Company [Internet]. 2024 Apr 16 [cited 2024 Apr 25]. Available from: https://www.fastcompany.com/91092650/dead-internet-theory-true-tiktok-ai-influencers

Mitchell S. Half of online traffic in 2024 generated by bots, report finds. SecurityBrief UK [Internet]. 2024 Apr 18 [cited 2024 Apr 26]. Available from: https://securitybrief.co.uk/story/half-of-online-traffic-in-2024-generated-by-bots-report-finds

Goodin D. Millions of IPs remain infected by USB work years after its creators left it for dead. Ars Technica [Internet]. 2024 Apr 26 [cited 2024 Apr 26]. Available from: https://arstechnica.com/security/2024/04/zombie-worm-continues-to-infect-millions-of-ips-years-after-it-was-left-for-dead/

Ding W, Levine R, Lin C, Xie W. Competition laws, ownership and corporate social responsibility. J Int Bus Stud. 2022; 53:1576-602. doi: 10.1057/s41267-022-00536-4. DOI: https://doi.org/10.1057/s41267-022-00536-4

Gartner. The Gartner hype cycle. Gartner Post [Internet]. 2023 [cited 2024 Apr 25]. Available from: https://www.gartner.com.au/en/methodologies/gartner-hype-cycle

Milmo D, Helmore E. Humanity at risk from AI ’race to the bottom’, says tech expert. Guardian Australia [Internet]. 2023 Oct 26 [cited 2024 Apr 25]. Available from: https://www.theguardian.com/technology/2023/oct/26/ai-artificial-intelligence-investment-boom

Marr B. Navigating the generative AI divide: open-source vs closed-source solutions. Forbes [Internet]. 2024 Apr 22 [cited 2024 Apr 28].Available from: https://www.forbes.com/sites/bernardmarr/2024/04/22/navigating-the-generative-ai-divide-open-source-vs-closed-source-solutions/?sh=40bc499365b2

Thalen M. Harvard bro sparks immediate backlash with new ‘SmashOrPassAI’ site, where users rate AI-generated women. Daily Dot [Internet]. 2023 Sept 5 [cited 2024 Apr 25]. Available from: https://www.dailydot.com/debug/smashorpassai-backlash/

Vittert L. AI girlfriends are ruining an entire generation of men. The Hill [Internet]. 2023 Sept 26 [cited 2024 Apr 25]. Available from: https://thehill.com/opinion/technology/4218666-ai-girlfriends-are-ruining-an-entire-generation-of-men/

Nachiappan A. WormGPT: AI tool designed to help cyber criminals will let hackers develop attacks on a large scale. Sky News [Internet]. 2023 Sept 18 [cited 2024 Apr 25]. Available from: https://news.sky.com/story/wormgpt-ai-tool-designed-to-help-cybercriminals-will-let-hackers-develop-attacks-on-large-scale-experts-warn-12964220

Dell Technologies. The case for bringing generative AI on premises. VentureBeat [Internet]. 2023 Oct 4 [cited 2024 Apr 25]. Available from: https://venturebeat.com/ai/the-case-for-bringing-generative-ai-on-premises/

Gardner J. The real danger in AI. Mind Matters [Internet]. 2023 May 10 [cited 2024 Apr 25]. Available from: https://mindmatters.ai/2023/05/the-real-danger-in-ai/

Ryan-Mosley T. How generative AI is boosting the spread of disinformation and propaganda. MIT Technol Rev [Internet]. 2023 Oct 4 [cited 2024 Apr 25]. Available from: https://www.technologyreview.com/2023/10/04/1080801/generative-ai-boosting-disinformation-and-propaganda-freedom-house/

Schmelzer R. Understanding the layers of trustworthy AI. Forbes [Internet]. 2024 Apr 26 [cited 2024 Apr 26]. Available from: https://www.forbes.com/sites/cognitiveworld/2024/04/26/understanding-the-layers-of-trustworthy-ai/?sh=5072b8552aa6

Panch T, Mattie H, Celi LA. The “inconvenient truth” about AI in healthcare. NPJ Digit Med. 2019;2:77. doi: 10.1038/s41746-019-0155-4. DOI: https://doi.org/10.1038/s41746-019-0155-4

Dworkin J. AI-driven data analysis could exacerbate misaligned incentives in biomedical research. STAT News [Internet]. 2023 Sept 29 [cited 2024 Apr 25]. Available from: https://www.statnews.com/2023/09/29/ai-chatgpt-health-science-rigor-trust-biomedical-research/

Petersson L, Larsson L, Nygren JM, Nilsen P, Reed JE, Tyskbo D, Svedberg P. Challenges to implementing artificial intelligence in healthcare: a qualitative interview study with healthcare leaders in Sweden. BMC Health Serv Res. 2022;22(1):850. doi: 10.1186/s12913-022-08215-8. DOI: https://doi.org/10.1186/s12913-022-08215-8

Morley J, Machado C, Burr C, Cowls J, Taddeo M, Floridi L. The debate on the ethics of AI in health care: a reconstruction and critical review. SSRN [Internet]. 2019 Nov 13 [cited 2024 Apr 25]. Available from: https://papers.ssrn.com/sol3/papers.cfm?abstract_id=3486518 DOI: https://doi.org/10.2139/ssrn.3486518

Reddy S, Allan S, Coghlan S, Cooper P. A governance model for the application of AI in health care. J Am Med Inform Assoc. 2020;27(3):491-7. doi: 10.1093/jamia/ocz192. DOI: https://doi.org/10.1093/jamia/ocz192

Amann J, Blasimme A, Vayena E, Frey D, Madai VI; Precise4Q consortium. Explainability for artificial intelligence in healthcare: a multidisciplinary perspective. BMC Med Inform Decis Mak. 2020;20(1):310. doi: 10.1186/s12911-020-01332-6. DOI: https://doi.org/10.1186/s12911-020-01332-6

Huang S, Siddarth D. Generative AI and the digital commons. arXiv preprint [Internet]. 2023 Mar 20 [cited 2024 Apr 25]. Available from: https://arxiv.org/pdf/2303.11074.pdf

Downloads

Published

2024-08-31

How to Cite

1.
McDonald T. Do Generative Artificial Intelligence Company Strategies of ‘Moving Fast and Breaking Things’ in Civil Society Cancel Their Social Licence to Operate? A Nurse’s Evaluation of Chatbot Impacts. PRIJNR [Internet]. 2024 Aug. 31 [cited 2024 Oct. 13];28(4):689-706. Available from: https://he02.tci-thaijo.org/index.php/PRIJNR/article/view/268964

Issue

Section

Scholarly Paper

Categories