Intended audience: Social Impact Professionals
Looking for more? This field is constantly changing, but here are some resources that DataKind finds particularly useful for social impact organizations considering using Generative AI.
DataKind’s perspective on GenAI use for the social sector:
- Webinar series: DataKind introduces GenAI in February 2023 and then shares about A Year of GenAI Learning as of February 2024, and finally on GenAI in Action at Nonprofits April 2024
- Report on GenAI for humanitarians (DataKind’s Head of Data Science contributed to this)
- WEF Data Equity: Foundational Concepts for Generative AI (DataKind’s CEO contributed to this)
- AI for humanitarians (DataKind’s CEO contributed to this)
- Find all technical blogs of DataKind’s GenAI project work on Medium here
- Project work example: a summary of our humanitarian data insights project report on GenAI research
- DataKind’s internal policy for Generative AI
Example social sector solutions:
- ICTworks answer bot
- An AI tool with curated content for nonprofits: https://www.nonprofitama.ai (and an interview with the founder)
- Open-access LLM fine-tuned for Swahili
- 2 GenAI chatbox solution examples for nonprofits
- Chatbot resources from the Engine Room
- Use cases in Indonesia
- GenAI transforms crisis management
- AI for paid parental leave
- Using NLP to detect mental health crises
- Examples from Fast Forward labs on how AI is being used for humanity (links to various media sources)
- Development \& Humanitarian GenAI tools directory
- Social impact chatbot database
Defining terms:
Understanding the challenges:
- LLM challenges and applications
- Evaluation of trustworthiness of LLMs from HAI
- On the opportunities \& risks of transformer models
- Biden’s executive order for AI safety
- LLM security flaw is no easy fix - WIRED
- [Academic paper] On the Dangers of Stochastic Parrots | Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency
- [Non-technical blog post] Risks and ethical considerations of generative AI
- [Video] AI Dilemma (and counterpoint to AI Dilemma)
- Is meaningful participation and accountability in AI possible?
- Why AI needs a nutrition label
Understanding the opportunities:
- [Video] Generative AI in a Nutshell
- [Video] Andrew Ng: Opportunities in AI - 2023
- [Technical blog post] Explainable AI: Visualizing Attention in Transformers
- Mckinsey’s research on Generative AI and the Future of Work in America
- Funders for GenAI for social impact
- Deploying GenAI in the Real World (global health)
Guidelines on responsible AI for nonprofits:
- Responsible AI framework selection matrix
- The Equitable AI Playbook
- Simple steps for responsible AI adoption for nonprofits
- DRAFT responsible GenAI framework from Dataiku
- [Non-technical blog post] Embedding controls and risk mitigations throughout the generative AI development lifecycle
- 7 Ethical Considerations When Implementing AI at Nonprofits
- Acceptable use of AI tools in nonprofit workforce
- 10 ways to help your organization manage the pain of AI adoption
- Advanced AI evaluation at AISI
- AI framework for an equitable world from NTEN
Technical Papers and Articles on responsible AI:
- Fair ML book
- Paper that takes a more human approach to creating fair algorithms
- An overview of all the different points where bias could enter the machine learning life cycle
- How to make transparent the effects of protected attributes on machine learning algorithms
- Red teaming with LLMs
- Testing framework utilizing the idea of unit tests for LLMs
- Privacy
- How we tend to fall into traps because we don’t think of systems sociotechnically
Tools:
- Fun blog on GenAI tools for USAID
- Foundation model transparency index from Stanford
- Getting started with creating custom versions of ChatGPT: GPTs and GPT store
- Fairlearn: Responsible AI tool
- IBM’s responsible AI tool for traditional ML
- Ethics checklist for machine learning development
Governance:
- AI Localism for Effective Governance
- [Academic paper] Do Foundation Model Providers Comply with the Draft EU AI Act?
Language:
Social program evaluation:
- Prompt Engineering for MERL: tips and cautions
- AI assistant for survey researchers
- How Language Models help evaluators tell better stories
- What’s next for emerging AI in evaluation?
- AEA’s New Directions for Evaluation Journal’s special edition on Evaluation and Artificial Intelligence
- 3 blog series from the World Bank on evaluating evaluation use cases
Proposal writing:
Education sector:
- The AI Divide Equitable Applications of AI in Higher Education to Advance the Completion Agenda
- Attainment with AI Making a Real Difference in College Completion with Artificial Intelligence
- Why Teacher Intelligence Will Always Matter More Than Artificial Intelligence
Going deeper on AI:
- [[TED talk] The magical AI assistants of the future and the engineering behind them](https://www.ted.com/talks/harrison_chase_the_magical_ai_assistants_of_the_future_and_the_engineering_behind_them)
- State of AI report in slide deck form
- [[Textbook] Generative Deep Learning, 2nd Edition [Book]](https://www.oreilly.com/library/view/generative-deep-learning/9781098134174/)
- Blog on mitigating hallucinations
- Paper on extracting structured data from unstructured documents using LLMs (which DataKind has done with PDF to data dictionary for IMF) with new benchmark and Chain of Thought (CoT) technique to improve results
- Microsoft open source framework “that enables development of LLM applications using multiple agents that can converse with each other to solve tasks” (examples here)
- Learning From Mistakes Makes LLM Better Reasoner
- Levels of AGI by Google DeepMind
- State of reasoning in LLMs (some of the latest techniques in prompting)
- Building Full Stack Apps with AI Agents
- Compound AI systems (Berkeley)
Safety solutions
- Tools for controlling LM outputs: Guardrails, LMQL, and SGLang
- Inference strategies to generate better outputs using calls to models and tools: chain-of-thought, self-consistency, WikiChat, RAG
- Red teaming AI: the devil is in the details
- Validating qualitative analysis done by GenAI
- Retrieval-augmented Generation Realized: Strategic \& Technical Insights for Industrial Applications
Please see other “scoping” articles for social impact organizations, just like seen at the bottom of the page here: https://datakind.github.io/scoping.html
Contributer(s): Rachel Wells with help from John Harnisher, Matt Harris, Lindsey Washburn, Kathleen Yaworsky
Contact us
If you would like to learn more about us, partner with us, or get in touch, visit our website or email community@datakind.org.
Subscribe