> For the complete documentation index, see [llms.txt](https://www.mlcompendium.com/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://www.mlcompendium.com/responsible-ai/fairness-accountability-and-transparency-in-prompts.md).

# Fairness, Accountability, and Transparency In Prompts

With large models, the prompt becomes both a source of bias and a tool for removing it, and the model can also state things that are simply untrue. This page first collects papers that debias models through prompts, then turns to LLM hallucinations.

The same notes are in [Fairness, Accountability, and Transparency](/responsible-ai/fairness-accountability-and-transparency.md).

## Debiasing using prompts

The debiasing methods on the previous page change the representation; the papers here change the prompt instead, across text, vision-language, and 3D generation.

In text, [MsPrompt: Multi-step Prompt Learning for Debiasing Few-shot Event Detection](https://arxiv.org/abs/2305.09335) targets event detection, identifying key trigger words and predicting event types, where data-hungry models suffer from the trigger bias that comes from ED datasets. [Auto-Debias: Debiasing Masked Language Models with Automated Biased Prompts](https://aclanthology.org/2022.acl-long.72.pdf) is the ACL 2022 long paper that does the same for masked language models.

Vision-language models inherit biases from uncurated datasets scraped from the internet, and those biases can be amplified and propagated to zero-shot classifiers and text-to-image generative models. [Debiasing Vision-Language Models via Biased Prompts](https://arxiv.org/abs/2302.00070) proposes a general approach to that problem, and [A Prompt Array Keeps the Bias Away: Debiasing Vision-Language Models with Adversarial Learning](https://arxiv.org/pdf/2203.11933.pdf) brings adversarial learning to it. The same idea reaches 3D in [Debiasing Scores and Prompts of 2D Diffusion for Robust Text-to-3D Generation](https://arxiv.org/pdf/2303.15413.pdf), listed on arXiv as view-consistent text-to-3D generation.

Before debiasing, the bias has to be measured. (good) [Understanding Stereotypes in Language Models: Towards Robust Measurement and Zero-Shot Debiasing](https://arxiv.org/pdf/2212.10678.pdf) does both; its arXiv entry now reads "Causally Testing Gender Bias in LLMs: A Case Study on Occupational Bias". Finally, the model can be asked to find its own bias: [Self-Diagnosis and Self-Debiasing: A Proposal for Reducing Corpus-Based Bias in NLP](https://direct.mit.edu/tacl/article/doi/10.1162/tacl_a_00434/108865).

## Hallucinations

A debiased answer can still be false, which is the last prompt-level failure on this page. (very good) [understanding LLM hallucinations](https://www.rungalileo.io/blog/deep-dive-into-llm-hallucinations-across-generative-tasks?utm_medium=email&_hsmi=304176203\&utm_content=303486713\&utm_source=hs_email) describes two types of LLM hallucinations and how they appear across different Natural Language Generation (NLG) tasks.


---

# Agent Instructions
This documentation is published with GitBook. GitBook is the documentation platform designed so that both humans and AI agents can read, navigate, and reason over technical content effectively. Learn more at gitbook.com.

## Querying This Documentation
If you need additional information that is not directly available in this page, you can query the documentation by asking a question.

Perform an HTTP GET request on the following URL with the `ask` and `goal` query parameters:

```
GET https://www.mlcompendium.com/responsible-ai/fairness-accountability-and-transparency-in-prompts.md?ask=<question>&goal=<user_goal>
```

`ask` is the immediate question: it should be specific, self-contained, and written in natural language.
`goal` is what the user is ultimately trying to achieve, the reason they need the answer. Sharing it helps GitBook give you a better, more relevant answer. A goal is most helpful when it describes the outcome the user wants rather than restating the question. For example, with `ask=how do I create an API token`, a goal like `automate deployments from our CI pipeline` lets GitBook tailor the answer to that use case.

The response will contain a direct answer to the question and relevant excerpts and sources from the documentation.

Use this mechanism when the answer is not explicitly present in the current page, you need clarification or additional context, or you want to retrieve related documentation sections.
