Q 728. In what ways can prompt engineering reduce hallucination in generative AI, particularly when working with highly specialized domains? Explain with examples.

 

Note for website visitors -

• This platform hosts two weekly questions, one on Tuesday and the other on Friday. 
• All previous questions can be found here: https://www.benchmarksixsigma.com/forum/lean-six-sigma-business-excellence-questions/. 
• To participate in the current question, please visit the forum homepage at https://www.benchmarksixsigma.com/forum/.
• The question will be open until Tuesday or Friday at 5 PM Indian Standard Time, depending on the launch day. 
• Responses will not be visible until they are reviewed, and only non-plagiarised answers with less than 5-10% plagiarism will be approved. 
• If you are unsure about plagiarism, please check your answer using a plagiarism checker tool such as https://smallseotools.com/plagiarism-checker/ before submitting. 
• All correct answers shall be published, and the top-rated answer will be displayed first. The author will receive an honourable mention in our Business Excellence dictionary at https://www.benchmarksixsigma.com/forum/business-excellence-dictionary-glossary/ along with the related term.

• Some people seem to be using AI platforms to find forum answers. This is a risky approach as AI responses are error-prone because our questions are application-oriented (they are never straightforward). Have a look at this funny example - https://www.benchmarksixsigma.com/forum/topic/39458-using-ai-to-respond-to-forum-questions/

• We also use an AI content detector at https://quillbot.com/ai-content-detector. Only answers with less than 45-50% AI-generated content will be approved.

In the audit industry, where accuracy and adherence to standards are crucial, hallucinations can result in serious professional risks, such as providing incorrect interpretations of compliance standards or generating fictitious audit findings. Below is an example of how prompt engineering can help reduce hallucinations for internal audits:

 

Scenario: Drafting an Internal Audit Report

 

Suppose you want the AI to help draft an audit report for compliance with internal financial controls.

 

Generic Prompt:

 

“Generate an internal audit report for financial compliance.”

 

Potential Issue:

The model might fabricate findings, create generic observations, or misrepresent audit standards, leading to inaccuracies in the report.

 

Refined Prompt for Reduced Hallucination:

 

*“Draft an internal audit report for financial compliance based on the following observations:

1. Control over vendor payments was not followed in 20% of sampled transactions.

2. Reconciliations were delayed in three out of five months reviewed.

3. There were no deviations in payroll processing.

Include recommendations for improvement and ensure alignment with Section 134 of the Companies Act, 2013.”

 

Why It Reduces Hallucination:

• Context: The specific observations guide the model to focus on known audit findings.

• Framework: Referencing Section 134 of the Companies Act, 2013, ensures compliance with the relevant legal standards.

• Scope: Explicitly limiting the focus to the given findings avoids fabricated or irrelevant issues.

 

Prompt engineering can help reduce hallucinations in generative AI, basically in specialized domains, by carefully crafting questions to guide the AI towards more accurate and relevant responses.

Listed below are some effective strategies.

• By using specific context and constraints by providing clear context and constraints that helps the AI focus on relevant information.
• Applying chain-of-verification prompting which involves breaking down the task into smaller steps and verifying each part.
• Adding reflective prompting which encourages the AI to reflect on its response can improve accuracy.
• Using scenario-based prompting which helps with realistic scenarios can help the AI generate more accurate responses.

For instance, in the field of cybersecurity, we can begin questioning with, what are the most common types of cyber-attacks? After that, how do these attacks exploit vulnerabilities in cloud computing environments? This method helps AI and also helps AI provide more detailed and accurate information.

AI Hallucinations occur when LLM’s make up answers that are not factual. This mostly occurs when the model tries to be extra helpful by fabrication information when the model does not have a factual backing for the data presented. This also occurs when the model has not been trained on that topic.

Prompt engineering techniques focus on guiding models to produce truthful or factual data for any query. By refining these prompts, we can minimize the number of hallucinations produced by AI and increase the overall performance of the AI system. Some of the practices we can follow to reduce hallucinations ae listed below.,

 

1)      Give clear and precise prompts avoiding ambiguity that may provide irrelevant output

2)      Explicitly state the context with some additional background information

3)      Break down the tasks into smaller manageable steps ensuring that AI models understand it easily

4)      If need arises specify the output format required for the answer

5)      Incorporate examples to get the desired output

6)      Ask the model to differentiate between factual vs speculative answers

7)      Ask the model to prove the references for the source of the information and prove its limits or in simpler terms ask the model to validate its own responses

8)     Usage of domain specific terminology also helps to align responses reducing nonsensical information

 

When working with highly specialized domains, we can use some of the below mentioned methods to reduce hallucination.,

 

1)      RAG – Retrieval Augmented Generation: This method combines the model’s capability to generate information with reliable information sources like knowledge bases.

Example: Who is called the “Father of the nation” in India? This will make the model look up information in the knowledge base before generating a response. Likewise, if any question is asked pertaining to a specific domain the model will investigate the relevant knowledge bases before responding

2)      ReAct Prompting – Reasoning + Acting: This method is used reduce hallucination by incorporating a step-by-step reasoning and an external tool such as an API to ensure that the responses are grounded in factual data.

Example: In medical diagnosis, instead of asking for symptoms of a disease, we break down the question into smaller steps and narrow down to the specifics based on reliable medical data and then ask it to respond with prognosis

 

There are several other methods to reduce the impact of hallucination in generative AI but there is still a long way to go to build trustworthy intelligence as the knowledge bases are vast and susceptibility to nonfactual information which is a reality today.

 

Michael Navin Xavier has provided the best answer to the question. His answer is well rounded and articulated. Well Done!!