Q 760. In an organizational setting, trust is crucial — team members won’t rely on an AI agent unless they believe it adds value and won’t make poor decisions. Describe a situation where an AI agent would need to earn the trust of human users (e.g., agents, team leads, or clients). What would you do to design the AI's behavior, communication, or results in a way that builds this trust over time? 

 

🏆 The best answer will be selected on the basis of:

• Relevance of the trust challenge

• Practicality of the trust-building approach

• Creativity in human-AI interaction design

 

Note for website visitors -

• This platform hosts two weekly questions, one on Monday and the other on Thursday. 
• All previous questions can be found here: https://www.benchmarksixsigma.com/forum/lean-six-sigma-business-excellence-questions/. 
• To participate in the current question, please visit the forum homepage at https://www.benchmarksixsigma.com/forum/.
• The question will be open until Monday or Thursday at 5 PM Indian Standard Time, depending on the launch day. 
• Responses will not be visible until they are reviewed, and only non-plagiarised answers with less than 5-10% plagiarism will be considered for winner selection. 
• If you are unsure about plagiarism, please check your answer using a plagiarism checker tool such as https://smallseotools.com/plagiarism-checker/ before submitting. 
• All correct answers shall be published, and the top-rated answer will be displayed first. The author will receive an honourable mention in our Business Excellence dictionary at https://www.benchmarksixsigma.com/forum/business-excellence-dictionary-glossary/ along with the related term.

• Some people seem to be using AI platforms to find forum answers. This is a risky approach as AI responses are error-prone because our questions are application-oriented (they are never straightforward). Have a look at this funny example - https://www.benchmarksixsigma.com/forum/topic/39458-using-ai-to-respond-to-forum-questions/

• We also use an AI content detector at https://quillbot.com/ai-content-detector. Only answers with less than 45-50% AI-generated content will be considered for winner selection.

 

For AI to earn trust in my team, the following should be considered.

•    Creation of awareness amongst team members regarding the capabilities of AI, explaining the "black box" idea so that team members are not completely oblivious of what it means.
•    Sharing past records of successful activity deliveries performed by the AI. It helps the team gain trust, when there is a track record of success.
•    Encouraging collaborations amongst the team with AI.
•    Team members should be trained in how to use AI, as this in turn boosts their confidence. This should also be championed by the lead, who can drive the importance and advantages of the use of AI for effective tasks delivery.
 

Case study:

In a generic Pharma company, an AI Formulation Co-scientist is introduced to improve product development efficiency via first time right bioequivalence study, longer stability, faster product development, and cost efficiency. Formulation and regulatory affairs teams are in a mode of resistance to put trust in their suggestions having fear that errors of AI could lead to failed bioequivalence studies, a higher number of queries from regulatory agencies and/or costly reformulations. If both teams do not believe in an AI-driven solution then it may delay the filing or launch timeline.

Example of Situations where an AI agent would need to earn the trust

Scenario 1: Formulation scientists do not trust formulation compositions suggested by AI without proper justification.

Expected Response from AI:

·        AI justifies why it has recommended specific excipients in a specific ratio. (Eg. 5% croscarmellose sodium has shown improved dissolution in 10 approved products from the USFDA).

·        AI provides a supporting document that a similar formulation is previously been approved in at least one product.

Scenario 2: The Regulatory team does not trust on filing strategy suggested by AI.

Expected Response from AI:

·        AI suggests a recommendation that includes a guideline provided regulatory agency. (eg. This strategy matches with guidance provided in the dissolution guideline USP <1092>.

These kinds of expected responses are based on evidence or scientific justification provided by AI helps to build trust over time.

To earn trust in an organizational setting, an AI agent must demonstrate reliability, transparency, and value. Here’s a detailed scenario and approach to building trust:

 

Steps to Build Trust:

1. Transparent Implementation:

   • Clear Communication: Clearly explain to the team how the AI works, its capabilities, and its limitations. Provide detailed documentation and training sessions to ensure everyone understands the AI's role.
   • Ethical Guidelines: Implement ethical guidelines and safety measures within the AI system to ensure it operates within predefined boundaries. For example, Anthropic's approach of aligning AI behavior with a "constitution" that includes principles like avoiding harm and providing accurate information
     1
     .

2. Gradual Integration:

   • Pilot Phase: Start with a pilot phase where the AI handles a small percentage of inquiries under close supervision. This allows the team to observe the AI's performance and provide feedback.
   • Human Oversight: During the initial stages, ensure that human agents can easily intervene if the AI encounters complex issues. This builds confidence that the AI won't make poor decisions without human oversight.

3. Performance Monitoring and Feedback:

   • Regular Reviews: Conduct regular performance reviews to assess the AI's accuracy and effectiveness. Share these results with the team to demonstrate the AI's progress and areas for improvement.
   • Feedback Loop: Establish a feedback loop where team members can report issues or suggest improvements. This involvement helps the team feel invested in the AI's development.

4. Continuous Improvement:

   • Learning from Mistakes: Ensure the AI system learns from its mistakes by incorporating feedback and continuously updating its algorithms. This reduces the likelihood of repeated errors and improves overall performance.
   • Updates and Enhancements: Regularly update the AI with new features and improvements based on team feedback and evolving business needs.

5. Demonstrating Value:

   • Efficiency Gains: Highlight the efficiency gains achieved by the AI, such as reduced response times and increased resolution rates. Use metrics and case studies to showcase the AI's positive impact on the team's performance.
   • Focus on High-Value Tasks: Emphasize how the AI allows human agents to focus on more complex and high-value tasks, enhancing their job satisfaction and productivity.

By following these steps, the AI agent can gradually earn the trust of human users, demonstrating its value and reliability while ensuring transparency and continuous improvement.

 Building Trust in AI: 3 Approaches That Work | Salesforce Ventures perspectives

In an audit function, consider a scenario where an AI agent is used to analyze invoices, flagging potential discrepancies, fraud, or non-compliance with company policies. The human auditors, who are accustomed to conducting these reviews manually, are initially skeptical about relying on an AI agent. They worry that the AI might miss critical red flags, make false positives, or fail to account for nuances in complex transactions. In this setting, the AI needs to build trust with both the auditees (the departments or vendors being audited) and stakeholders (audit managers or compliance officers).

To build trust among auditees (the departments or vendors being audited), the AI should operate transparently and fairly. If a discrepancy is flagged, the AI can generate an automatic report with clear details on why the transaction was flagged. Additionally, it can offer auditees a chance to explain discrepancies or resolve issues before final conclusions are drawn. For stakeholders, the AI’s consistent performance, accuracy, and ability to reduce human error in routine audits will build confidence in the tool’s effectiveness.

Use-case: Building Trust in AI Ops for Enterprise Service Management

Scenario:

An AI agent is integrated into an AI Ops framework to enhance operational efficiency. Its primary function is to process user queries and resolve tickets within ServiceNow with improved accuracy and speed. For leadership and operations teams to trust AI-driven service automation, it must demonstrate reliability and effectiveness in key service areas. Failure to provide timely and precise support can negatively impact brand value and business continuity.

Task:

The critical challenge is ensuring that AI Ops earns stakeholder confidence by proving its ability to handle service requests effectively. Trust-building becomes essential as AI transitions into autonomous decision-making roles.

Action:

A phased AI agent deployment strategy should be followed to validate AI Agent performance, gradually increasing team confidence:

1. Parallel Execution & Benchmarking

   • Run the AI agent alongside human-driven operations, evaluating its responses against traditional customer service methods.

   • Analyze accuracy, response speed, and resolution efficiency to demonstrate AI capability before full automation.

2. Guided Execution with Human Oversight

   • Transition to an assisted decision-making model, where AI formulates response strategies, analyzes issues, and suggests solutions.

   • Require human review and approval before AI-driven resolutions are applied, ensuring quality control and adherence to business policies.

3. Gradual Autonomy & Continuous Monitoring

   • In the final phase, enable full AI automation while maintaining ongoing performance tracking and refinement to optimize accuracy.

   • Implement adaptive learning models, feedback mechanisms, and real-time monitoring for AI behavior improvements.

Result:

By following this structured deployment approach, operations teams gain time to understand, validate, and appreciate AI capabilities. Incremental confidence-building fosters trust, ensuring AI-driven automation becomes a reliable asset in enterprise service management.

Integrating AI into Project Management in Product Development

Picture a medium-sized tech company implementing a cutting-edge AI tool to assist project managers and team leaders in organizing tasks, predicting timelines, and identifying potential risks. The AI's role includes analyzing project data, suggesting resource distributions, and highlighting potential obstacles. However, as a new addition to the team, it faces skepticism regarding its dependability.

Challenges in Gaining Trust:

 

• Concern about inaccuracies: A flawed estimation might derail project timelines.

• Fear of losing control: Team leaders could feel overshadowed by algorithm-driven suggestions.

• Opacity of decisions: Recommendations without clarity breed doubt.

• Responsibility concerns: Managers hesitant to rely on AI may worry about accountability if things go wrong.

Building Trust Through Thoughtful Design:

1. Supportive Role, Not Autonomous Action
   Position the AI as an assistant offering well-informed suggestions rather than taking independent actions.
   For instance, it might recommend prioritizing certain tasks with evidence like: "Based on current trends, there’s a significant risk of delay for Task X unless reprioritized."

2. Transparent, Explainable Decisions
   Ensure the AI provides clear, natural explanations for its reasoning.
   Enable users to explore how it reaches its conclusions, such as: "This prediction stems from historical patterns of similar tasks running behind schedule."

3. Gradual Implementation with Feedback
   Introduce a system where users can accept, modify, or reject the AI’s proposals.
   Over time, these interactions refine the AI’s insights, demonstrating its adaptability to human expertise.

4. Showcasing Reliability Through Results
   Incorporate performance metrics, e.g., "Over the last quarter, AI-generated forecasts have shown 92% accuracy."
   Highlight success stories where the AI helped avert delays or manage budgets efficiently.

5. Tailoring Communication to Teams
   Adapt the AI’s communication style to fit the team’s culture — whether formal or relaxed — and allow customization of engagement settings, such as update frequency.

6. Empowering Human Oversight
   Always provide the option for manual intervention. If the AI encounters high uncertainty, it should flag the concern rather than make a definitive call.
   Introduce thresholds to escalate to human decision-makers when necessary.

A Gradual Path to Trust:
As the AI proves its worth through precision, clarity, and adaptability, it evolves from being just another tool to becoming a valued collaborator. It complements human judgment rather than replacing it, earning its place as an essential advisor over time.

Case Study: Enhancing Statutory Audit with AI

 

Situation:

At a mid-sized auditing and consulting firm, auditors faced challenges dealing with voluminous transactional data during statutory audits. Manual processes were time-consuming, prone to errors, and led to auditor fatigue, reducing audit effectiveness.

 

AI Implementation:

An AI-powered audit assistant was introduced to identify anomalies, flag high-risk transactions, and suggest preliminary audit exceptions based on historical audit data and regulatory compliance rules.

 

Earning Team Trust through AI:

• Explainability: The AI tool not only identified transactions for review but also provided reasons (e.g., unusually large amounts, repeated vendor payments). This transparency helped auditors clearly understand AI recommendations.

• Human Collaboration: The AI acted purely as a recommendation engine. Auditors retained full control over decisions, reviewing and confirming AI-identified anomalies. This collaborative model assured auditors that AI augmented rather than replaced their expertise.

• Consistency: The AI consistently provided reliable results. Over a six-month pilot, accuracy in identifying genuine anomalies improved audit efficiency by 35%, substantially reducing false positives.

• Bias-Free Outputs: The model was rigorously trained on diverse historical datasets, reducing biases in anomaly detection, and increasing auditor confidence in its impartiality and accuracy.

• Real-Time Feedback Loop: Auditors provided immediate feedback on AI suggestions, refining the model continually. This feedback loop made the auditors active participants in AI evolution, fostering greater acceptance.

• Transparent Data Use: Full disclosure was provided about the data being used by AI, storage security measures, and data privacy compliance, which addressed data security concerns proactively.

• Early Wins: The AI was initially deployed in limited audits with low-risk transactions. Early, measurable successes led to a gradual and confident expansion across complex audit scenarios.

 

Outcome:

 

Auditors at the firm gained substantial trust in AI as they experienced improved audit quality, reduced workload, and enhanced compliance accuracy. AI transitioned from being perceived as just a tool to becoming a valued and trusted audit partner.

In a workplace, an AI tool—like a sales assistant helping a sales team—needs to earn people’s trust by showing it is useful, clear, and reliable. To do this, the AI should explain why it gives certain suggestions, share how sure it is about its advice, and be open about where it gets its information from. It should be introduced step by step so people don’t feel overwhelmed, let users decide how they want to use it, and give personalised tips that suit each person’s style and situation. Making the AI easy to talk to and understand, with simple language and clear pictures, also helps people feel comfortable using it. Also, listening to user feedback and improving over time shows that the AI is dependable and wants to help.

 

Trust grows more when the AI is seen as a helpful partner, not a replacement for people. By encouraging teamwork between humans and AI, sharing examples of success, and letting users adjust how the AI works for them, the tool becomes something people want to rely on. When the AI consistently gives useful advice and works along with people, sales reps, team leaders, and clients will start to trust it and use it as an important part of their daily decisions.

Any situation of the critical areas of human being - e.g. prescribing any medicines basis the symptoms are shared by the patient. In such cases , there will always be fear and hesitance to give the complete control to AI agent. To gain the trust AI should first be enabled in a limited capacity & for simpler transactions, where the model is trained to provide suggestions and options over concluding decision. Over the period it should learn from Human decisions and make it a more robust and trustworthy to deal with

What is trust and why is it crucial in organizational setting:

Trust can be defined as a strong belief in the character, capability, or truth of a person or something. In other words, trust is a byproduct of reliable consistent and transparent behavior of someone or something overtime.

Trust is one of the essential characteristics of a person within any setting, that determines dependability which influences success. Likewise, gaining trust with the introduction of AI agents within organizations is paramount to its success.

 

Scenario:

Let us imagine the Facilities Management (FM) company introduces an AI agent to help its management by analyzing technicians’ performance data and developing performance evaluation reports. The objective is to minimize manual administrative efforts and produce fast and reliable reports.

This is a very sensitive area and hence producing a more consistent, accurate, transparent and unbiased report is paramount to gaining trust from the management and technicians that shall determine success of the rollout.

 

Strategies for creating AI agents that inspire trust:

Clear understanding of the use case (business requirement) and selecting the appropriate AI application / platform incorporating the following capabilities is a core necessity.

 

1.      Incremental progress

Start small by identifying and implementing small portions of evaluation and progress steadily by incrementing scope. This helps to focus and edify the agent to increase accuracy and build trust overtime.

 

2.      Intent clarity

During the initial setup, clearly defining the intent of the application using prompt engineering concepts will eliminate ambiguity. This will lead to the agent providing relevant and contextual insights eliminating errors during the initial stages and moving forward.

 

3.      Data reliability

Ensure to provide and use quality data to train the AI system and develop. Inclusivity of all possible scenarios will help eliminate bias in the system output.

 

4.      Explainability

Develop system capability to be able to clearly explain the inputs, logical steps and the rationale behind the insights. This will help eliminate the black box effect in the AI system.

 

5.      Traceability

Establish AI system performance metrics record logs and action steps to understand where and how the system went wrong. Continuous performance monitoring shall help us understand how the system is performing and maturing over time.

 

6.      Accountability

Decide and communicate through policies, key responsibilities and accountabilities for the inputs, rules, insights and the ones responsible for the overall system performance.

 

7.      Feedback looping

Build capabilities in the system to be able to accept feedback from users, experts and developers for the systems ongoing learning and fine tuning. Effective feedback loops place a significant role in the progressive performance of the AI system.

 

8.      Security

All data used to train, develop and deploy the system must be secure and private to avoid the spread of sensitive information.

 

Following and adhering to these strategies shall be beneficial to building trust over the system and for successful deployment and application.

 

 

An AI agent may be implemented to aid in project management duties, including the identification of potential risks, the monitoring of progress, and the provision of recommendations for optimizing workflows. There are numerous methodologies in use within an organization; however, the six-sigma methodology is the most effective. A project leader can adhere to the DMAIC phase to achieve the desired level of quality.

 

Situation: The AI agent is responsible for monitoring the project's progress. In our organization, we employ the DMAIC approach, which entails the creation of step 0 and the control phase before proceeding to the whole project.  Once problem statement and goal statement defined as per operational definition ARMI is created with roles and responsibilities at start of project definitely the AI agent viewed with the doubt by stakeholders and project team members the reason they may be concerned about inaccurate information or make poor decisions.

 

Transparency and Explainability: AI agents should provide explicit explanations for their suggestions and decisions. For example, when proposing a change to the project milestone timeline, the AI should explain the data and reasons behind the idea. This transparency helps team members comprehend the AI's thought process and creates trust in its capabilities.

Consistency and Reliability: AI agents should provide correct and reliable information. Consistently updating the team leader with their progress reports, risk assessments, and performance indicators may lead to AI as a reliable resource. Consistent performance will gradually increase confidence within the team in trusting AI.

 

 Collaboration between AI agents and humans: Collaboration plays a vital role.  AI should be developed as an opportunity and not to replace human decision-making. For example, the AI can deliver data-driven insights in each phase of the DMAIC methodology while allowing the project leader and an MBB to make final decisions on whether to go with data insight or not. This collaborative approach ensures that the AI is viewed as a beneficial collaborator rather than a threat.

 

Feedback system: Project leaders must seek approval from Master Black Belts at each stage of the process. This system allows users to submit feedback on AI performance. The AI can use this feedback to enhance its recommendations over a period of time. By actively seeking and integrating user feedback, the AI shows its commitment to ongoing enhancement and attentiveness to user demands.

 

 Example:

Considering an example on AI Agent: Hello (Project Leader) I have noticed that the existing resource workforce may cause a delay in completing the improvement phase. Based on statistics from our project management platform and recent team communications, we appear to be short on workforce data for the forthcoming phase. I advocate reallocating the workforce from the process. Here's a full breakdown of work allocation and predicted timelines to complete the phase.

 

The DMAIC method in project management, especially when combined with an AI agent, improves process optimization, risk identification, and progress tracking. Embracing transparency, reliability, teamwork, and constructive input can help the AI earn the trust of skeptics and position itself as a valuable asset to the team.

People might feel more comfortable with AI when it starts off by giving suggestions. For example, "Based on your previous interests". This shows the team that AI is available for support so they are more comfortable around it and feel as though they are in control. AI can allow for feedback from users as well. I would provide rating or an option to leave comments based on what was liked or disliked by users. AI language would also be made friendly and easy to understand and comprehend. 

While doing Quality Assurance checks, where a Quality checker has to check the details updated by agents against the correct values to be selected while supporting the customer, there are many screens to be reviewed in a CRM. For some screens especially where the money refund options are dependent on the designation/grade of the employee, AI should be able to detect if the right amount was processed as per the requirement. When errors happen the requirement would be to check internally who has committed the error, whether this is reversible or not, the magnitude of the issue (financial impact), time taken to fix the issue before these are escalated to the team leaders first, then to operations managers and then to the client.

 

Relevance:

In BPOs supporting the utilities industry where these kind of refund transactions happen very frequently we face a number of challenges in identifying the right bank accounts the amount is transferred, the right amount that is transferred and if the person transferring has required authority or not . This often leads to delays in processing as there are many manual checks that are included at every stage.

 

Solution & Benefits:

AI can be built to do a Quality Assurance work by validating the employee IDs against their authority matrix. Relevant manual blocks can be applied until AI can learn every scenario that is available wherein AI can trigger a human response requests. By clearly defining the necessary triggers as per the refund amounts over a period of time AI can learn what possible pitfalls can be encountered and how to navigate these. Any faulty decisions taken by AI to be fed back in the database with the root cause of the issues and possible actions to be taken in such an occurrence in future. These faulty decisions involves communicating to the wrong people while within the timelines or not communicating beyond the timelines etc

 

The value addition in this process starts when AI leverages outcomes of various possible scenarios by learning  what kind of transactions can be internally handled within the team, which ones need to be escalated to the internal management, which ones to higher leadership and eventually to client.  This involves understanding the risks of not highlighting the breaches to the higher management immediately, the timelines to be adhered to in case of transactions that can't be rectified from the supplier's end.  While the chances of AI making poor decisions  in the initial phases are high, as time progresses it will learn to communicate to the right people and in time to ensure correct resolutions.

To earn trust within the team, one should have the following key elements: transparency in their decision-making process, consistency in their outputs, and operate fairly without bias. In addition to having above key elements, AI must allow humans to stay in control, admit uncertainty when needed, and improve based on feedback. Most importantly, it should protect data and respect privacy. If AI acts as a reliable, honest, and helpful teammate, the team will naturally start to trust and rely on it.

For example:

In a situation where a teacher uses AI to write report card comments. If the AI output is “Priya is a curious learner and improved in math by 25% this term.” That’s transparent and data-based. If it gives fair comments for all students and allows the teacher to edit them, it builds trust. But if it randomly praises one student and ignores others, trust is lost.

In the healthcare sector, a doctor uses AI to suggest treatments. The AI says: “This medicine is 90% effective based on 500 patient cases.” That’s explaining its choice and admitting confidence level. The doctor stays in control, but now trusts the AI’s help because it’s based on real data.

A Self-driving car: An AI car stops when it sees a red light, even if the road is empty. It explains that the car stops for safety when the red light is detected. It shows that it is following important rules, even if no one is watching. 

How Can AI Earn Trust in Your Team?

 

Goal of the any team is to complete task with strategic planning and execution, completeness, with ethics and within stipulated time. With proper utilization of differentiated AI in the working scenario, it can help in execution of activities in numerous ways. It would be fast and accurate. Activity based on AI would be non biased (considering the data is unbiased). Helping in undestanding multiple data irrespective of time zone and geopgraphy. It can be utilized with AI tool to provide suggestion and this would save time, gain extra time to recheck and finish the  task. Final approval will be through human inferences. By this big load of data can be handled through AI tools with high speed, accuracy, completeness and which would directly help the team to grow and improve further. 

 

Example: If the team objective is in BPO bussiness which aims to provides help/assistance. Chat Bot/Vitual Assistance Referee are active 24/7 and can be utilized any part of world not confined to any geography. It is helpful as it covers numerous mutilple language. Developer/ assistance team will gain time to improve further. Routine task can be managed through AI agents. 

How Can AI Earn Trust in Your Team?

Artificial intelligence can become a part of the functional team once it shows its capability towards  solution solving or provides a permanent solution to problem statement.

AI system should be able to have easy workflow so that it is user friendly and should not raise many queries while resolving the issue/problem statement.

There are a couple of ways of doing this:

1. The AI agent should be designed to provide reasoning for a particular response, for example, Referencing and analyzing six months' historical data.
2. The AI agent must ask the human user for the suitability or correctness of the response.
3. Human users must have a mechanism to validate the responses periodically and confirm if the response is correct and if not human user should feed in the feedback for AI to learn.
4. Feedback for the exceptions and the right solution must be fed back to the AI agent to continually learn.

 

I believe 2-way communication will help AI agent to earn the trust of human users.

I have some thoughts on how orienting, training, communicating, and involving team members would lead AI to earn trust:

 

* To inculcate transparency, workshops need to be held where we demonstrate how AI works on customer (internal and external) queries and generates responses from available knowledge bases and from the web.
* When deploying AI in a particular department, the inputs and feedback from team members need to be gathered . Create a channel or forum for them to share issues, improvements, and suggestions. This channel/forum should be looked at by Project Managers to review and act on the inputs from team members
* Training sessions and plans to educate the team should be created and implemented. Once the team understands the working of AI and the value they bring, they will be more confident and shall trust the technology
* Another way to earn and build trust for AI among the teams is by ensuring AI applications are built on the foundation of privacy and data security and that they comply with such policies and relevant regulations. 
* Communicating and showcasing tangible benefits produced by AI in day-to-day tasks. Making everyday tasks easier or more efficient would lead to earning trust in AI. e.g., improved efficiency, reduction in the time taken to resolve customer queries,  increasing accuracy in data entry etc., will 

There are joint winners for this question - Vinod GC and Jimmy Sonekar.