Using AI at work: the questions to ask first

Oct 12
Before introducing an AI tool at work, agree what it should help with and how people will check its output. NIST’s Generative AI Profile identifies risks including information integrity, privacy and the relationship between people and AI systems. A small, clearly governed use case is easier to review than an open-ended promise to automate everything.
What task are we trying to improve? Describe a specific activity, such as preparing a first draft or organising information. Decide what a useful result looks like and how you will compare it with the current way of working.

Is this tool approved for this information? Check your organisation’s policy and the tool’s agreed terms before using business material. Identify what information may be entered, who can access it and which approvals are required. Do not assume a consumer account has the same controls as a business arrangement.

Who will review the output? Assign a person who understands the subject and can spot errors, omissions and unsuitable recommendations. Decide which sources or records they will use to verify the result. The more consequential the task, the stronger the review needs to be.

Where will human decisions remain? Define the boundary between assistance and action. A draft email, a suggestion and a decision sent to a customer are different stages. Agree who is responsible for approving the final step and how mistakes will be corrected.

How will colleagues learn to use it? Explain the approved use cases, examples of acceptable inputs and the review checklist. Give people a route for questions and for reporting problems. Record what you learn from an initial trial before widening the use.

A useful starting checklist

Name the task, approved tool, permitted information, reviewer and final decision owner. Agree a success measure and a review date. Start with a task that can be checked and corrected, and adjust the approach using evidence from the trial.

Source: NIST, Artificial Intelligence Risk Management Framework: Generative Artificial Intelligence Profile (2024).
https://nvlpubs.nist.gov/nistpubs/ai/NIST.AI.600-1.pdf
Created with