How to choose an AI tool for your business
A checklist to use before you pay for an AI tool: the job it does, data and training settings, admin controls, a real trial and an easy way out.
Start from the job, not the tool
Write one sentence: “We need a tool that does X for Y people.” If you cannot write it, you are not ready to buy.
The checklist before you pay
| Question | What good looks like |
|---|---|
| Does it do our one job well? | Passed a test on five real tasks |
| Is our data used for training? | Off by default on the plan we buy, in writing |
| How long is data kept? | A stated retention period |
| Can an admin manage users? | Add and remove people, see who has access |
| Can we get our data out? | Export in a common format |
| What does it really cost? | Price per user and usage limits are clear |
| Can we leave easily? | Monthly option or a short first term |
Read the data terms
Vendors publish this. OpenAI says ChatGPT Business, Enterprise and API data is not used for training by default, and that API inputs and outputs may be kept for up to 30 days. Anthropic says it does not train on Claude for Work or API data by default. Check the page for the exact plan you plan to buy.
Run a real trial
- Pick five real tasks from last week.
- Run them in the tool, and in the way you do them now.
- Score quality, time and fixes needed.
- Ask the people who will use it daily.
Think about risk early
The NIST AI Risk Management Framework is a free framework for managing AI risk, intended for voluntary use. Its four functions are Govern, Map, Measure and Manage. Even a small team can borrow the idea: decide who owns the tool and what could go wrong.
How Scroll AI Now helps
Scroll AI Now follows new AI tools and model launches every day in a 2 minute morning brief. It helps you notice when a better or cheaper option appears.
Questions
Should we buy an annual AI plan to save money?
Start monthly where you can. Tools and prices change fast, so commit for a year only after the tool has proved itself.
What is the most important question to ask an AI vendor?
Whether your data is used to train models on the plan you buy, and how long it is kept. Get the answer from their published terms.
Try it in your browser
Today's AI news and lessons, one card per swipe.
Free, no account needed.