Development guides

Internal AI search: check document versions, access and sources

An AI search may find an old document or information the person asking cannot access. Resolve versions and permissions first, then make each answer traceable to its source.

ProApp editorialPublished and checked
A locking records cabinet and reference materials
AI-generated illustration of the article’s setting.

The workflow illustrates a possible design and is not a client case study.

Illustrative workflow
  1. Check document access
  2. Retrieve and cite
  3. Review answer quality

Finding a document is not enough

If old policies remain among scattered files, a successful search can still produce an outdated answer. Access needs a separate check: someone who cannot open a document should not learn its contents from search results. Before indexing documents, confirm the current version, its owner and who may read it, then apply those rules to retrieval.

Check existing document permissions

Microsoft 365 Copilot uses the permissions on the original data. That still leaves you responsible for correcting access that is too broad. Compare custom search when sources span several platforms or you need a particular citation or workflow, including the work of keeping permissions up to date.

Attach sources and versions to answers

Use one department's approved documents for the first trial. Include the source and version in answers, and say when the documents do not provide enough evidence. The search also needs to follow later deletions, permission changes and expired content. Recheck access when a result is shown to the user.

Check that revoked access stays blocked

Ask the same question through accounts with different permissions and compare what each can see. Revoke access and delete documents to check that old content no longer appears. Try conflicting versions and questions the files cannot answer. Ask the document owner to verify that the cited passages support the answers.

Bring questions with verified sources

Bring the document groups, access rules and common questions, with the correct source for each answer.

Working through a similar problem?

Tell us how you work today, which tools you use and what you want to improve. We can discuss changes to your current system, connecting tools or developing something new.