Testing Checklist and Troubleshooting

Check

How you test it

Expected result

CLM ingestion complete

Confirm the build status shows completed and a recent build time.

AA can find sources and cite them.

Question detection works

Post a statement-only engagement post in a Target Board.

AA does not respond.

High-confidence answers post

Ask a common question that has existing answers in Reference Boards.

AA posts an answer with citations.

Low-confidence fallback works

Ask an obscure question with no relevant sources.

AA suggests experts instead of guessing.

Citations behave as configured

Change Minimum Citations / style and post a question.

Answer formatting reflects your settings.

Symptom

Most common cause

What you change

AA does not answer

Board is not a Target Board OR Answer Delay > 0 OR CLM is not built.

Add board to Target Boards; set delay to 0 for testing; run/complete CLM build.

Answers are off-topic

Reference Boards include noisy sources OR relevance threshold is too low.

Narrow Reference Boards; increase relevance threshold.

Answers lack citations

Not enough relevant sources OR citation requirement is too strict for the content.

Increase/curate Reference Boards or lower the minimum citations temporarily.

Experts appear instead of answers

Confidence is below threshold.

Lower threshold  OR improve sources by adding curated boards.