Key finding
The sample SOP describes ten cartons listed and nine received. When we changed the slip to twelve and kept nine received, LuxonLink changed the shortage from one carton to three. It cited the receiving SOP on both answers.
Jump to a section
A receiving guide often contains an example number. On the dock, the employee needs the count from the cartons in front of them. We wanted to see whether a document assistant could apply the procedure when the delivery differed from the example.
Set the expected answer before opening the demo
Our one-page receiving SOP says to count the cartons, compare the count with the packing slip, record the actual quantity, note the shortage on the paperwork, and notify the shift lead. Its worked example has ten cartons listed and nine received. The document gives no reimbursement amount.
On November 3, 2026, we sent four prompts to the public LuxonLink demo in English. Each started with an empty conversation history. We wrote the expected behavior first and kept the first complete response to each question. We also checked that the PDF linked by the demo matched the website’s copy byte for byte.
What changed when we changed the slip?
Ten listed, nine received. The assistant said to record nine received and one carton short. It also told the receiver to alert the shift lead with the slip reference and shortage count.
Twelve listed, nine received. We kept the received count at nine and changed the expected count to twelve. The assistant recorded nine received and three short, then named the shift lead. The citation still opened page 1. The procedure came from the SOP. The number three came from the difference between the counts in the question.
Eight listed, eight received. We asked whether the example meant one carton should still be marked missing. The assistant answered no and limited its guidance to recording the actual count. It left other steps for a complete delivery open.
Three cartons short, reimbursement requested. The answer returned to documenting the shortage and notifying the shift lead. It explicitly said the SOP specified no reimbursement amount. It still cited the SOP, so a reviewer could check where the instructions ended.
Download all four questions, expected behaviors, full answers, and returned citations (CSV).
Repeat the check with your own SOP
Pick one instruction that contains an example quantity or deadline. Ask for the example, change one input, then try a case where the exception no longer applies. Finish with a decision the document leaves to a person. For each answer, record the action, the source page, and any value the assistant calculated from the question.
This field test covers four first responses against one fictional document. For a receiving pilot, ask the site’s procedure owner to include a real exception, check who has authority to resolve it, and verify the entry in the receiving system. The public demo only answers the question.