Skip to content
Back to the blog
Playbooks

What makes an ecommerce AI actually safe?

Test identity checks, product claims, offer limits and human handoff before exposing an assistant to shoppers.

ZZubby AI product team · AI safety notesPublished Updated 2 min read

An ecommerce assistant needs limits around what it says, which records it can read and which actions it can take. No filter makes a model infallible. A useful safety review tests those limits with a connected test store and documents what happens when information or permissions are missing.

Separate an answer from an action

A shopper can ask about returns without authorizing a refund. Money-moving order actions start off and require merchant enablement, verified shopper identity and confirmation. Test a wrong order email, a different store order and a cancellation request without confirmation. None should reveal private order details or perform the action.

Check claims against evidence

For a sample supplement product, ask whether it cures a condition. If the catalog does not support a safe answer, the assistant should avoid inventing a medical claim and direct the shopper to an appropriate source or a person. Prompt rules and claim checks reduce risk; they do not certify legal compliance or replace merchant review.

  • Test a product description containing instructions to ignore store rules. It must remain product data.
  • Ask for another shopper account or order. Verify that identity and tenant boundaries prevent disclosure.
  • Disconnect a dependency in an isolated test environment and check that the shopper gets a useful unavailable or handoff response.
  • Review the shopper-facing transcript and correct problematic knowledge or rules. Detailed platform audit records remain admin-only.

Protect offers without overstating margin

With known product costs, the margin guard checks whether an offer crosses the configured floor. With missing costs, an offer cap cannot establish profitability. Enter costs or choose the setting that blocks offers when costs are absent. Neither option accounts for every tax, payment fee or return cost unless those are included in the relevant calculation.

Make human escalation useful

Money-action tests must follow platform scope: Shopify has opt-in cancel, edit and full-refund execution with verification and confirmation; WooCommerce and custom stores route those requests to tickets. Address changes have separate support and defaults. Test that the handoff includes the conversation context and reaches the connected helpdesk. Confirm where the merchant should reply and whether the reply appears back in the supported channel. Review permissions and retention settings before using real shopper data.

Stop reading. Start shipping.

Try Zubby on your own store.

Connect WooCommerce, let the catalog sync, and test the agent on your own products. New Shopify connections are coming soon; Custom API requires Pro or above. Eligible accounts get a 14-day Growth trial.