Shopify Inbox

The Shopify Inbox AI agent has real potential and is a genuine step up from the previous Inbox (which was limited to live chat management). But several issues still need fixing before it can be used reliably in production.

1. Response language
The AI has replied in English even though the entire conversation was in French.

2. Inconsistency depending on how the question is phrased
Two questions with the same intent, phrased differently, don't give the same answer: one omits relevant information/product, the other doesn't. This is a real reliability concern if the result depends so heavily on the customer's exact wording.

3. Hallucinated non-existent link
On certain requests, the AI tries to share a link to a page that doesn't exist at all on our site. How can this type of URL hallucination be avoided?

4. Scope of learning
Does the training/learning happen only at the conversation level, or does it also benefit future conversations?

5. Disabling the AI mid-conversation
After disabling the AI agent while a conversation was in progress, it kept being handled by the AI despite the box being unchecked. Is this a bug?

6. Limited training options
For training, with Knowledge Base you can suggest answers, but not suggest new questions in the scenarios. Is this planned? We also don't have control over selecting/correcting which data source is used, which is surprising.

Overall, a great tool at first glance, but one that still needs a lot of foundational work. Looking forward to updates. In the meantime, to get reliable answers, I'm forced to use another paid tool instead of this native, free one.

Très bonne application gratuite. Elle s’intègre parfaitement à ma boutique Shopify et facilite les échanges avec les visiteurs. L’interface est simple, intuitive et agréable à utiliser. Je la recommande vivement !

We need localized features on the app (at least multiple language support for the welcome message on the chatbox)