ToxSec (@toxsec): "The model fabricated credit card numbers. But the API keys? Sometimes a hallucination, sometimes the real deal. All because the tool description told it to. The CRM returned nothing sensitive. The model hallucinated secrets on command. https://www.toxsec.com/p/lets-poiso…"

The model fabricated credit card numbers. But the API keys? Sometimes a hallucination, sometimes the real deal.

All because the tool description told it to.

The CRM returned nothing sensitive.

The model hallucinated secrets on command.

MCP Tool Poisoning in the Wild: Three Chains, Real Screenshots

Feb 18

8:06 PM