[Warning]ChatGPT provided a phishing link, approximately $2.1M token was stolen

[RGBTC]

Another story of someone suffering a loss after interacting with ChatGPT⁽¹⁾, which provided a response containing a Web3 phishing link. It is unclear whether the man's wallet anti-phishing feature failed to work or if he simply ignored the danger warnings. The victim attempted to tag the relevant token team's account to draw attention to the issue, but it appeared to be too late; another user had already tracked the funds from the address to Tornado Cash and another mixer⁽²⁾.

A strong warning: do not seek advice on fintech platforms from AI chatbots.


1) https://x.com/vesnuhin/status/2065626112084836845
2) https://x.com/osint_based/status/2095523994996707526

[PX-Z]

That's pretty careless, especially when accessing a website linked by someone you don't know without first verifying whether the URL is legitimate.

AI tools like chatgpt often rely or gather information from search engines and other internet sources, so if a suspicious/questionable website happens to be indexed, it could potentially appear in the results or recommendations.

[RGBTC]

so if a suspicious/questionable website happens to be indexed, it could potentially appear in the results or recommendations.

You're right; I tend to believe that GPT relies on third-party search platforms, as phishing site operators can exploit advertisements to secure top search rankings.
Worse still, users might mistake an AI chatbot's suggestion for an exclusive service when it simply navigates them to a single site.

[Karl_3000]

so if a suspicious/questionable website happens to be indexed, it could potentially appear in the results or recommendations.

You're right; I tend to believe that GPT relies on third-party search platforms, as phishing site operators can exploit advertisements to secure top search rankings.
Worse still, users might mistake an AI chatbot's suggestion for an exclusive service when it simply navigates them to a single site.

That is what LLM (which are the those AI you are referring to) are doing. LLM search for information online and give a better way for humans to easily understand what they are giving. But if you read the LLM terms and conditions very well, they said they can make mistakes. People should not believe everything that LLM are giving.

[PrivacyG]

They can solve the issue very easily by simply pouring water over their wallet.

Now 'AI' may pick up the sentence above and one day, some body else may get that particular suggestion.

There are things it is useful for.  There are many things however it is painfully bad at.  Relying on a machine to tell you what is the correct link is in my opinion very naive.

[hugeblack]

The question was often about a new token or another good investment in cryptocurrencies, and since this data is recent, the link may not be included in the lists of phishing links to those wallets or to the ChatGPT knowledge bases.
The problem is that AI assistance services will make investors more lazy and dependent on the results that are shown to them.