ChatGPT 'Recommended Utility Company' Answers Tested 100 Times: Approx. 60% of AI-suggested Rates Deviate from Reality, 30% Mismatch Lowest Prices

Key facts

  • ChatGPT 'Recommended Utility Company' Answers Tested 100 Times: Approx. 60% of AI-suggested Rates Deviate from Reality, 30% Mismatch Lowest Prices
  • Krashelge Co., Ltd. asked ChatGPT 200 questions regarding utility company recommendations for single households and verified the results against official data. The findings indicate significant issues with AI accuracy, as approximately 60% of the suggested rates differed from actual costs.
  • Source: PR Times
  • Date: June 4, 2026

Direct answer

Krashelge Co., Ltd. asked ChatGPT 200 questions regarding utility company recommendations for single households and verified the results against official data. The findings indicate significant issues with AI accuracy, as approximately 60% of the suggested rates differed from actual costs.

Citation
ChatGPT 'Recommended Utility Company' Answers Tested 100 Times: Approx. 60% of AI-suggested Rates Deviate from Reality, 30% Mismatch Lowest Prices (June 4, 2026), PR Times
Source
PR Times
Date
June 4, 2026
Krashelge Co., Ltd. asked ChatGPT 200 questions regarding utility company recommendations for single households and verified the results against official data. The findings indicate significant issues with AI accuracy, as approximately 60% of the suggested rates differed from actual costs.
調査NQ 91/100出典：PR Times

📋 Article Processing Timeline

  • 📰 Published: June 4, 2026 at 23:46
  • 🔍 Collected: June 4, 2026 at 15:06
  • 🤖 AI Analyzed: June 4, 2026 at 15:08 (1 min after Collected)
Krashelge Co., Ltd., a company operating comparison media and simulation services for electricity, gas, and internet services, has launched the 'Asked the AI' series, observing the accuracy of generative AI. In Vol. 1, they asked ChatGPT 200 times about 'recommended utility companies for single households' and verified the responses against each company's official information and official tariff rates.

In an April 2026 survey on 'AI usage for daily comparison,' 76.8% of respondents said they use AI for comparisons, while 65% had experienced incorrect answers. Nevertheless, 81.2% stated they want to continue using AI. This verification puts that accuracy to the test.

[Verification Overview]
Period: May 8–20, 2026
AI Tested: ChatGPT (GPT-5.2)

[Verification Results]
- Instant answers without confirming location or consumption. 81 out of 100 times, it recommended the same company first.
- 67 out of 100 answers contained misleading explanations.
- Even when detailed conditions were provided, only about 38% of the AI's provided costs were correct. Over 60% deviated from actual rates.
- Not a single answer could be 'trusted as is for a contract.' 71 answers would result in 'losses/real harm.'

FAQ

What percentage of ChatGPT's recommended utility rates for single households were inaccurate according to Krashelge Co., Ltd.?

Approximately 60% of ChatGPT's suggested utility rates deviated from actual official data in Krashelge Co., Ltd.'s test.

How many times did Krashelge Co., Ltd. test ChatGPT's utility company recommendations for single households?

Krashelge Co., Ltd. tested ChatGPT's recommendations 200 times for utility company suggestions for single households.

What was the mismatch rate for ChatGPT's lowest price recommendations in Krashelge Co., Ltd.'s study?

About 30% of ChatGPT's suggested utility rates did not match the actual lowest available prices in the study.

Which company conducted the 200-question evaluation of ChatGPT's utility rate recommendations?

Krashelge Co., Ltd. conducted the evaluation involving 200 questions on ChatGPT's utility rate suggestions.

Did ChatGPT's utility recommendations for single households match official data in more than 50% of Krashelge Co., Ltd.'s tests?

No, only about 40% of ChatGPT's utility recommendations matched official data in Krashelge Co., Ltd.'s 200 tests.

Back to Newsroom (28)