OpenAI has released a new benchmark for testing AI systems in healthcare. Called HealthBench, it's designed to evaluate how well language models handle realistic medical conversations. According to OpenAI, its latest models outperform doctors on the test.

OpenAI has released a new benchmark for testing AI systems in healthcare. Called HealthBench, it’s designed to evaluate how well language models handle realistic medical conversations. According to OpenAI, its latest models outperform doctors on the test.

  • taladar@sh.itjust.worksEnglish
    81·
    10 hours ago

    So they created a test so broken and warped that no actual professional can understand it but their AI performs well on it?