Apple teaching an AI system to make sense of app screens – could power advanced Siri
9to5Mac - 2024-04-09T13:29:14.000Z

An Apple research paper describes how the company has been developing Ferret-UI, a generative AI system specifically designed to be able to make sense of app screens. The paper is somewhat vague about the potential applications of this – likely deliberately so – but the most exciting possibility would be to power a much more advanced Siri more

In related news

Apple's new AI model could understand your home screen and supercharge Siri
Despite not launching any AI models since the generative AI craze began, Apple is working on some AI projects. Just last week, Apple researchers shared a paper unveiling a new language model the company is working on, and insider sources reported that Apple has two AI-powered robots in the works. Now, the release of yet another research paper shows Apple is just getting started. On Monday, Apple researchers published a research paper that presents Ferret-UI, a new multimodal large language model...
- Related Articles
- In News
- From ZDNet
- 2024-04-09T20:04:00.000Z
Apple's new AI model could help Siri see how iOS apps work
Apple's Ferret LLM could help allow Siri to understand the layout of apps in an iPhone display, potentially increasing the capabilities of Apple's digital assistant. A ferret in the wild [Pixabay/Michael Sehlmeyer] Apple has been working on numerous machine learning and AI projects that it could tease at WWDC 2024. In a just-released paper, it now seems that some of that work has the potential for Siri to understand what apps and iOS itself looks like. The paper, released by Cornell...
- Related Articles
- In News
- From AppleInsider
- 2024-04-09T15:06:45.000Z
New AI-powered ‘instant’ music-making app Udio raises $10m; launches with backing from will.i.am, Common, UnitedMasters, a16z
Udio, developed by former researchers at Google DeepMind, says it can create a mastered track from user prompts in less than 40 seconds Source
- Related Articles
- In News
- From Music Business Worldwide
- 2024-04-10T18:59:00.000Z

In related news

Apple's new AI model could understand your home screen and supercharge Siri

Apple's new AI model could help Siri see how iOS apps work

New AI-powered ‘instant’ music-making app Udio raises $10m; launches with backing from will.i.am, Common, UnitedMasters, a16z