New iOS 18 AI features coming to iPhones in 10 Days

We all know that Apple has fallen behind in the AI race. That’s why For some time now, we have been awaiting the upcoming iOS 18 AI features for iPhones. Now the time is closer than ever.

iOS 18 is set to be showcased at the Worldwide Developers Conference on June 10th. Following the event, developers will get access to iOS 18 for testing, possibly as early as July when a public beta is expected to roll out. After the beta testing phase, iOS 18 is slated for an official release in September 2024, coinciding with the launch of new iPhones.

Apple is about to AI to make their devices smarter and easier to use (Image credit)

Do you want an early glimpse of how the next-gen iPhone works? Let’s take a closer look at Apple’s big plan first.

Project Greymatter will bring new AI features to iPhones

What is Project Greymatter? Project Greymatter is Apple’s big plan to make their devices smarter using a technology called artificial intelligence, or AI. They’re working on adding AI features to their iPhones, iPads, and Mac computers to help people do things more easily and of course not to be left behind in the AI ​​race.

With Project Greymatter, Apple wants to make it so your device can do helpful things like summarize your messages and articles, turn your voice recordings into written text, and even make your photos look better automatically.

So, what are the upcoming iOS 18 AI features coming soon?

According to various reports and leaks, iOS 18 is bringing some helpful new AI features to your iPhone and iPad, making your device even smarter and more helpful. Here’s what you can expect:

• Greymatter Catch Up: Say goodbye to overwhelming notification overload. iOS 18’s new feature, called “Greymatter Catch Up,” will let Siri give you a quick summary of your recent notifications, so you can stay updated without feeling overwhelmed.
• AI-powered photo editing: Get ready to take your photo editing skills to the next level. iOS 18 will introduce AI-powered editing options in the Photos app, including a new “Clean Up” feature that can remove unwanted objects from your pictures automatically.

iOS 18 AI features: “Clean Up” in iOS 18 uses AI to automatically remove unwanted objects from photos, simplifying the editing process for users (Image credit)

• Math Notes: For students and math enthusiasts, iOS 18 will introduce “Math Notes” in the Notes app. This feature will recognize and solve mathematical equations, making it easier to jot down and solve math problems on your device.
• Generative Playground: An innovative application leveraging Apple’s generative AI software, allowing users to create and edit images seamlessly. The app also features iMessage integration, offering a glimpse into the future of AI-driven creativity.
• Text summarization and transcription: AI-powered text summarization and transcription features will be integrated into core applications such as Notes and Messages. Users can expect seamless access to summarized articles, transcribed audio recordings, and on-device text generation.
• Improved Siri responses (finally): Siri will receive significant updates to its response generation capabilities, leveraging a new smart response framework and Apple’s on-device LLM. New iOS 18 AI features enable Siri to provide more contextually relevant and insightful responses to user queries.

iOS 18 AI features: Siri, Apple’s assistant, is getting better at understanding and answering questions (Image credit)

• Cross-device media and TV controls: Apple is working on cross-device media and TV controls for Siri, allowing users to control media playback on different devices seamlessly. While this feature may not be available immediately, it represents Apple’s commitment to enhancing user experience across its ecosystem.
• Keyboard Math Predictions: iOS 18 will introduce a feature called “Keyboard Math Predictions,” enabling the auto-completion of mathematical expressions within Notes and other text input fields. This enhances user convenience and efficiency when dealing with mathematical content.

Ajax LLM serves as a foundational framework for powering AI-driven functionalities, enabling applications like Siri, Notes, and Messages to deliver more nuanced and contextually relevant responses. This model is expected to play a significant role in powering AI-driven features across Apple’s ecosystem, offering users intelligent and personalized interactions across various applications and services. Here is a brief look at it.

A closer look at Ajax LLM

As mentioned, several of Apple’s standard system components, including Safari, Spotlight Search, and Siri, are set to undergo significant AI-related enhancements in the upcoming iOS 18. The company’s motivation behind incorporating generative AI technology into its operating systems stems from a desire to improve existing default applications deployed across billions of devices worldwide while prioritizing user privacy through on-device processing. These enhancements, fueled by Apple’s Ajax large language model (LLM), will introduce practical benefits for end-users, such as text summarization, document analysis, and AI-enhanced search options.

iOS 18 AI features: With AI, Apple hopes to make it easier for you to do things like find information and organize your stuff (Image credit)

Notably, Safari is poised to introduce article summarization through its Intelligent Search feature, providing users with brief summaries of web pages. Similarly, Siri will integrate more closely with Messages, offering simplified responses generated by on-device AI. Apple’s focus on on-device processing not only enhances user privacy but also ensures efficient functionality without relying on cloud-based processing.

With these new  iOS 18 AI features set to debut at the annual Worldwide Developers’ Conference, Apple’s renewed focus on artificial intelligence signals a promising future for its ecosystem.

Featured image credit: Eray Eliaçık/Bing