Photo credit: Villa Marianne
AInsights: Your executive insights into the latest in generative artificial intelligence…
Meet Agent 00AI…your new Q that can help you navigate your work and personal life.
Google held its I/O event, and everything the company announced was not only disruptive or progressive in the genAI space, but also had implications for itself.
Let's take a look at these announcements and then analyze more deeply how they stack up against OpenAI, Meta, Anthropic, and Perplexity.
First, Google announced Gemini AI integration across multiple key products, a sign of the future for next-generation hardware and software products.In the near future, artificial intelligence will become a part of human society user interfacecollaborate with you instantly as an assistant, or ultimately as your proactive agent.
- Automatically generate movie/TV show descriptions in Google TV.
- Geospatial augmented reality content in Google Maps.
- AI-generated quizzes on YouTube educational videos.
- Natural language search in Google Photos (“Ask Photos” feature). That in itself is huge. How many photos do you have on your phone or in the cloud that you may never see again? Just describe the image to the AI and it will find it!
- AI assistance for email drafting, summarization, and e-commerce returns in Gmail. Now step up your email searches too! Why is this still a challenge in 2024!
Complete Google I/O in 10 minutes
Gemini 2 model update
Google also announced a new 27 billion parameter model for Gemini 2 (latest 1.5 details here), its next-generation artificial intelligence product, optimized for efficient performance on GPUs. This larger model can support the largest input of any commercial artificial intelligence model.
Veo and Imagen 3 by Creator
Google showed off Veo, its latest high-definition video generation model designed to compete with Sora and Midjourney, and Imagen 3, its highest-quality text-to-image model that promises more realistic visuals.
These tools will initially be available to select creators.
Information overview and AI sandbox
Google has launched Audio Overviews, a feature that generates audio discussions based on text input, and AI Sandbox, a series of generative artificial intelligence tools used to generate audio discussions based on user prompts. Create music and sounds.
An overview of artificial intelligence in search
Google Search is rolling out “Artificial Intelligence Summary” to provide quick summaries of answers to complex search queries, as well as Assistant-like planning features for multi-step tasks.
Google introduced the ability to ask open-ended questions and receive detailed, coherent answers generated by artificial intelligence models. This gives users more comprehensive information than a link list.
Artificial intelligence agent: Google has launched an artificial intelligence agent that can carry out back-and-forth conversations to help users complete multi-step tasks such as research, analysis and creative projects. These agents leverage the latest language models to provide personalized assistance.
Multi-mode search: Google has expanded its search capabilities to understand and generate responses that combine text, images, audio and other patterns. This enables users to search for images or audio clips and receive related multimedia results.
Longer context: Google’s search models are now able to understand and incorporate longer context from user query history and previous interactions. This allows for a more contextual and personalized search experience.
These new artificial intelligence search features are designed to provide more natural, interactive, and comprehensive access to information than traditional keyword-based searches. They leverage Google's latest advances in large language models and multimodal artificial intelligence to provide a more assistive and intelligent search experience.
Still, we haven’t seen tools for businesses that need to be on the other side of the AI hunt. Clearly, search behavior is changing, but how products and services emerge on the other side of discovery is the next Wild West.
AI Teammate for Google Workspace
The “AI Teammate” feature will be integrated into Google Workspace to help build searchable work collections based on messages and email threads, and provide analysis and summaries.
Project Astra – AI Assistant
Google has launched Project Astra, a prototype artificial intelligence assistant built by DeepMind that can assist users with tasks such as identifying their surroundings, finding lost items, reviewing code, and answering questions in real time.
It's the most promising Google AI assistant yet, but for the record, it's not yet available. Project Astra represents Google’s vision for the future of artificial intelligence assistants…and more.
We're also likely on the cusp of the next generation of Google Glass. But this time, things won’t be so awkward as Meta and Ray-Ban help consumerize wearable artificial intelligence.
So what is it?
Project Astra is a multi-modal artificial intelligence agent that can perceive and respond to real-time information through text, video, images and speech. It can use a smartphone camera or smart glasses to simultaneously access information from the network and its surrounding environment. The system encodes video frames and speech into a timeline and caches them for efficient call and response. For example, in the demo below, you'll see a live video panning across a room, with the user stopping, drawing an arrow on the screen, and asking the AI assistant to identify the object. In another example, the video source continues to pan and the user is asked to identify the object producing the sound. The AI assistant accurately identifies the speaker.
Key features of the Astra project
Use computer vision and audio processing to instantly identify objects, sounds, and their specific parts.
Understand context and location based on visual cues from the environment.
Provide explanations and information about the object, code snippet, or scene it perceives.
Engage in natural, conversational interactions, adapting to interruptions and speech patterns.
Provide proactive help and reminders based on the user's context and past interactions.
Impact on business
Project Astra represents a major leap forward in artificial intelligence capabilities, providing businesses with multiple potential benefits:
Improve productivity: Artificial intelligence assistants can understand and respond to the complexity of real-life scenarios, simplify various tasks, and improve employee productivity and efficiency.
Improved customer experience: Businesses can leverage Project Astra's multi-modal capabilities to provide more intuitive and personalized customer support, thereby enhancing the overall customer experience.
Enhanced decision-making: By processing and integrating information from multiple sources in real time,
Project Astra provides data-driven insights and recommendations to senior executives and decision-makers.
Opportunities for innovation: Project Astra’s advanced AI capabilities can pave the way for new products, services, and business models that leverage multimodal interactions and contextual awareness.
While Project Astra is still under development, Google plans to integrate some of the features into products such as the Gemini app and web experience later this year. Business executives should pay close attention to Project Astra's progress and explore how its cutting-edge artificial intelligence capabilities can benefit their organizations and drive innovation.
This time it's your AInsights. Now, you and I can think about the future of AI-driven search, work, the next generation of creations we will produce, and how we will navigate our world and our businesses with the help of AI.
Please subscribe to AInsights, here.
If you would like to join my main mailing list for news and events please follow, Solis Quantum.
