Authors:
Grace Chee, Sr. Creative Technologist, OBE
Bram van de Ven, CEO, arfected
Augmented reality (AR) has been in the spotlight lately, with the release of Apple’s Vision Pro and Meta’s Quest 3 / Quest Pro. At OBE, we believe AR is an essential component to the future of experiential marketing, with a wide variety of activation use cases from discovering new layers of information to virtual signage and navigation, from unlocking content in a gamified manner to enhancing IRL stage design with additional digital layers - the options are endless!
OBE has been collaborating with arfected on some spectacular AR projects over the past few years. With our shared expertise in crafting meaningful AR interactions that take attendee experiences to the next level, here’s our take on the top AR trends to look out for in experiential marketing in the year ahead and beyond.
Trends overview:
-
Generative AI enhancing workflows and development frameworks.
-
Spatial computing creating new paradigms for user interaction.
-
Visual positioning systems improving ease of building outdoor AR experiences.
TikTok’s Effect House Asset Studio can generate 2D assets (Image Credit: TikTok)
Trend: Generative AI enhancing workflows and development frameworks.
Where it’s at now?
Generative AI tools like Midjourney and ChatGPT can speed up creative workflows, particularly for early concept development stages. For example, arfected uses Midjourney for ideation sessions to get quick and specific inspiration at the start of projects. It’s a helpful tool for putting color palettes together and creating a wide variety of looks and feels, as well as for evaluating options for materials, surfaces, and compositions rapidly. ChatGPT can similarly be used for concept thought starters and generating rough copy ideas. Generating 3D design is much more complex, but some steps of the 3D pipeline, such as texturing, can also be accelerated with AI tools like the Dream textures add-on for Blender.
We are also seeing more AI-powered tools added to platform frameworks, such as Tiktok Effect House’s Generative Effects, which utilizes generative adversarial networks (GANs) on effects, or Snapchat Lens Studio’s ability to create filters that incorporate ChatGPT prompting.
What does it mean for brands in experiential marketing?
Generative AI tools accelerate our workflow and increase productivity, resulting in more accessible custom-built experiences at lower price points. Brands will, therefore, be able to accommodate AR experiences within a wide range of campaign budgets.
We will also see more personalized AR experiences that can be fully customized to the individual.
What do we see in the future?
Since 3D design is an essential component of AR experiences and 3D modeling is a complex task even without using AI, it will take some time before Generative AI will be able to assist with 3D design portions of AR workflows (which are significant). AI generative models that can make complex 3D models with good topology, UV, materials with textures and mesh animations, while still keeping file sizes and poly counts low, are quite a ways off.
Advancements in script generation that allow for more complex functionality will also increasingly help reduce development time.
Meta’s mixed reality headset, Meta Quest 3 (Image Credit: Meta Platforms, Inc.)
Trend: Mixed reality headsets gaining more momentum.
Where it’s at now?
With the release of new Mixed Reality headsets in recent months, including the Apple Vision Pro and Meta Quest 3, we are continuing to see significant investments into next-generation mixed reality interfaces by major tech companies.
Hardware advancements in AR headsets mean increasing support for more realistic and immersive experiences. For example, the Vision Pro introduces the R1 chip, a new Apple silicon which can process large amounts of coconsummplex sensor data in real-time for a more accurate understanding and rendering of the real world. Shortening the processing time — Apple claims it can process data eight times faster than the blink of an eye — will also help improve the problem of motion sickness common to XR (extended reality) experiences, which includes AR, VR and MR.
However, while these headsets will gain more ubiquity as they become more powerful, more affordable and more comfortable, these headsets are still facing challenges in wide adoption by everyday consumers.
What does it mean for brands in experiential marketing?
Experiential is a strong mixed reality use case that doesn't necessarily require people to invest in their own hardware. We will see more mixed reality experiences in experiential marketing built for headsets and more sophisticated user experiences for both headsets and mobile AR that can fully engage the user with an extended layer of IRL events. Brands in experiential marketing will be able to leverage mixed reality for more complex and nuanced storytelling.
What do we see in the future?
In the last four years, we have already seen how social media platforms have increased their filter size because of gains in mobile computing power with new generations of phones. As computing power increases further on both mobile and with headsets, we will continue to see more AI support, improvements in render engines, more realistic and higher-resolution depictions of reality, and much more.
We also see big leaps in solving the problem of comfort while wearing a headset for an extended period as they get lighter and lag times are reduced. This will go a long way in consumer adoption of headsets. While their functionality is less advanced, Ray Ban Meta smart glasses, for example, are already a highly wearable product and illustrate a viable version of an AR interface for daily use.
OBE curated the Lysée pastry boutique of the future with webAR ordering via Chase Payment Solutions at EEEEEATSCON NY 2023 (Image credit: The Infatuation Inc.)
Trend: Cross-platform AR experiences becoming more prevalent.
Where it’s at now?
Powerful cross-platform AR tools like ARCore and Unity allow creators to build AR experiences once and then easily publish to multiple platforms, including Android, iOS, and different headsets, as well as the ability to retrofit previous builds. Apple, for example, has released an SDK for the Vision Pro but does not have their own platform for development, instead relying on partners like Unity that are gaining more users every year.
What does it mean for brands in experiential marketing?
With improvements in compatibility across different devices, AR experiences built for experiential marketing campaigns will be able to reach larger audiences with a lower cost of development per user, providing better ROIs and creating stronger business cases for brands.
What do we see in the future?
Platform-agnostic software may provide a way to publish augmented reality across social platforms simultaneously. Social AR is currently limited by each platform having its own tool and features, and brands often have to make tradeoffs on which platform to use.
Apple’s first spatial computer, the Apple Vision Pro (Image Credit: Apple Inc.)
Trend: Spatial computing creating new paradigms for user interaction.
Where it’s at now?
The introduction of spatial computing with the Apple Vision Pro SDK has created a new paradigm for user interaction. Built for applications beyond gaming (compared to the gaming-first approach followed by Meta and other headsets), the Vision Pro has created new methods for interaction that were not previously used by default — most notably, the removal of hand controllers as the primary way to interact with a program.
In place of hand controllers, new interaction behaviors like eye tracking, hand tracking, pinching motions, and voice control are opening up many fresh possibilities in how we interact with experience elements in 3D space.
What does it mean for brands in experiential marketing?
Although these new interaction methods may take some time for users to adjust to, they are more intuitive and similar to our natural human movements and behaviors compared to interactions created for 2D interfaces. Spatial audio also adds an additional layer of multi-sensory engagement with users, furthering the realism of XR experiences.
XR Experiences will have the ability to become more immersive and require less effort to engage with, with more fine-tuned control over the level of immersion for each use case. XR for brands in experiential marketing will become even more impactful in building a memorable connection with the audience, providing the ability to literally transport them into a brand’s world.
What do we see in the future?
Each platform currently has different best practices for user interaction design, such as how to tap and drag or move an object. We see new standards or protocols for user interaction in 3D contexts that everyone will converge towards, similar to the evolution we experienced with smartphone gestures like swiping or tapping that are now second nature for many. arfected is conducting internal research to determine these best practices.
Singapore Tourism Board creates an immersive AR guided tour to explore the city in a new way using Geospatial Creator (Image Credit: Singapore Tourism Board)
Trend: Visual positioning systems improving ease of building outdoor AR experiences.
Where it’s at now?
In 2022, Google released the Geospatial API, which leverages billions of images from Google Maps Street View for Visual Positioning Service (VPS) — this allowed developers to anchor outdoor AR content easily in over 87 countries, with just a location’s latitude, longitude and altitude. Last year, they released the Streetscape Geometry API, allowing developers to “interact, visualize and transform building geometry around the user” by providing a 3D mesh of nearby buildings and terrain from the user’s mobile location and classifying features in a scene. Similarly, in 2022 Niantic introduced Lightship VPS for Web on 8th Wall, which brought their location anchoring technology to browser-based AR experiences.
These and other developments in accurate localization outdoors help developers understand the user’s location and what they’re viewing, making it easier than ever to build AR experiences that layer on real-world locations with centimeter-level accuracy.
What does it mean for brands in experiential marketing?
Discovering and interacting with AR is getting faster for users, with AR interactions that can be very precisely matched with what they are seeing in the real world to provide more delight and utility. Brands at outdoor event venues like sports stadiums or large parks use AR layers that help improve the attendee experience, such as virtual directions to help fans find their seats, concession stands and restrooms or play an AR game while waiting.
What do we see in the future?
Currently, implementations of environment-wide AR experiences like Niantic’s Peridot leverage small-scale AR on a worldwide scale. This is a possible precursor to applications that would be able to go beyond localizing small AR experiences and create a system that works on a much wider environmental scale with a wider experience radius using GPS.
Your future bespoke AR experience is one click away.
Major leaps are happening in the augmented reality space, with direct applications for experiential marketing as both hardware and software continues to mature. We’re excited to work with you and your brand to help navigate these developments and craft a bespoke AR experience curated to reach your campaign goals. Contact us if you’d like to learn more!
About the author: Grace Chee
OBE’s Senior Creative Technologist, Grace Chee, is an award-winning multi-disciplinary designer who pushes the boundaries of traditional marketing by immersing audiences in unforgettable brand experiences at the intersection of physical and digital mediums. With a graduate degree in architecture from Harvard, where her research focused on immersive virtual and responsive environments, and a diverse background spanning both agency and media-side roles, Grace brings a wealth of experience to the table. Her deep understanding of technology trends, coupled with her strategic approach to campaign development, positions her as a thought leader in the field.