Update Release Notes
We have released a minor update to Snap OS and Spectacles Firmware that addresses two issues that were found after the full May release (details below).
The fixes resolve
- Crashes when launching Lenses that use the Internet Module and Camera Module
- Logging from Spectacles not appearing in Lens Studio
Please update to the latest version of Snap OS and the Spectacles App. Follow these instructions to complete your update. Please confirm that you’re on the latest versions:
- OS Version: v5.61.0376
- Spectacles App iOS: v0.61.1.0
- Spectacles App Android: v0.61.1.1
- Lens Studio: v5.9
May Snap OS Update - With A Lens Explorer Refresh
- ✨ Lens Explorer Refresh (Beta): Lens Explorer got a new look with new features including search, sorting, and a Lens detail page.
- 📸 Multi-Lens Capture: You can now capture multiple Lenses including System UI components such as palm buttons and system keyboard.
- ⌨️ System Keyboard Improvements: A new password mode & layout, and improved AR/Mobile handover.
- 🛜 Spectacles x Lens Studio Connectivity Improvements: Updated Lens Studio UI to show platform-specific options; and support for direct push for Lenses that use remote assets.
- 📶 Local Connections over HTTP and WebSocket: You can now connect to local services using localhost HTTP connections (http).
- 🔛 SIK v0.12.0 & Sync Kit: Improvements for SIK and using SIK in connected Lenses for a streamlined developer experience with fewer helper components.
- 📱 Mobile Lens Launcher: Quickly launch, search, close, and save lenses from the Spectacles App.
- ⚙️ Guided Mode for Connected Lenses: No device restart needed anymore, and added Connected Lenses support via a fixed Session ID.
Lens Explorer Refresh (Beta)
Lens Explorer got a new look! We also added search and sort capabilities. Search is available by Lens Name, Developer Name (use "@" before the query), or Tag (use "#" before the query). You can also sort Lenses by A-Z, Z-A, oldest, or newest. This is particularly useful for recently pushed lenses in the Drafts category. When hovering over a Lens tile, an extra information button (ℹ) now appears which opens a detail page for that Lens. The detail page shows Lens description and tags as provided by the developer - if you have published a Lens recently, we encourage you to update your Lens to include a description & tags!
|
|
Multi-Lens Capture
You can now capture multiple Lenses including System UI components such as palm buttons and system keyboard. This allows you to give people a more representative experience of your Lens on Spectacles!
|
|
System Keyboard Improvement
We've introduced a new feature to help keep user passwords secure: an alert pops up when a password field is active during a capture, helping users stay aware and prevent accidental sharing. We also improved keyboard hand-over between AR and Mobile along with better open/close flows.
|
|
Spectacles x Lens Studio Connectivity Improvements
We redesigned the Lens Studio to Spectacles connectivity interface to only display options available for each target platform. You can now also use direct push for both remote assets and Connected Lenses. The available connection options differ based on the platform selected in the "Made For" setting in Lens Studio. (Learn more about pushing Lenses to your Spectacles device here).
|
|
Local Connections over HTTP and WebSocket
You can now connect to local services using localhost HTTP connections making it easy to use your own local server for testing projects under development while using the Fetch API or Web Sockets (Learn more about using Fetch API, Web Sockets)
SIK & Sync Kit (Beta)
To streamline the creation of connected Lenses, we have improved compatibility between Spectacles Interaction Kit (SIK) and Sync Kit. We are introducing SyncInteractionManager and SyncInteractor, enabling interactors to be synced across connections. This aims to streamline the developer experience by requiring fewer helper components and reducing the work needed to migrate to use SyncKit. Learn more about using SIK & Sync Kit.
SIK v0.12.0 has been released. Key areas of focus include dependencies via package management, documentation, and sync Interactions.
Mobile Lens Launcher
To make it easier to demo Lenses on Spectacles, we are introducing the ability to quickly launch, search, close, and save Lenses from the Spectacles App. You can also view Lenses by category or using the search bar.
Guided Mode for Connected Lenses
Guided mode lets you lock the system in a single Lens. This is particularly useful when you have a demo or activation and want to avoid having users switch between Lenses. In this release, we improved guided mode to remove the requirement of a device restart to change the Lens. While in guided mode, you can easily switch between different Lenses available in your device.
Additionally, you can now set a Session ID from the Spectacles app to skip session selection. This lets you join the same session from multiple Spectacles and / or Lens Studio, which is useful for debugging during Lens development and streamlining demos. If a Session ID is set, Spectacles show a notification on wake. Learn more here.
We also added Connected Lenses support in guided mode using a fixed session ID to put a group of devices into the same session. Learn more about Guided Mode here.
Versions
Please update to the latest version of Snap OS and the Spectacles App. Follow these instructions to complete your update. Please confirm that you’re on the latest versions:
- OS Version: v5.61.371
- Spectacles App iOS: v0.61.1.0
- Spectacles App Android: v0.61.1.1
- Lens Studio: v5.9
⚠️ Known Issues
- Video Calling: Currently not available, we are working on a fix and will be bringing it back shortly.
- Hand Tracking: You may experience increased jitter when scrolling vertically. We are continually working to improve this.
- Wake Up: There is an increased delay when the device wakes up from sleep using the right temple button or wear detector. Will improve in the next release.
- Custom Locations Scanning Lens: We have reports of an occasional crash when using Custom Locations Lens. If this happens, relaunch the lens or restart to resolve.
- Spectator: Lens Explorer may crash if you attempt consecutive tries. If this happens, sleep the device and wake it using the right temple button.
- Capture / Spectator View: It is an expected limitation that certain Lens components and Lenses do not capture (e.g., Phone Mirroring). We are working to enable capture for these Lens experiences.
- Multi-Capture Audio: The microphone will disconnect when you transition between a Lens and Lens explorer. You can also sometimes hear static in the capture if there is no Lens audio. We are working to improve this.
❗Important Note Regarding Lens Studio Compatibility
To ensure proper functionality with this Snap OS update, please use Lens Studio version v5.9 exclusively. Avoid updating to newer Lens Studio versions unless they explicitly state compatibility with Spectacles, Lens Studio is updated more frequently than Spectacles and getting on the latest early can cause issues with pushing Lenses to Spectacles. We will clearly indicate the supported Lens Studio version in each release note.
Checking Compatibility
You can now verify compatibility between Spectacles and Lens Studio. To determine the minimum supported Snap OS version for a specific Lens Studio version, navigate to the About menu in Lens Studio (Lens Studio → About Lens Studio).
Pushing Lenses to Outdated Spectacles
When attempting to push a Lens to Spectacles running an outdated Snap OS version, you will be prompted to update your Spectacles to improve your development experience.
Feedback
Please share any feedback or questions in the Spectacles Reddit update thread.
Previous Release Notes
A Snap OS Update - Take Spectacles Out & On-the-go
-
🏃♂️Three Lenses to Try Outside
- 🐈 Peridot Beyond by Niantic - You and your friends can now take your Dots (virtual pets) for a walk outside, pet them, and feed them together, amplifying the magic of having a virtual pet to be a shared experience with others.
- 🐶 Doggo Quest by Wabisabi - Gamify and track your dog walking experience with rewards, dog facts, recorded routes, steps, & other dog’s activities
- 🏀 Basketball Trainer - augment your basketball practice with an AR coach and automated tracking of your scores using SnapML
- 👩🏫 Two Sample Lenses to Inspire You to Get Moving
- Easily Build Guided Experiences with GPS, Compass Heading, & Custom Locations
- ⌨️ System AR Keyboard - Add text input support to your Lens using the new system AR keyboard with a full and numeric layout.
- 🛜 Captive Portal Support - You can now connect to captive Wi-Fi networks at airports, hotels, and public spaces
- 🥇 Leaderboard - With the new Leaderboard component you can easily add a dose of friendly competition to your Lenses
- 📱 Lens Unlock - Easily deep link from a shared Lens URL to the Specs App, and unlock Lenses on Spectacles
- 👊 New Hand Tracking Capabilities - 3 new hand tracking capabilities: phone detector to identify when a user has a phone in their hands, grab gesture, and refinements to targeting intent to reduce false positives while typing
- 📦 Spectacles Interaction Kit Updates - New updates to improve the usability of near field interactions
- ⛔ Delete Drafts - You can now delete your old draft Lenses to free up space in Lens Explorer
- 💻 USB Lens Push - You can now push Lenses to Spectacles on the go using a USB cable without requiring an internet connection through trusted connections
- ⏳ Pause & Resume Support - You can now make your Lens responsive to pause and resume events for a more responsive experience
- 🌐 Internet Availability API - New API to detect when a device gets or lose internet connectivity
- 📚 New Developer Resources & Documentation - We revamped our documentation and introduced a ton of developer sample projects on our github repo to get you started
Lenses that Keep You Moving Outside
Our partners at Niantic updated the Peridot Beyond Lens to be a shared experience using our connected Lenses framework, you and your friends can now take your virtual pets (Dots) for a walk outside, pet them, and feed them together, amplifying the magic of having a virtual pet to be a shared experience with others. You can also connect your customized dot to Spectacles from the Peridot Mobile App and synchronize rewards. For your real pets, the team at Wabisabi released Doggo Quest, a Lens that gamifies your dog walking experience with rewards, walk stats, and dog facts. It tracks your dog using SnapML, logs routes using the onboard GPS (Link to GPS documentation), and features a global leaderboard to log user’s scores for a dose of friendly competition. To augment your basketball practice, we are releasing the new Basketball Trainer Lens, featuring a holographic AR coach and shooting drills that automatically tracks your score using SnapML.
To inspire you to build experiences for the outdoors, we are releasing two sample projects. The NavigatAR sample project (link to project) from Utopia Lab shows how to build a walking navigation experience featuring our new Snap Map Tile - a custom component to bring the map into your Lens, compass heading and GPS location capabilities (link to documentation). Additionally, we are also releasing the Path Pioneer sample project (link to project), which provides building blocks for creating indoor and outdoor AR courses for interactive experiences that get you moving.
|
|
|
|
|
Easily Build Location Based Experiences with GPS, Compass Heading, & Custom Locations
Spectacles are designed to work inside and outside, making them ideal for location based experiences. In this release, we are introducing a set of platform capabilities to unlock your ability to build location based experiences using custom locations (see sample project). We also provide you with more accurate GPS/GNSS and compass heading outdoors to build navigation experiences like the NavigatAR Lens. We also introduced the new 2D map component template which allows you to visualize a map tile with interactions such as zooming, scrolling , following, and pin behaviors. See the template.
|
|
|
Add Friendly Competition to your Lens with a Leaderboard among Friends
In this release, we are making it easy to integrate a leaderboard in your Lens. Simply add the component to report your user’s scores. Users will be able to see their scores on a global leaderboard if they consent for their scores to be shared. (Link to documentation)
|
|
New Hand Tracking Gestures
We added support for detecting if the user holds a phone-like object. If you hold your phone while using the system UI, the system accounts for that and hides the hand palm buttons. We also expose this gesture as an API so you can take advantage of it in your Lenses. (see documentation). We also improved our targeting intent detection to avoid triggering the targeting cursor unintentionally while sitting or typing. This release also introduces a new grab gesture for more natural interactions with physical objects.
|
|
|
|
Improved Lens Unlock
Improved Lens Unlock - you can now open links to Lenses directly from messaging threads and have them launch on your Spectacles for easy sharing.
|
|
New System Keyboard for Simpler Text Entry
We are introducing a new system keyboard for streamlined test entry across the system. The keyboard can be used in your Lens for text input and includes a full keyboard and numeric layouts. You can also switch seamlessly with the existing mobile text input using the Specs App. (See documentation)
|
|
Connect to the Internet at Hotels, Airports, and Events
You can now connect to internet portals that require web login (aka., Captive Portals) at airports, hotels, events, and other venues.
Improvements to Near Field Interactions using Spectacles Interaction Kit
We have added many improvements to the Spectacles Interaction Kit to improve performance. Most notably, we added optimizations for near field interactions to improve usability. Additionally, we added filters for erroneous interactions such as holding a phone. You can now subscribe directly to trigger events on the Interactor. (see documentation)
|
|
|
Delete your Old Lens Drafts
In this release, we are addressing one of your top complaints. You can now delete Lens drafts in Lens explorer for a cleaner and tidier view of your draft Lenses category.
|
|
Push Your Lens to Spectacles over USB without an Internet Connection
Improved the reliability and stability of wired push to work without an Internet connection after first connection. Spectacles can now remember instances of trusted Lens Studio and will auto-connect when the wire is plugged. It will still require an internet connection on the first Lens push.
Pause and Resume Support
Make your Lens responsive to pause and resume events from the system to create a more seamless experience for your Lens users.
|
|
Detect Internet Connectivity Status in Your Lens
Update your Lens to be responsive to changes in actual internet connectivity beyond Wi-Fi connectivity. You can check if the internet is available and be notified if the internet gets disconnected so you can adjust your Lens experience.
|
Spectacles 3D Hand Hints
Introducing a suite of animated 3D hand gestures to enhance user interaction with your Lens. Unlock a dynamic and engaging way for users to navigate your experience effortlessly. Available in Lens Studio through the Asset Library under the Spectacles category.
New Developer Resources
We revamped our documentation to clarify features targeting Spectacles vs. other platforms such as the Snapchat app or Camera Kit, added more Typescript and Javascript resources, and refined our sample projects. We now have 14 sample projects that you can use to get started published on our Github repo.
|
Versions
Please update to the latest version of Snap OS and the Spectacles App. Follow these instructions to complete your update. Please confirm that you got the latest versions:
OS Version: v5.60.422
Spectacles App iOS: v0.60.1.2
Spectacles App Android: v0.60.1.0
Lens Studio: v5.7.2
⚠️ Known Issues
- Spectator: Lens Explorer may crash if you attempt consecutive tries. If this happens, sleep the device and wake it using the right temple button
-
Guided Mode:
- Connected Lenses are not currently supported in multiplayer mode
- If you close a Lens via the mobile controller, you won’t be able to reopen it. If this happens, use the right temple button to put the device to sleep and wake it again
- See What I See: Annotations are currently not working with depth
- Hand Tracking: You may experience increased jitter when scrolling vertically. We are working to improve this for the next release.
- Wake Up: There is an increased delay when the device wakes up from sleep using the right temple button or wear detector. We are working to improve this for the next release
- Custom Locations Scanning Lens: We have reports of an occasional crash when using Custom Locations Lens. If this happens, relaunch the lens or restart to resolve.
- Capture / Spectator View: It is an expected limitation that certain Lens components and Lenses do not capture (e.g., Phone Mirroring, AR Keyboard, Layout). We are working to enable capture for these areas.
❗Important Note Regarding Lens Studio Compatibility
To ensure proper functionality with this Snap OS update, please use Lens Studio version v5.7.2 exclusively. Avoid updating to newer Lens Studio versions unless they explicitly state compatibility with Spectacles, Lens Studio is updated more frequently than Spectacles and getting on the latest early can cause issues with pushing Lenses to Spectacles. We will clearly indicate the supported Lens Studio version in each release note.
Checking Compatibility
You can now verify compatibility between Spectacles and Lens Studio. To determine the minimum supported Snap OS version for a specific Lens Studio version, navigate to the About menu in Lens Studio (Lens Studio → About Lens Studio).
Pushing Lenses to Outdated Spectacles
When attempting to push a Lens to Spectacles running an outdated SnapOS version, you will be prompted to update your Spectacles to improve your development experience.
Feedback
Please share any feedback or questions on the Spectacles Reddit.
For the latest release notes please see here
❄️ A Snap OS Update - Designed to Bring you Closer to Others This Holiday Season ❄️
-
🎲 3 New shared games to play with your friends and family
- 👨🍳 Clash of Cuisines - a board game where you compete to take over a city with your restaurants
- 🎭 Guess It - A holiday favorite re-imagined for AR glasses by WabiSabi
- 🐹 Spatial Whack-a-mole - get moving with others while whacking moles coming out of portals in space by Benny Paruzynski
- 📖 Star Tale (coming Dec 24)- a magical 3D holiday pop-up book experience
- 🎄 Project Holiday - immerse yourself in decorating a virtual tree in your space
- ❄️ Holiday themed updates to Beat Boxer & Make Believe to get you in the spirit of the season
- 📦 The new Spectacles Sync Kit - a revamp of our framework for developing shared AR experiences with a brand new Typescript package
- 💻 A new realtime Connected Lens monitor in Lens Studio to optimize your debugging experience of multi-player AR Lenses
- 🪪 An update to Spectacles captures to include a new Lens info end card showcasing the Lens icon and developer name, as well as a new capture settings to support additive or blending modes
- 🤝 A new guided mode to boot your device into a single Lens experience for demos and events making it easy to demo the same Lens over and over without having to launch it from Lens Explorer
- 👌 A new hand input API to get the hand velocity for interactive experiences that include use a throwing or poking interactions
- 🖐️ Reduced hand tracking jitter and improved pinch robustness.
- 🌐 Support for captive portal internet so you can connect to the internet and enjoy your Spectacles at hotels, events, and other venues
- 👩💻 A new Git repository with sample projects to help you learn how to build Lenses
- 🚄 Improved motion to photon latency
Introducing new interactive shared experiences to enjoy with family and friends - Clash of Cuisines, Charades & Whack-a-mole
This holiday season, we havemade 3 new Lenses that you can enjoy with your family as a shared AR experience. Play a risk like a game celebrating the cuisines of the world, or a holiday favorite of charades with your friends and family. If you want to enjoy a fun game with movement, try the new spatial game of whack-a-mole, these Lenses show how Spectacles are designed to bring you together with those you care about the most.
|
|
|
|
We are also releasing 2 new Lens to spread the magic of the holidays in AR including Star Tale - a magical story telling experience featuring a holiday pop-up book, and Project Holiday - a festive holiday experience where you can immerse yourself in decorating a virtual tree in AR.
|
|
Bring People Together with the Spectacles Platform
Inspired by all these different ways to bring people together and want to try yourself? We are also releasing our new Spectacles Sync Kit - a revamp of our Connected Lenses framework to make it easier to build shared experience. Those include a re-write in Typescript with improved stability. We also added 4 new sample projects and documentation to make it easier for you to follow along and build your own multi-player shared AR experiences. These are accessible from our git repository, with more projects to be added in the future.
|
|
|
|
|
Connected Lenses enable multiple users with Spectacles to view and interact with the same content in real time. Spectacles and a friend are the only requirements for play; no additional items like a printed marker are needed. Each device operates within its own unique coordinate space, determining how Spectacles perceive their position relative to the world. In a co-located connected Lens environment, you must align the coordinate spaces of the devices to synchronize digital content. Spectacles simplify this process to take seconds and feel seamless and natural. Begin by opening a shared / connected Lens, look around your environment, instruct your friend to join the same session by accessing the Active Nearby category in Lens Explorer, then have them also look around your environment. Within seconds, synchronization occurs, and you are ready to play!
|
|
Spectacles enable ease of use of Connected Lenses and the development process is simplified as well. This release introduces new platform capabilities to expedite development time. The Spectacles Connected Lenses package in the Asset Library is now the Spectacles Sync Kit, featuring:
A complete re-write in TypeScript for modularity, allowing easier navigation of its code base with type completion.
Additional examples demonstrating basic functionalities such as:
- Synchronizing moving objects across participants
- Synchronizing numeric values, such as scores
- Synchronizing material color values to maintain visual consistency
Whether using the Spectacles Sync Kit or example projects, Lens Studio facilitates fast iteration and development for Connected Lenses. Lens Studio simulates a Connected Lenses session with multiple players by creating several preview panels, each acting as an independent player.
Additionally, we are introducing a new feature, the Connected Lens Monitor, which enhances debugging capabilities. With this, you can:
- Identify the session host, who originally created the Connected Lenses
- Monitor the frequency of messages sent in the session
- Determine the order of message transmission
- Track changes in object values and their sources of change
Review our developer documentation for more details.
With the Spectacles Sync Kit, resources for Sample Projects, and the Connected Lens Monitor now available, we look forward to seeing how you utilize these tools to create your next Connected Lens experience.
Giving Credit
Many of you are having fun sharing captures of your early concepts online. To make them more personal, we are adding some improvements including:
- An end card that showcases the icon, name, and developer name for your Lens. As your Lenses get shared around the web, they will easily be recognized as your work.
- We also added some new visual transparency treatment options to make your AR capture pop more and be more true to what you experience on the glasses.
|
|
|
|
|
Captive Portal Support for Internet on the Go
We added support for connecting to the internet using Captive portals common at hotels, airports, and public venues. You can now use the Browser to authenticate when connecting to those types of networks, perfect on your travels this holiday season.
More Control over Hand Input
In this release, we are introducing a new API to help you build more refined hand based interactions in your Lens. The hand velocity API gives you access to the velocity of the hand - useful when building interactive experiences that make use of fast hand movement. Like how hard you punch in the boxing Lens.
Guided Mode for Streamlining Demos at Events and Activations
For conferences and events where you want to focus your audience on a single experience. We are providing Guided Mode, which allows you to lock the system to a single Lens that the system will show every time you turn on the device. This allows you to have a more controlled experience focused on your Lens and not worry about your users going to other Lenses.
Make your experiences Snappy with Web Sockets
In this release, we are introducing support for web sockets. Using web sockets you can connect to backend servers and establish a real-time connection to exchange data. Unlocking more responsive real-time experiences that connect to backend servers including real-time exchanges with LLMs in the cloud for a more responsive and low latency experience. To learn about how to use web sockets, please see samples and documentation here.
Versions
Please update to the latest version of Snap OS and the Spectacles App. Follow these instructions to complete your update.
Please confirm that you got the latest versions
OS Version: v5.59.218
Spectacles App iOS: v0.59.1.1
Spectacles App Android: v0.59.1.1
❗Important Note Regarding Lens Studio Compatibility
To ensure proper functionality with this SnapOS update, please use Lens Studio version v5.4 exclusively. Avoid updating to newer Lens Studio versions unless they explicitly state compatibility with Spectacles, Lens Studio is updated more frequently than Spectacles and getting on the latest early can cause issues with pushing Lenses to Spectacles. We will clearly indicate the supported Lens Studio version in each release note.
Checking Compatibility
You can now verify compatibility between Spectacles and Lens Studio. To determine the minimum supported SnapOS version for a specific Lens Studio version, navigate to the About menu in Lens Studio (Lens Studio -> About Lens Studio).
Pushing Lenses to Outdated Spectacles
When attempting to push a Lens to Spectacles running an outdated SnapOS version, you will be prompted to update your Spectacles to improve your development experience.
Feedback
Please share any feedback or questions on Reddit.
Our First Snap OS Update with new Lenses, Platform Features & APIs
- 🧠 2 New ML Lenses and 7 New Platform Features
- 🎹 Piano Tutor: Learn to play piano with interactive lessons and real-time feedback.
- ⚽ Ball Game: Interact with digital content using a physical ball.
- 📍 Spatial Anchors API (Beta): Persist content between Lens sessions.
- 🌐 Fetch and Base64 APIs: Simplify web endpoint calls and camera frame exchange.
- 📸 Image Spatialization API: Convert 2D images to 3D using generative AI.
- 🗺️ Location API (Beta): Access device GPS coordinates for location-based experiences.
- 💻 Web View Component: Embed web pages directly into your Lenses.
- 🔓 Lens Unlock: Share published Lens URLs for easy access.
- 🚀 New interactive sample scene: showcasing Spectacles Interaction Kit (SIK) capabilities
In this November 2024 update, we’ll be rolling out some of our many planned updates! We're introducing exciting new Lenses that showcase the power of the Spectacles camera and SnapML. We've also added 7 new platform features and tools to empower you to create even more innovative and engaging Lens experiences.
Introducing Piano Tutor and Ball Games
With the new Piano Tutor Lens, you have a personal piano instructor right at your fingertips. Learn to play through interactive lessons or practice your favorite songs. Piano Tutor uses a custom model powered by SnapML to adapt to different pianos all you need to do is sit down and play, eliminating the need for cumbersome manual setup and calibration, and uses another custom ML model for to detect if you played the right note and provide real-time feedback on your accuracy.
The Ball Game Lens transforms a physical ball into a controller in a virtual ball game, making it fun to practice kicking a ball through challenging virtual courses, no setup required. Using a custom tracking model, the Lens follows the ball's movements, allowing you to interact with both physical and digital elements together in a truly immersive way.
|
|
New Platform Features and APIs
We're excited to introduce the beta version of our Spatial Anchors API, enabling developers to anchor digital objects to specific locations in your surrounding and keeping them there so you can return to them later. Like a digital post it notes reminders of tasks and chores around your house. Now you can have the content of your Lens persist between sessions for a more immersive experience and ensure users can use your Lens for multiple sessions. (see examples and documentation)
We're also introducing a groundbreaking Image Spatialization API that leverages generative AI to convert common 2D image formats into 3D. Developers can now incorporate this API into their Lenses to create stunning 3D effects. In this release, we've updated the Layout Lens, allowing you to import images from your phone using the Spectacles app and spatialize them for a captivating 3D experience. (see examples and documentation)
In this release, we are unlocking your ability to use rich content from the internet in your Lens, or experiment with using camera input for experimenting with multi-modal AI. The new Fetch API and Base64 APIs simplify the process of calling web endpoints and exchanging camera frames with those endpoints in extended permissions developer mode. (see examples and documentation, and read more about experimental extended permissions)
Spectacles are the leading see through AR glasses designed for the outdoors, and with this release, we're introducing the beta version of the basic location API. This API grants access to the device's GPS coordinates, opening up a world of possibilities for location-based Lens experiences. In this release, we focused on increasing the reliability and speed of acquiring GPS coordinates, this will be a beta release followed by improvements (see examples and documentation)
We understand the value of web content, which is why we've added the new Web View component. This drag-and-drop component allows you to seamlessly embed web pages directly into your Lenses. (see examples and documentation)
Sharing your Lens creations is now easier than ever with the new Lens Unlock feature. Simply share the URL of a published Lens, and others can enter it into the Spectacles app to unlock and experience it. Unlocked Lenses remain in the 'All Lenses' section for 24 hours and if you want to come back to it frequently, you can favorite it for quick access in Lens Explorer.
Improvements and Bug Fixes
In addition to these great features, we also made some improvements and bug fixes, including:
- 🤖 Support for annotations in the Video calling Lens when calling an Android user (rolling out on Snapchat Android in the next several weeks)
- 🛠️ New encoding support in Video calling that makes it more power-efficient so you can use Video calling for longer
- 🛜 Improvements to MyAI in poor internet conditions, reduced voice response latency, and adjustment to more easily center on the region of interest
- 🪫 Added device time-out settings in mobile which enables you to adjust the time before the device shuts-down when not in use.
Please update to the latest version of Snap OS and the Spectacles App. Follow these instructions to complete your update (link)
Once update, please confirm that you got the latest versions
OS Version: v5.58.621
Spectacles App iOS: v0.58.1
Spectacles App Android: v0.58.1.0
❗A note on Lens Studio
Please only use version v5.3 of Lens Studio. Please DO NOT update to a later version of Lens Studio unless it explicitly mentions current support for Spectacles. Lens Studio is updated more frequently than Spectacles and getting on the latest early can cause issues with pushing to Spectacles. We’ll explicitly mention the supported version of Lens Studio with every release note
If you have any feedback or questions, please head over to reddit.com/r/spectacles and reply to the thread.
🎉 Spectacles Interim Update 10.16.2024
In this interim update, we have added bug fixes to improve the reliability of transferring captures from Spectacles to the phone among other bug fixes.
Please update to the latest version of Snap OS and the Spectacles App. Follow these instructions to complete your update and confirm you have the latest versions below:
OS Version: v5.57.0449
Spectacles App iOS: v0.57.9.0
Spectacles App Android: v0.57.54
❗A note on Lens Studio
Please only use version v5.1.1 of Lens Studio. Please DO NOT update to the latest version of Lens Studio unless it explicitly mentions current support for Spectacles. Lens Studio is updated more frequently than Spectacles and getting on the latest early can cause issues with pushing to Spectacles. We’ll explicitly mention the supported version of Lens Studio with every release note
If you have any feedback or questions, please respond to the thread on Reddit.