Generative Fortune Telling
AR Engineer of Pilot lens + Generation pipeline
ML, LLM, Gen AI, ChatGPT, Image Generation
The Fortune Telling Lens was one of the lenses piloted at Snap to demonstrate the use of LLM and Image Generation technologies for lens content generation. The objective of this particular lens was to eliminate the necessity of users inputting text prompts, and instead have them steer the outcomes through more intuitive and engaging interactions. This lens uses ChatGPT and SnapFusion to generate tarot cards that read users' futures. The outcomes are generated based on users' preferred attributes.
Sync Framework
Partial Contributor of template
Shared AR, Multi-User, Synchronous, Back-end, Persistence
Snapchat offers Lens Developers a way to create AR experiences that friends can experience together at the same time and can return to over time called Connected Lenses. In order to help streamline and assist you in building Connected Lenses, we have introduced a new custom component called Sync Framework.
Sync Framework is a set of scripts and components designed to help you make Connected Lenses for building shared online multiplayer experiences, both synchronous and asynchronously. While building Connected experiences, it should be easy to synchronize any entity in a Connected Lens (like a SceneObject or Component) across the network.
Sync Framework - Voting
Owner of template + Documentation
Shared AR, Multi-User, Synchronous, Back-end, Persistence
The voting template shows Lens Studio developers how to use Sync Framework to build an AR experience that allows multiple users to contribute their input for selection in a shared session. This template is a good place to start with if they want to build a lens for voting, quiz games, or anything else that requires selection input from multiple users, with each user being represented by a character in the session.
Ring Try-on
Owner of Feature + Dev APIs
ML, AR Try-on, Hand Tracking, Algorithms, 3D Math
The Ring Try-on feature serves as one of the many try-on features in Lens Studio based on human body understanding. On top of the current hand-tracking model, the ring try-on uses algorithms to compensate for the deficiencies in the stability and accuracy of hand tracking.
This project was a collaboration with the computer vision engineering team and the lenses team. The objective was to optimize and utilize this feature to build campaign lenses for Cartier, ensuring accuracy, high performance, and stability.
Sender
Receiver
Interactive Snaps
AR Engineer of Prototype
User Experience, Persistence, Back-end, Rendering, On-Device Authoring
Interactive Snaps are bite-size interactive experiences easy for Snapchat users to consume.
While the sender of the lens can author the lens using a “template lens” and send it to a friend through chat, the receiver can unlock this experience from chat and interact with it.
Pixel Accurate Rendering
AR Engineering Support
UI/UX, Design, Front-End, Rendering
Pixel Accurate Rendering allows developers to render content perfectly based on their pixel size in Lens Studio. For example: a logo that needs to be correctly sized to avoid aliasing. Or, if they are designing UIs in an external software, it can be useful for translating exact measurements (e.g. pixels or points) from those softwares into their Lens.
Face Stickers
Owner of template + Documentation
Engagement, Usability
The Face Stickers template allows Lens Studio Creators to quickly build a face sticker Lens. With this template, they can place any images or texts of their choice on positions relative to the face. The object was to design a streamlined creation experience that lowers the barrier for Lens Studio creators.
In-Lens-Digital-Goods
AR Engineering Support
User Experience, Persistence, Usability, Monetization
Digital Goods are unique items within a Lens that Snapchatters can unlock with Snap Tokens. Examples include image enhancement features (e.g. photo editing tools), accessories (e.g. sunglasses), custom entertainment (e.g. exclusive sounds or music), and more.
Mesh / 3D Text to VFX
Owner of Asset
VFX, Rendering, 3D Hand Interactions
A Lens Studio asset that converts any 3D mesh or 3D text to VFX.