How To Classify Objects In AR With Lightship Semantic Segmentation ?

Dilmer Valecillos
Dilmer Valecillos
3,143
0
Published 2022-06-13
In today's video I walk you through how to setup semantic segmentation with Lightship ARDK for Unity to classify objects in AR. The AR Components covered today are:

- AR Semantic Segmentation Manager
- ISemanticBuffer and SemanticBufferUpdated action
- SemanticBufferProcessor with CopyToAlignTextureARGB32
- Logging awareness buffer information such as channel indexes and channel names
- Using Semantic Textures with RawImage UI component

📌 Project and source code shown in this video available in Patreon:
www.patreon.com/dilmerv

⚡️ JOIN THE TEMPLATE Challenge for chance to win up to $10,000 ⚡️
lenslist.co/dare/lightship-explore-challenge

📌 Official Niantic Lightship ARDK Unity Semantic Segmentation docs:
lightship.dev/docs/ardk/context_awareness/semantic…

📌 Get XR & game development tips from me in Twitter
www.twitter.com/dilmerv

🥽 Learn & Get my XR Training from:
www.learnxr.io/

👉 My Blog / 🔥 Newsletter (Subscribe to get up to date XR news)
blog.learnxr.io/

#niantic #lightship #unity
All Comments (9)
  • @adamhegedus8189
    Nice tutorial! Though, make sure to to destroy your textures when you clear the masks, otherwise they are going to leak (C# GC doesn't know about Unity objects).
  • @KtyJust
    If i want to add my own shader, does it work with URP oder HRDP? And do I have do write it in C or can I use the shadergraph?
  • @KtyJust
    Hi thank you for your tutorial. When I try to build it on my phone it doesnt activate the camera. Does this even work with the camera and real surroundings?
  • @rajatbhalla1455
    Hello, I am a patron of you. I want to know is there anyway to change or modify ARCamera texture to ano0ther color like a filter? Same as we can do in shader file of Vuforia ARBackground. Please make a tutorial for that as well. I need it urgently. Thanks a lot!!