Apple unveiled new features and capabilities for its visionOS platform at WWDC24, including Room Tracking, Object Tracking, and Hand Tracking in ARKit. Other updates include RealityKit enhancements like Spacial Audio, Collisions, and Quadraphonic channel immersive music. Additionally, TabletopKit offers high-level APIs for multi-user tabletop games, while Enterprise APIs require managed entitlement and license for in-house/custom apps only. The updates also cover features like Immersive Media Viewing, Multiview Video Playback, Spatial Photo and Video, HealthKit integration, and more.
Hypervision: Micro-OLED vs. LCD – And Why the Apple Vision Pro is “Blurry” by Karl Guttag https://t.co/XE8Bx2U6mI #VirtualReality #VR #AppleVisionPro
Not enough people read this important and serious article I wrote about Apple Vision Pro. To celebrate the impending international launches, here it is again. If you have VR headsets in your home, please read this before bringing Apple Vision Pro home. https://t.co/IsvyPH1Tnc
The Apple Vision Pro allows see through reflections on translucent 3D objects that also interact with its digital screen. Nice. https://t.co/ncqDJrJswv
visionOS: Design Interactive Experiences #WWDC24 - Design for your story, Maximize real-world space - Introduce interactivity, Connect with your characters - Design for your audience, Respect audience choices - Take care about accessibility Session: https://t.co/Qa9lYcYxHq https://t.co/Yov42GqDZc
Unity 6 Preview Will Soon Add Pre-Release Support For visionOS 2 - @UploadVR https://t.co/raHMol6YxI #VirtualReality #VR #unity #AppleVisionPro
visionOS: Design Great VisionOS Apps #WWDC24 - Make new things possible - Transport people somewhere new - Integrate with physical surroundings - Design meaningful sound - Keep interactive content close to people - Abstract away complexities Session: https://t.co/nB0JoEfCvu https://t.co/K7C0MAj9qH
With visionOS 2, Apple Vision Pro Can Support Room-Scale VR - @UploadVR https://t.co/zzokVHhuc3 #VirtualReality #VR #AppleVisionPro
visionOS: Game Input #WWDC24 - System gestures are easy and natural: Direct/Indirect, Combination gestures - Use custom gestures sparingly and accessible with Hand Tracking in ARKit - Physical controllers can expand your input options Session: https://t.co/vpru4RvhyS https://t.co/2RkYsEfo3K
🫵 Join the https://t.co/KFY5DDVuGw 😎 »What Is the #Apple #VisionPro? A #Lifesaver for #DisabledUsers.« https://t.co/jWqRLjjwbz #Metaverse #VirtualWorlds #VR #AR #MR
visionOS: Creating Custom Environments #WWDC24 - Design considerations - Optimizing 3D assets: Reduce meshes, Create texture atlas and HDRI for Light/Dark modes - Case Study - Blender and RCP: Change Root Prime name, Disable tone map in RCP Session: https://t.co/0XXULhdKlN https://t.co/IiIryLKARH
RealityKit: Object Capture #WWDC24 - Area mode (2.5d surface): iPad Pro 2021/iPhone 12 Pro and later with LiDAR - Mac sample app for high-res processing: Quad mesh, up to 16K textures, up to 2,000 images - APIs: Area mode, Custom object masking Session: https://t.co/vTQ7COIStt https://t.co/teL1hDMx68
With visionOS 2, Apple Vision Pro Can Print What You See - @UploadVR https://t.co/zloWp0DGbf #VirtualReality #VR #MixedReality #Apple #AppleVisionPro
Professional Tools For Creating Apple Immersive Videos & Spatial Videos Are Coming - @UploadVR https://t.co/D5tzAaF2WK #VirtualReality #VR #Apple #AppleVisionPro
I've been falling into the Spatial Media trap after Apple Vision Pro. Didn't enjoy it much before that hmd but the quality converted me. I think along with AI tooling something big is about to happen. Great article to catch up on the camera options. https://t.co/a2RQMGadch
visionOS: HealthKit #WWDC24 - Adopt HealthKit in visionOS: query health data, aggregate and compute statistics, register for updates between multi-devices with iCloud - Refine UX: Multi-windows, Immersive space - Handle Guest User errors Session: https://t.co/xYyPmRJgY5 https://t.co/NoyapqStdl
visionOS: Spatial Photo and Video #WWDC24 - Stereoscopic video - New APIs for Spatial Video: Recording, Loading, Presenting - AVPlayerViewController - Custom Spatial Media: File format, Metadata Session: https://t.co/6gSXFvkVYE https://t.co/Mo1DS0rGuf
visionOS: Multiview Video Playback #WWDC24 - Up to five simultaneous playback - AVPlayerViewController, AVExperienceController, Browser View Controller - Support graceful progression, Consider the use case, Support intuitive content browsing Session: https://t.co/AiQDpVT76K https://t.co/MZ8irCJnXi
RealityKit: Immersive Media Viewing #WWDC24 - Custom Docking Region - Media reflection shaders: Specular / Diffuse - Environment Probe, Brightness/Tint, Reverb - Environment Picker - SharePlay: synchronization of the environment state Session: https://t.co/vT3Aj40LYr https://t.co/RgTCRBevOD
visionOS: Enterprise APIs #WWDC24 - Requires managed entitlement and license, In-house/custom apps only - Main camera access, Barcode/QR code scanning, Passthrough Screen capture - ANE access, Object Tracking adjustment, Performance settings Session: https://t.co/ybariTpBKU https://t.co/ZF3W1gzyPz
visionOS: TabletopKit #WWDC24 - High-level APIs for multi-user tabletop games - Make a table, Place seats, Place equipment - Implement rules: Monitor interactions, Append actions - Configure multiplayer Sample: https://t.co/Fm4ZHImDR4 Session: https://t.co/5VgrwKzZ6Y https://t.co/mzfQqQ1gMy
visionOS: RealityKit Spacial Audio #WWDC24 - Spacial Audio: AudioGeneratorController, Distance attenuation - Collisions: Audio materials - ReverbComponent - Quadraphonic chan. immersive music - Mixing audio sources Code: https://t.co/9rNAlo0hth Session: https://t.co/rulxsZRNWz https://t.co/LHZR6VOJHW
Our new XR avatars on Apple Vision Pro 🥽 https://t.co/UA9VIVk9vT
visionOS: ARKit #WWDC24 - Room Tracking: RoomAnchor - Plane Detection: Slanted plane - Object Tracking: new - World Tracking: Oriented-based tracking by system - Hand Tracking: HandAnchor, Prediction API Sample Code: https://t.co/H3AtmqBRo7 Session: https://t.co/ER7L3uyUFx https://t.co/gU4EO6G6BM