As an “infinity monitor” you can use anywhere, it is really great.
But it is not - as it was advertised - a “spatial computer”. I can’t even think of it as an AR device, because it is terrible at image recognition and tracking… something even an iPhone can do. I have no idea why that is the case, because the hardware is, theoretically, ridiculously powerful… but something is seriously, seriously wrong with the software right now… and it cripples the headset for what is supposed to be it’s one major use-case: spatial computing.
P.S. In case it wasn’t obvious, I bought one to develop for, and as a developer I’m pretty angry at how poorly it performs at basic AR tasks.
So Apple hardware that’s super powerful but has bad software to support all that power?
“Where have I heard that one before?” he types on his iPad Pro…
Ouch. Don’t get me started on iPad “Pro”. There is nothing “Pro” about a device that is so heavily sandboxed and restricted to only installing things from a single, heavily curated app store. 😫
Such great hardware and UX, ruined because their app distribution monopoly is more profitable than moving devices.
I’m less bothered about the App Store than I am just allowing these devices with these very powerful chips to stretch their wings.
And it’s just simple things, too. iPadOS should allow you to have two different audio tracks going at once. It can handle that. But it’s too skewed to being a “bigger iPhone” than it is a “smaller MacBook.”
And I honestly love my iPad. Using it right this moment with a wireless KB and trackpad. And I’m happy I can extend the display relatively easily to a monitor now, too.
But it could definitely be so much more if the handcuffs were taken off.
What’s the use-case you’re trying to build?
I have a card game (a physical one, not virtual) and I want to “replace” the real cards with digital, animated, “living” ones. Ideally, I could apply this technique to other types of tabletop game, later… but cards are the current project.
This works fine on iOS and even in the Vision Pro simulator, but on hardware, the image recognition is slow and unreliable, and it doesn’t track items through space in real-time. It’s laggy and “floaty”. Image recognition for unique, flat cards should be one of the simplest possible use-cases… and given how much more powerful the hardware is than a phone, and the fact that it works on the simulator, it sure seems like a software issue… but you can’t ship Apps with such severe problems, either.
It looks like you’re hitting what this person called out:
https://twitter.com/nathanwchan/status/1754624863762047162?s=46&t=uP3SZsZSJ5VGsmbyPE2Jfg
And that is a sucky limit that makes your use-case not usable-able. Which is a shame because it’s a cool use-case.
The tracking is great for everything except image tracking, too.
Yu-Gi-Oh is finally becoming a reality
What do you mean with image recognition?
Like show it an image of a cat and it should recognize what it is?
Yeah. You train it to recognize an object/image, and then you can respond to that however you want, programmatically. It’s really cool for things like tabletop games.
For the how: Apple has APIs to including lightweight ML models for that sort of thing. You have to train a model, but for something like a card game it’s super easy. For physical objects it requires more prep just because you have to take photos instead of using existing artwork… but it’s still relatively straightforward.
This is pretty good article about the way a Vision Pro can be used in your day to day. But to get lemmy’s apple enthusiast required Apple Bad out of the way…
So here goes, from the article:
the Vision Pro still isn’t something most people should consider buying
There. Anyway.
I’m going on my first flight today since getting my Vision Pro and I’m excited. I downloaded some random shows, including some from an iPad app, and the 3D version of Mad Max: Fury Road!
I fully expect it to be a buggy, early-adopter-quality experience, but I’m psyched.
I am thoroughly enthused, one might say.
Well, how did it go?
It was honestly an incredible experience.
The flight had wifi and I had sprung for a seat with a charging port, so I was able to use it for nearly the entirety 6 hours of the flight with the exception of take off and landing.
I turned on travel mode before the plane started moving. I’ve heard that if you don’t it can be buggy getting into travel mode.
After that I saw maybe one or two hitches. If I looked down the tracking would fail but otherwise it was smooth the whole way.
I would say that watching Mad Max with it projected out above the lake in Mount Hood was the best 3D movie experience I’ve had. That I was on a plane the whole time was almost inconsequential.
I also watched some youtube videos and wow presents+ videos. I could have used the in-flight entertainment as well, since it was streaming at high resolution through Safari.
I was able to text and do other stuff as well during the flight.
I felt a little self conscious wearing it when the flight attendant came by so I’d always pull it off my head each time. This messed with the volume of my bluetooth headphones.
But when I went to power down the headset for landing I saw someone else doing the same with his vision pro so I don’t feel as bad about my wearing it.
Definitely an expensive device for the experience, but still incredible!
I guess if you spend all your time working with a laptop on a kitchen counter, this product can with that.
… but WTF are you doing working on a kitchen counter? Get yourself a proper desk. Seriously. And if you’ve got a proper desk two or three large displays will provide better pixel density and a more comfortable work environment for a lot less money.
I can get behind using it for mediation, gaming, watching videos, etc… but no way am I going to spend this kinda money on any of those use cases. I look forward to a future version that is an order of magnitude cheaper.
telepresence
This is an article about using the device away from your desktop machine.
