A Vision Pro Perspective
I have used many different VR headsets at hackathons and studio labs, but the visual quality was less than desirable. Reading in them was far less than optimal. I had found the 3D immersive capabilities somewhat interesting for training physical tasks and heightening awareness skills. But, the quality of the headsets’ visual quality and rough interaction models were large hurdles to overcome.
A couple years back (or so) I had tried the Apple Vision Pro out of curiosity at an Apple Store, after its launch and impressive walkthroughs. I was blown away with the visual quality as it was generations better than other options out there. But, the interactions with the apps and interface were incredibly simple to understand and became very quickly intuitive.
The Apple Store demo really piqued my interest. I could see its upsides for consumption. But, I could also see the potential for using it for remote work and interaction environments. That work potential became a large curiosity. The price of the Apple Vision Pro was a huge hurdle to go digging for the sake of curiosity. But, when Apple added the capability for a virtual monitor for your Mac with wide and ultrawide options, that started nudging the viability for curiosity. But, the price was still a bit too steep. I started looking at used Vision Pro models and prices were around $1k off new purchase prices. The friction there was knowing how to find one in good shape. I asked in an Apple forum I am part of how to purchase a used Vision Pro and someone in the forum had one they were thinking about selling. We chatted and worked out how to meet and purchase the device.
I figured if the two big things I had interest in it was worth the investment in the used AVP: 1) Viability for virtual meetings; 2) Virtual monitor. If it didn’t meet my interest or curiosity waned, I figured I could sell it on and get close to what I paid.
Before the Two Use Cases I Care About
The questions many ask are around:
- Quality?
- The quality of the hardware, visual displays, and interactions are seriously impressive. Opening web pages and reading ebooks is really nice clean and really impressive. There are no jaggies nor glitching.
- Does it feel heavy?
- I picked up the Annapro 2 add-on that is a brace that is padded and used at the top of the forehead area that takes the weight off your face and balances it much better. I regularly will have 2 to 5 hour sessions with the Vision Pro on and it doesn’t feel heavy nor cause neck strain for me.
- How much do you use it?
- I used it at least once a week, but many weeks around three times a week for tasks, virtual monitor use (more on this below), and some content consumption.
- App availability?
- There are apps for most things I do (many of my regular apps are available as visionOS native apps, and most other are available as iPad apps that are made Vision Pro capable), but not all apps that I really want are available as native visionOS apps. Two of the apps I really want on the device are the Drafts app (this is how I capture and surface quick notes across devices, not having it natively is a pain) and iA Writer as the Vision Pro a great device for focussed work (the input side is something). Having native Obsidian would help a lot as well, but that is more difficult as it is an Electron-based app.
- I really want data visualization apps for larger data sets or data with a lot of complications, so that scaling the interface allows for better examination and interrogation of the data.
- I really want Freeform as a solid whiteboard option, but it is so close and yet so far.
- Isn’t it mostly a content consumption device?
- The consumption capabilities of the Vision Pro are amazing, but for a consumption primary device the price is a bit much. The immersive environments to work in or consume content in are insanely well done. The immersive video content is stunning to say the least. Watching movies or other video content is a really good experience in 3D or regular viewing.
Curiosity Around Virtual Meetings
The Apple marketing pitched the Vision Pro as a good virtual interaction device. It used personas that were your face and hands. But, the big question I had around this was the ability to have meetings with colleagues that normally require hopping on a train or plane to get in the same room for 2 to 4 hours, or a couple days. That in-person interaction around plans in documents, presentations, spreadsheets, and whiteboards with a few people seems really viable. I really wanted to test it out that interpersonal interaction capability.
People that work together are most often rather distributed these days and there is no getting around that and travel isn’t cheap. But, if you can shift two or three fly-in meetings to Vision Pro you have basically paid for the device. But, if you can have more solid interactive meetings between the fly-in meetings that have better value than Zoom or Teams or even augment them with greater interaction and fidelity, that is a great win as well.
When I picked up my used Vision Pro it was still the first version of visionOS. The personas were decent and far better than other VR / AR providers, but could be better. Within a few months a major update was made and the personas really became good. Within a few minutes you forget you are interacting with a persona, and it feels normal with great facial gestures and hand and shoulders captured too.
Trying the interaction around documents and presentations with friends has been incredibly good. Once you open a document the person(s) you are interacting with shift from in front of you to arranged next to you and can point and touch what is being shared. This was and is incredibly good. I’ve done 2 and 3 hour sessions in the virtual meeting sessions and for most things it is really good where showing, talking about, interacting in shared documents, and editing is quite good.
The two limitations of this model are: 1) SharePlay is used for the interactions so it is capped to 5 people in the virtual interactive environment at a time; 2) The whiteboard with Apple’s Freeform (Apple launches Freeform) is their virtual whiteboard, which is similar to a Miro or Mural. The 5 person limitation isn’t bad and it is fine for many fly-in meeting needs for planning and check-ins, but 10 for in the same space and then have 5 person breakout sessions with much better interaction would really go a long way. Freeform in Vision Pro really need an input device and the best option is an iPad, which is rather good, but really needs a few more improvements. The iPad Pro with the Pencil Pro and the virtual shadow and the shadow for bevelled orientation seems like it was designed with Vision Pro in mind. But there needs to be some sort of pass-through to take some of the friction out of this. You can get rather proficient with a little time using the iPad Pro as the Freeform interface to do detailed work. The dedicated virtual pens lose fidelity and detail and from my perspective are a poor option.
A great advantage of using the Vision Pro virtual meetings is the focus of participants. In regular meetings most participants aren’t focussed on the matter at hand. For fly in meeting with distracted participants that is a very expensive problem. The distractions are normal and viable to keep on top of projects and problems that happen no matter if a meeting is happening or note. The advantage of Vision Pro is it puts the meeting front and center and the interactions with others in the shared virtual meeting, which is an amazingly strong value.
For virtual meetings this is a good option, but almost there and there needs to be some focus on what is needed to get there. There have been small steps, but the steps need to be more frequent and a bit larger. The other downside is a network effect problem (network effect as the converse), as there aren’t enough people who have Vision Pro devices to have ad hoc meetings with partners and clients at the drop of a hat. I have a few friends whom I interact with that I can test the advances around Share Play and different shared interaction capabilities.
Virtual Monitor
The other added value functionality I was curious about was the Virtual Monitor for Macs. I use the Vision Pro as a virtual monitor for my MacBook Pro quite a bit. The ability to use regular width screen (roughly equivalent to my 16 inch Mac Book Pro or a bit bigger), wide screen (about two screen widths), and ultra wide that wraps (about 3 screens) is really impressive. I most often use the ultrawide option when I need 3 or 4 apps open to have a screen I’m working in, one screen size for my notes, and one or two for reference.
There are two upsides for the Virtual Monitor mode. One is the ability to have Vision Pro apps open around the monitor mode as sticky notes, MindNote mindmap app, Safari floating with a page open, OmniOutliner lists open, and Apple Music. When I’m at my desk I have an external monitor to the left of my laptop stand, so I have two screens. The real life two screen setup causes more neck strain than the wide or ultrawide screen (by a long shot) and that is including the weight of the Vision Pro headset.
The quality of the pass through was a big question. The quality isn’t the same as the amazing screen on the MacBook Pro, but it is two 4k monitors with one in front of each eye. It sometimes is a little less than optimal, but if I move the virtual monitor either closer or farther back it gets to a sweet spot for really nice clarity. I don’t use the virtual monitor or ultra detail work or color precision work as the MacBook Pro screen is superior (similar for my 4k external monitor on my desk).
Two things I really enjoy doing in the virtual monitor are working on system mappings as I can go really wide and tackle and working in Freeform as a virtual whiteboard (it would be so much better were Freeform inputs much better in Vision Pro in its native app). I use Canvas in Obsidian for some capturing of systems and models, I also use OmniGraffle (the Mac version, as there isn’t an Vision Pro version yet, nor a working version of the iPad app for OmniGraffle 8 - I’m moved most of my OmniGraffle work into the beta of version 8 over the last year). In OmniGraffle I don’t use paper size, as I only use it for digital work, so I can go quite wide and tall.
One other advantage of the Virtual Monitor is that for the price of three good 4k monitors the Vision Pro is around the same price.
Vision Pro Impression Today
I still have the Vision Pro and I still get a lot of value from the device and regular use. There are some weeks where much of my use in the device is consumption, but pure consumption weeks are fairly rare.
One of my favorite uses is to put it on and just focus on work and tasks. Dropping into an immersive environment or the TGV app (a virtual TGV train trip that can provide a train focussed environment through the developer capabilities). I find trains are a great focus environment to get things done for me and this app works really well to resemble that.
I am really happy I picked up the Vision Pro, particularly used, as the price point felt it was quite on target. I really would love for Apple to take larger and more progressive steps. There are times I don’t know that Apple understands the full impact and focus of all the use cases, but I’ve virtually attended a few of the Vision Pro Developer full-day series and Apple is covering a lot of ground and covers many of the use cases well. I look forward to what is coming down the road.