微软Hololens全攻略：Windows Mixed Reality深入指南

需积分: 10 90 浏览量更新于2024-07-18 1 收藏 63.03MB PDF 举报

"《Windows Mixed Reality for Hololens》是一份详尽的微软官方文档，针对Microsoft HoloLens这款混合现实头戴设备进行了深度剖析。该PDF文件共1550页，内容覆盖了HoloLens硬件的全方位介绍、基础概念、开发工具安装、核心功能、应用程序类型、以及与Azure云服务的集成等多方面。首先，文档介绍了什么是混合现实（Mixed Reality），以及什么是全息图（Hologram），帮助读者理解这种技术的基本原理。接着深入解析了HoloLens硬件的细节，包括沉浸式头戴设备的特性和配件，为开发者提供了全面的硬件参考。核心组件部分，文档讲解了关键技术如视线追踪（Gaze）、手势识别（Gestures）、运动控制器（Motion controllers）以及语音输入（Voice input）。这些是用户与虚拟环境交互的基础，对用户体验至关重要。空间定位（Spatial mapping）和空间音频（Spatial sound）也是关键章节，它们使用户能够感知虚拟世界的真实感。文档还讨论了坐标系统（Coordinate systems）和空间锚（Spatial anchors），这些是构建空间一致性的基石。在应用开发方面，文档列举了混合现实应用的几种类型，并阐述了应用程序模型（App model）和不同视图模式（App views）。此外，Microsoft Academy部分提供了丰富的实战教程，如MRBasics 100-108，一步步引导开发者从入门到完成项目，包括实际使用设备或模拟器的情况。更高级的主题包括语言翻译（MR and Azure 301）、计算机视觉（302）、定制视觉（302b）、自然语言处理（303）、面部识别（304）、函数和存储（305）、视频流（306）、机器学习（307）以及跨设备通知（308）。这些内容展示了如何利用Azure云服务扩展HoloLens的应用潜力。《Windows Mixed Reality for Hololens》是一本全面且实用的指南，无论是对于想要了解HoloLens的潜在开发者，还是已经在使用中的开发者，都是深入学习和提升技能的重要参考资料。通过这份文档，读者能够掌握从基础到进阶的混合现实开发技术，并探索其与云端服务的集成可能性。"

CHARACTERISTIC HOLOGRAPHIC DEVICES IMMERSIVE DEVICES

Example Device Microsoft HoloLens Acer Windows Mixed Reality Development

Edition

Display See-through display. Allows user to see physical

environment while wearing the headset.

Opaque display. Blocks out the physical

environment while wearing the headset.

Most mobile phones on the market today have little to no environmental understanding capabilities. Thus the

experiences they offer cannot mix between physical and digital realities. The experiences that overlay graphics on

video streams of the physical world are augmented reality, and the experiences that occlude your view to present a

digital experience are virtual reality. As you can see, the experiences enabled between these two extremes is mixed

reality:

Starting with the physical world, placing a digital object, such as a hologram, as if it was really there.

Starting with the physical world, a digital representation of another person

–

an avatar

–

shows the location

where they were standing when leaving notes. In other words, experiences that represent asynchronous

collaboration at different points in time.

Starting with a digital world, physical boundaries from the physical world, such as walls and furniture, appear

digitally within the experience to help users avoid physical objects.

Most augmented reality and virtual reality offerings available today represent a very small part of this spectrum.

They are, however, subsets of the larger mixed reality spectrum. Windows 10 is built with the entire spectrum in

mind, and allows blending digital representations of people, places and things with the real world.

There are two main types of devices that deliver Windows Mixed Reality experiences:

1. Holographic devices. These are characterized by the device's ability to place digital content in the real world as

if it were really there.

2. Immersive devices. These are characterized by the device's ability to create a sense of "presence"

–

hiding the

physical world and replacing it with a digital experience.

Movement Full six

degrees

freedom movement, both

rotation and translation.

Full six

degrees

freedom movement, both

rotation and translation.

Devices and experiences

Note, whether a device is connected to or tethered to a separate PC

(

via USB cable or Wi

)

or self

contained

(

untethered

)

does not reflect whether a device is holographic or immersive. Certainly, features that improve

mobility lead to better experiences and both holographic and immersive devices could be tethered or untethered.

Technological advancement is what has enabled mixed reality experiences. There are no devices today that can run

experiences across the entire spectrum; however, Windows 10 provides a common mixed reality platform for both

device manufacturers and developers. Devices today can support a specific range within the mixed reality spectrum,

and over time new devices should expand that range. In the future, holographic devices will become more

immersive, and immersive devices will become more holographic.

Often, it is best to think what type of experience an app or game developer wants to create. The experiences will

typically target a specific point or part on the spectrum. Then, developers should consider the capabilities of devices

they want to target. For example, experiences that rely on the physical world will run best on HoloLens.

Towards the left

(

near physical reality

)

. Users remain present in their physical environment and are never

made to believe they have left that environment.

In the middle

(

fully mixed reality

)

. These experiences perfectly blend the real world and the digital world.

Viewers who have seen the movie Jumanji can reconcile how the physical structure of the house where the

story took place was blended with a jungle environment.

Towards the right

(

near digital reality

)

. Users experience a completely digital environment and are oblivious

to what occurs in the physical environment around them.

Here's how different experiences take advantage of their position on the mixed reality spectrum:

Skype on Microsoft HoloLens. This experience allows collaboration through drawing in someone's physical

environment. As an experience, it is currently further left on the spectrum because the physical environment

remains the location of activity.

Fragments and RoboRaid. Both of these take advantage of the layout of the user's physical environment, walls,

floors, furniture to place digital content in the world. The experience moves further to the right on the spectrum,

but the user always believes they are in their physical world.

HoloTour on Microsoft HoloLens. HoloTour is designed with an immersive experience in mind. Users are

meant to walk around tourist locations. On HoloLens, HoloTour pushes the limits of the device's immersive

capabilities.

When you have a particular location where you want a hologram, you can place it precisely there in the world. As

you walk around that hologram, it will appear stable relative to the world around you. If you use a spatial anchor to

pin that object firmly to the world, the system can even remember where you left it when you come back later.

Some holograms follow the user instead. These tag

along holograms position themselves relative to the user, no

matter where they walk. You may even choose to bring a hologram with you for a while and then place it on the

wall once you get to another room.

Best practices

Some scenarios may demand that holograms remain easily discoverable or visible throughout the experience.

There are two high

level approaches to this kind of positioning. Let's call them "display

locked" and "body

locked".

Place the hologram at a comfortable viewing distance typically about 1

2 meters away from the head.

Provide an amount of drift for elements that must be continually in the holographic frame, or consider

animating your content to one side of the display when the user changes their point of view.

Display

locked content is positionally "locked" to the device display. This is tricky for a number of reasons,

including an unnatural feeling of "clingyness" that makes many users frustrated and wanting to "shake it

off." In general, many designers have found it better to avoid display

locking content.

The body

locked approach is far more forgivable. Body

locking is when a hologram is tethered to the

user's body or gaze vector, but is positioned in 3d space around the user. Many experiences have adopted

a body

locking behavior where the hologram "follows" the users gaze, which allows the user to rotate

their body and move through space without losing the hologram. Incorporating a delay helps the

hologram movement feel more natural. For example, some core UI of the Windows Holographic OS uses

a variation on body

locking that follows the user's gaze with a gentle, elastic

like delay while the user

turns their head.

Place holograms in the optimal zone

between 1.25m and 5m

Two meters is the most optimal, and the experience will degrade the closer you get from one meter. At distances

nearer than one meter, holograms that regularly move in depth are more likely to be problematic than stationary

holograms. Consider gracefully clipping or fading out your content when it gets too close so as not to jar the user

into an unexpected experience.

剩余1549页未读，继续阅读

xiaomaoo

粉丝: 1
资源: 3

微软Hololens全攻略：Windows Mixed Reality深入指南

Windows Mixed Reality 设备安装操作指引

Beginning Windows Mixed Reality Programming 无水印pdf

Windows Mixed Reality Development.pdf

微軟-Hololens-混合現實平台開發.pdf

科技行业先锋系列16：微软发布Hololens2，助推混合现实-0228-中信证券-11页.pdf

科技行业先锋系列16：微软发布Hololens2，助推混合现实-20190228-中信证券-11页.pdf

混合现实 零售领域版.pdf

混合现实 制造领域版.pdf

《全球虚拟增强现实产业报告（2020年）.pdf

Hololens2入门

最新资源

混合现实零售领域版.pdf

混合现实制造领域版.pdf