ai与虚拟现实_AI使虚拟现实和增强现实更加真实的8种方式
ai与虚拟现实
by Mariya Yao
姚iya(Mariya Yao)
AI使虚拟现实和增强现实更加真实的8种方式 (8 Ways AI Makes Virtual & Augmented Reality Even More Real)
This piece was written & edited in collaboration with TOPBOTS writer Nick Hall.
这篇文章是与TOPBOTS作家Nick Hall合作编写和编辑的。
Regular reality is being disrupted by virtual and augmented reality (VR/AR). The biggest names in tech are battling to power the next generation of entertainment, education, and communication.
虚拟现实和增强现实(VR / AR)破坏了常规现实。 科技界的知名人士正在努力为下一代娱乐，教育和通讯提供动力。
Facebook acquired Oculus to make next generation social networking virtual. Apple CEO Tim Cook claims augmented reality will be “as big as the iPhone.” Microsoft’s HoloLens, Google’s Tango, and Intel’s Project Alloy are just a few of the myriad of developments underway to make VR/AR devices as ubiquitous as computers and phones.
Facebook收购了Oculus，以实现下一代社交网络的虚拟化。 苹果首席执行官蒂姆·库克(Tim Cook) 称增强现实将“与iPhone一样大”。 微软的HoloLens，谷歌的Tango和英特尔的Project Alloy只是使VR / AR设备像计算机和手机一样无处不在的众多发展中的几个。
Another major trend, artificial intelligence (AI), boosts the technical complexity behind compelling VR/AR experiences. Despite the hype, the progress that AI drives in VR/AR are by no means artificial.
人工智能(AI)的另一个主要趋势是，在引人入胜的VR / AR体验背后增加了技术复杂性。 尽管进行了大肆宣传，但AI在VR / AR中驱动的进展绝不是人为的。
Here are 8 specific ways that AI makes our virtual realities even more real.
以下是AI使我们的虚拟现实更加真实的8种特定方式。
1.物理环境图 (1. Physical environment mapping)
Occipital’s Bridge is one example of how AI can help to map entire environments in real time and blend the results with a virtual world. The external ‘structure sensor’ on Bridge feeds into an AI system and allows a ‘mixed reality’ experience entirely in the headset. This works thanks to the magic of instant depth perception and precise positioning with six degrees of freedom. The result is that you get a fully immersive VR experience with real world structures.
枕骨桥是AI如何帮助实时绘制整个环境并将结果与虚拟世界融合的一个示例。 Bridge上的外部“ 结构传感器 ”可输入AI系统，并完全在耳机中提供“混合现实”体验。 这要归功于即时深度感知和六自由度精确定位的魔力。 结果是您获得了具有真实世界结构的完全身临其境的VR体验。
The fledgling system can already produce CAD-quality models of your house, so you can try furniture and decorations before you buy. This mixed version of reality could provide precise AR shopping experiences in local retail stores. The company is also inviting developers to build new apps and is taking an open-source approach.
刚起步的系统已经可以制作出具有CAD质量的房屋模型，因此您可以在购买前尝试使用家具和装饰品。 现实的混合版本可以在本地零售店提供精确的AR购物体验 。 该公司还邀请开发人员构建新的应用程序，并正在采用开源方法。
Google Tango is arguably more advanced and already in the wild on the Lenovo Phab 2. So far, most of the apps targeted at the phone have been relatively simple games. We expect that to change rapidly.
谷歌Tango可以说是更高级，并且已经在Lenovo Phab 2上狂奔。到目前为止，针对手机的大多数应用程序都是相对简单的游戏 。 我们希望这种情况会Swift改变。
2.精确的深度感知 (2. Precise depth perception)
It’s one thing to map the walls of a building, it’s quite another to map the constantly shifting internal organs of a patient on the operating table. We’re closing in on a world where a surgeon will see your major organs through a headset, with a modern-day slant on X-ray vision. Indeed, we have the first concepts from the likes of mbits imaging and the ‘Surgery Pad’.
绘制建筑物的墙壁是一回事，绘制手术台上患者不断变化的内部器官是另一回事。 我们正在接近一个世界，在这个世界上，外科医生可以通过头戴式耳机看到您的主要器官 ，并且可以对X射线视线进行现代倾斜。 确实，我们拥有mbits成像和“ 手术垫 ”之类的第一个概念。
Looking further into the future, surgical robots will take over routine procedures. An essential part of these devices will be automatic depth perception and instant, accurate adjustments. Even regulated breathing causes slight shifts in the patient’s position, so only the precision of AI can cope with the vast number of calculations that will make the difference between a clean cut and a severed artery.
展望未来， 外科手术机器人将接管常规程序 。 这些设备的基本组成部分将是自动深度感知和即时，准确的调整。 甚至规则的呼吸也会引起患者位置的轻微变化，因此只有AI的精度才能应付大量的计算，这将使纯净切割和切断的动脉之间产生差异。
3.选择性危险警告 (3. Selective hazard warnings)
Soldiers in the field make split-second decisions under heavy fire that can separate life from death. At the same time, they are bombarded with information from eyes in the sky and the crew back at base.
野战士兵在大火之下做出瞬间的决定，这可以将生与死分开。 同时，他们被来自天空的眼睛和机组人员返回基地的信息轰炸。
Artificial intelligence has the power to make complex decisions for them and has already been employed in military strategies. An AR system powered with AI can run millions of simulations, compare current situations to archives, and determine the best course of action before any bullets are fired. Soldiers of the future will have a video game-style field of view with all the assists turned on.
人工智能具有为他们做出复杂决定的能力，并且已经被用于军事战略中。 搭载AI的AR系统可以运行数百万次模拟，将当前状况与档案进行比较，并确定在发射任何子弹之前的最佳行动方案。 未来的士兵将在所有辅助功能打开的情况下拥有视频游戏风格的视野。
AR can also highlight clear and present danger, which allows the soldiers on the ground to make informed choices and deal with the threats in order. ARC4 is a small step towards this future vision. A system connected to the might of military drones, satellites and more, the battleground of the future will be a much more high-tech environment.
AR还可以突出显示当前存在的危险，这使地面上的士兵可以做出明智的选择并按顺序处理威胁。 ARC4是迈向这一未来愿景的一小步。 一个与军用无人机，卫星等等相关的系统，未来的战场将是一个更加高科技的环境。
The military technology will trickle down to civilian use cases. The same AR system that helps Marines win the day can save cyclists from oncoming cars. Garmin’s radar-equipped Varia Vision is an idea of what’s to come, but future models will see around corners and give you advance warning before you’re even in danger.
军事技术将深入到民用案例中。 可以帮助海军陆战队赢得胜利的相同的AR系统可以使骑自行车的人免于迎面而来的汽车。 Garmin的配备雷达的Varia Vision是对未来的构想，但是将来的模型将在拐角处出现，并在您面临危险之前给您提前警告。
4.定制的模拟和培训 (4. Customized simulation & training)
The combination of artificial intelligence and VR/AR is a powerful tool for educating the next generation of surgeons, pilots and even youngsters in school.
人工智能和VR / AR的结合是在学校教育下一代外科医生，飞行员甚至年轻人的有力工具。
Doctors already get countless hours of virtual surgery time so they can encounter every complication before they hit the wards. Emergency medical teams (EMTs) deal with car crashes and natural disasters, firemen navigate the worst blazes, and pilots experience how engines go down — all in virtual worlds without a single life at stake.
医生已经获得了无数小时的虚拟手术时间，因此他们在遇到病房之前就可以遇到各种并发症。 紧急医疗队(EMT)处理车祸和自然灾害，消防员驾车驶向最严重的烈火，飞行员体验引擎如何停机-在虚拟世界中，一切都不会危及生命。
AI can improve simulated training by incorporating more data points, comparing and contrasting different techniques, and personalizing the education. The system will act more like a customizable trainer than a static simulator. Children could get their own personal tour guide through ancient Rome and the Amazon jungle. They’ll get to ask questions, see the world in action, and experience an interactive education that books just cannot deliver.
AI可以通过合并更多的数据点，比较和对比不同的技术以及个性化教育来改善模拟培训。 该系统将比静态模拟器更像是可定制的培训师。 孩子们可以在古罗马和亚马逊丛林找到自己的私人导游。 他们将提出问题，了解现实世界，并体验书籍无法提供的互动式教育。
With a simple set of sensors and a headset that monitors every move, we should be able to learn everything from the perfect golf swing to the Chinese language. Virtually anybody should be able to access world class coaching at any academic or sporting discipline. The combination of AI with VR/AR has the potential to democratize education and give every student a chance to learn.
借助一套简单的传感器和一个可以监测每一个动作的耳机，我们应该能够学习从完美的高尔夫挥杆到中文的所有知识。 几乎任何人都应该能够获得任何学术或体育学科的世界级教练。 AI与VR / AR的结合可以使教育民主化，并为每个学生提供学习的机会。
5.真正的社交媒体 (5. Truly Social Media)
One day we will look back and laugh at Facebook’s measly chat window as we relax over a virtual coffee with a friend who is halfway around the world. In the near future, we can meet our friends in both real or virtual environments, from a pool hall to the Taj Mahal, and interact as if they’re in the same room. The processing power required for this is mind-boggling, but also within our grasp thanks to AI.
有一天，当我们与世界各地的一位朋友一起喝杯虚拟咖啡放松身心时，我们会回头嘲笑Facebook的聊天窗口。 在不久的将来，我们可以在真实或虚拟环境中认识我们的朋友，从泳池大厅到泰姬陵，并像他们在同一个房间一样进行互动。 为此所需的处理能力令人难以置信，但借助AI也在我们的掌握之中。
Facebook, which invested heavily in VR with the purchase of Oculus Rift, is already using generative models from deep learning to automatically design believable character avatars based on your photos.
通过收购Oculus Rift在Facebook上投入大量资金的Facebook，已经在使用深度学习的生成模型来根据您的照片自动设计可信的角色化身 。
6.角色建模 (6. Character Modeling)
Right now, we employ two methods for animating characters: motion capture and manual CG work. Handcrafted animations are laborious, while motion capture is limited to the physical capabilities of the actor being modeled. change thanks to AI methods, such as learning by demonstration, self-teaching AI, and phase-functioned neural networks.
目前，我们采用了两种方法来对角色进行动画处理：运动捕捉和手动CG工作。 手工制作的动画很费力，而动作捕捉则仅限于要建模的演员的物理能力。 借助 AI方法进行更改，例如通过演示学习 ， 自我教学AI和具有相功能的神经网络 。
Motion capture involves painstakingly recording a vast array of movements that are essentially repeated over and over. New systems like phase-functioned neural networks, developed by the University of Edinburgh, uses machine learning to combine a vast library of stored movements and map them onto new characters.
运动捕捉涉及精心记录大量反复重复的动作。 爱丁堡大学开发的诸如相功能神经网络之类的新系统使用机器学习来组合庞大的存储动作库，并将其映射到新角色上。
The team applied the neural network to a character it called The Orange Duck and the results are remarkable.
该团队将神经网络应用于一个名为“橙色鸭”的角色，结果令人瞩目。
This will open up a new world of realistic animation in video games, cartoons, and Virtual Reality environments. A relatively simple session of motion capture can turn into a full range of movement with the help of a neural network. It means realistic characters can, theoretically, be created on the fly.
这将在视频游戏，卡通和虚拟现实环境中打开逼真的动画的新世界。 借助于神经网络，相对简单的运动捕获会话可以转变为整个运动范围。 从理论上讲，这意味着可以即时创建逼真的角色。
Not everyone is happy with AI-driven animation. Studio Ghibli founder Hayao Miyazaki notoriously reflected that AI represented the “end of times” when shown automated character models from Japanese company DWANGO. Perhaps you shouldn’t be surprised it upsets a man who has spent his entire life drawing with AI that replaces drawing.
并非所有人都对AI驱动的动画感到满意。 Studio Ghibli创始人宫崎骏(Hayao Miyazaki) 臭名昭著地反映出 ，当展示日本公司DWANGO的自动角色模型时，AI代表了“时代的终结”。 也许您不应该感到惊讶，这会让一个用一生的图纸代替AI的人感到沮丧。
7.会话非玩家角色(NPC) (7. Conversational Non-Player Characters (NPCs))
Auxiliary, non-playable characters (NPCs) in video games are notorious for behaving in odd ways. They act nonchalant when crimes are committed in front of them or when strangers barge into their homes. Their conversation is stilted and they just don’t adapt to circumstances.
电子游戏中的辅助不可玩角色(NPC) 以其怪异的行为而臭名昭著 。 当犯罪行为摆在他们面前或陌生人闯入他们的房屋时，他们会表现得冷淡。 他们的谈话之以鼻，他们只是不适应环境。
Even in conversation-driven games like Mass Effect, NPCs are an afterthought. The console only has so much processing power to offer, so NPCs often become part of the background. But with AI to power their realism, NPCs could adapt to events and even participate in a proper conversation. Game consoles, especially for VR, could carry neuromorphic chips that send AI-related tasks to cloud servers, so even the sideline characters can evolve based on the input of other players.
即使在诸如质量效应之类的对话驱动游戏中，NPC也是事后才想到的。 控制台只能提供这么多的处理能力，因此NPC通常会成为后台的一部分。 但是，借助AI来增强其现实性，NPC可以适应事件，甚至参与适当的对话。 游戏机，尤其是用于VR的游戏机，可以携带神经形态芯片，将与AI相关的任务发送到云服务器 ，因此，即使副业角色也可以根据其他玩家的输入进行进化。
8.渲染优化 (8. Rendering Optimization)
One of the biggest challenges in VR / AR is rendering realistic graphics with today’s consumer hardware. Too much complexity leads to pixelated images and lag. This leads to headaches for VR headset wearers. The result is that most VR experiences are simplistic and lacking in convincing detail.
VR / AR的最大挑战之一是如何使用当今的消费类硬件渲染逼真的图形。 过于复杂会导致像素化图像和延迟 。 这导致VR耳机佩戴者头痛。 结果是，大多数VR体验都过于简单，缺乏令人信服的细节。
The application of AI to game rendering is so obvious that Nvidia even offers formal courses teaching 3D and graphics artists how to apply deep learning techniques to tasks like super resolution, photo to texture mapping, and texture multiplication. In VR, machine learning can be used for selective rendering, where only the portions of a scene where a viewer is looking are dynamically generated in full visual fidelity, saving on computing costs. Images can also be more intelligently compressed with AI techniques, enabling faster transmission over wireless connections without a discernible loss in quality.
AI在游戏渲染中的应用是如此明显，以至于Nvidia甚至提供了正式课程，教3D和图形艺术家如何将深度学习技术应用于诸如超分辨率，照片到纹理贴图以及纹理乘法等任务。 在VR中，机器学习可用于选择性渲染，在该渲染中，只有观看者正在观看的场景部分会以完全的视觉保真度动态生成，从而节省了计算成本。 图像还可以使用AI技术进行更智能的压缩 ，从而可以通过无线连接更快地传输数据，而不会造成明显的质量损失。
High cost barriers and lagging hardware have caused VR/AR to become overhyped in the past years. By using AI to overcome technical barriers and improve realism, you can now examine the intricate and alien landscape of Mars to within 30 cm of the true topology. Given that NASA’s acceptance rate for astronauts is less than 0.08%, VR — powered by AI — is the closest you’ll probably get to a space adventure.
高成本壁垒和落后的硬件已导致VR / AR在过去几年中被过度炒作。 通过使用AI克服技术障碍并改善现实性，您现在可以检查火星错综复杂的外景，使其距真实拓扑30厘米以内 。 考虑到NASA对宇航员的接受率不到0.08％，由AI驱动的VR是您最接近太空冒险的方式。
Love what you read? You can find more stories like this one at www.topbots.com. Or join the TOPBOTS community to get the best bot news & exclusive industry content.
喜欢你读的书吗？ 您可以在www.topbots.com上找到更多类似的故事。 或加入TOPBOTS社区以获得最佳的机器人新闻和独家行业内容。
ai与虚拟现实