Seeing AI - Talking Camera App for the Blind|APP|广告营销案例【ADGuider广告指南】

为盲人观看人工智能摄像头应用

案例简介：概要我们的使命就是让地球上每个人实现更多。我们认识到，盲与低视力的社区 (2.53亿的人) 通常是无从得到技术和历史上降低了教育和就业机会。我们发现了三个关键问题与现有的工具: • 限制功能: 现有技术感到非常基本的，有限制或单一用途的功能，如发现或阅读课文。•昂贵的: 例如，大多数文本阅读 smartglass 解决盲人是在 $3000-$10000。同样，基于硬件的激光条码扫描仪专为盲人的社会成本超过 $1300。对于一个社会历史上降低了教育和就业的机会，这种成本使其更难以获得这些技术。•笨重的硬件: 其中许多大件五金工具做一个功能，这意味着多个项目在你的包包，减少流通。战略让用户的技术，我们开始处理用户工作并开展一系列的技术来解决这个问题。我们确定了若干方案和感兴趣的对象并开始收集资料 (公司内部员工的众包)。培训的智能场景识别模式是通过标的超过 300,000 图片 (超过 70,000 小时的人标记工作) 有五个句子描述每个，再培训的渠道模式。这种模式识别视觉对象、行为、形容词。然后它会产生可判说明，结合的对象范围内和相互之间的关系 (如笔记本电脑上的表，而不是笔记本电脑和表)。此外，系统确认名流和标志性建筑 (如 "观金门 bridge' bridge'" 代替)。该系统有助于一个盲人教授在飓风在波多黎各不倒下的线条和树木，而来的安全。结果自发布于 2017年7月，独立的应用程序有所改善，帮助用户完成超过 700万个独立的工作和已被下载 200,000 2018年5月的使用者。许多的这些发现以前需要依赖援助。评级 4.8 星在苹果应用商店，反馈通常含有 "等一类的信任”，新机遇 "、" experiences'，'game changer'，''independence' 和 'empowerment'。一系列的反馈意见常常围绕下列主题: 第一次经历的生活--阅读菜单，自卖自夸, 查找物品的自动售货机教育盲人学生在校期间的文盲，人迹罕至的纸质文本。同样，盲人父母必读书籍，检查手写作业的孩子和笔记的教师。就业社会对话中的感觉盲目摄影菜和自力更生的厨房里获得负担得起的技术。执行用独特的直观和创意音响的用户体验，看到艾上运行-艾器来解决盲人社区所面临的问题时，从来没有做过。由于盲目的用户往往难以取景相机正确, 该应用程序使用实时艾设备上，引导他们采取更好的照片导致更高的精度，比如听觉指导，直到所有粮票四角的文件是可见的。同样，能够识别条形码应用程序生成的音声来引导用户实现地区的条形码。此前，盲人用户需要购买笨重的 $1300 的专用硬件条码扫描器能够做到这一点。当相机看到的脸在 'person 模式 ”，它描述了如何面对的是，画面中的位置，帮助用户框它，如果脸上的微笑或另一种情绪。与这些声音反馈，盲目的用户都已经贴面带微笑的照片的朋友在社交媒体上。此外，用户可以把三张照片和火车的面部识别系统 (一首业)，所以如果一个朋友出现在镜头前，将宣布它是实时的。活动描述看到艾是一个免费的应用程序，讲述了视觉世界盲与低视力的社区。这个正在进行的项目利用人工智慧的力量来打开附近的人们的视觉世界和描述，文字，货币，颜色和对象与口语音频。像瑞士军刀，该应用程序提供了很多的工具的利用功率的设备上的深入学习，开放更多的 “第一次生活” 方案。主要功能包括实时文本阅读、文件结构的理解、条码定位及产品识别、人脸识别、情感/年龄/性别说明，货币识别，识别颜色, 发声光检测器和手写阅读器。此外，这个程序可以让即使其他应用程序访问和包容的时候的照片，而使用其他应用程序。看到 90 第二产品视频: http://aka.ms/seeingaiproductvideo

为盲人观看人工智能摄像头应用

案例简介：Synopsis Our mission is to empower every person on the planet to achieve more. We recognize that the blind and low vision community (253 million according to WHO) is often underserved by technology and historically has reduced educational and employment opportunities. We discovered three key issues with existing accessibility tools: • Limited functionality: Available technologies feel really basic, have limited or single purpose functionality, like detecting color or reading text. • Expensive : For example, most text reading smartglass solutions for the blind are in the range of $3000-$10000. Similarly, hardware-based laser barcode scanners designed for the blind community cost upwards of $1300. For a community which historically has reduced educational and employment opportunities, such costs make it even harder to get access to these technologies. • Bulky hardware: Since many of these bulky hardware tools do one feature, this means carrying multiple items in your bag, reducing mobility. Strategy By keeping the user before the technology, we started addressing the user tasks and then building the technology to solve it. We identified several scenarios and objects of interest and started collecting data (with both internal crowdsourcing from employees). Training for the scene recognition mode was achieved by first labelled over 300,000 images (over 70,000 hours of human labelling effort) with five descriptive sentences each, and then training a pipeline model. This model identifies visual objects, actions, adjectives. Then it generates a possible sentence description, combining the context of objects and relationships between each other (e.g. laptop on top of a table instead of laptop and table). Additionally, the system recognize celebrities, and landmarks (e.g. ‘a view of golden gate bridge’ instead of ‘a bridge’). The system helped a blind professor during the hurricanes in Puerto Rico avoid fallen power lines and fallen trees, and come to safety. Outcome Since launch in July 2017, the app has improved independence by assisting users in completing over 7 million tasks independently and has been downloaded by 200,000 users as of May 2018. Many of these tasks previously required relying on sighted assistance. Rated 4.8 stars on the Apple App Store, feedback often contains words such as ‘new confidence’, ‘new opportunities’, ‘new experiences’, ‘game changer’, ‘’independence’ and ‘empowerment’. A subset of feedback received often revolves around the following themes : First time experiences in life – reading menus, selfies, finding items in a vending machine Education – Blind students in school can now read inaccessible paper text. Similarly, blind parents are reading books, checking the handwritten homework of their kids and notes from teachers. Employment Feeling included in social conversations Blind photography Grocery shopping and self-reliance in the kitchen Getting access to affordable technology. Execution With a uniquely intuitive and creative audio-based user experience, Seeing AI runs on-device AI to solve problems faced by the blind community in a manner that had never been done before. Given that blind users often have difficulty framing camera correctly, the app uses real time AI on-device to guide them to take a better photograph resulting in higher accuracy - e.g. audibly guiding till all 4 corners of a document are visible. Similarly, to be able to recognize barcodes, the app generated audio beeps to help guide the user towards areas with barcodes. Previously, blind users would have to buy a bulky $1300 dedicated hardware barcode scanner to be able to do this. When the camera sees a face in 'person mode', it describes how far the face is, its location in the picture to help users frame it, and if the face is smiling or another emotion. With all this audible feedback, blind users are already posting smiling photographs of their friends on social media. Additionally, users can take three photos and train an face recognizer (a first in the industry), so if a friend appears in front of the camera, it will announce it in real time. CampaignDescription Seeing AI is a free app that narrates the visual world for the blind and low vision community. This ongoing research project harnesses the power of Artificial Intelligence to open up the visual world and describe nearby people, text, currency, color and objects with spoken audio. Much like a Swiss Army knife, this app provides many tools in one by leveraging the power of on-device deep learning to open many “first time in life” scenarios. Key features include - Real-time text reading, document structure understanding, audio-based barcode locator and product recognizer, face recognition and emotion/age/gender description, currency recognition, color recognition, audible light detector and handwriting reader. Additionally, this app can make even other apps accessible and inclusive by describing photos while using other apps. See the 90 second product video : http://aka.ms/seeingaiproductvideo