Download as PDF, PPTX
![Augmented Reality Definition
•Defining Characteristics [Azuma 97]
• Combines Real andVirtual Images
• Both can be seen at the same time
• Interactive in real-time
• The virtual content can be interacted with
• Registered in 3D
• Virtual objects appear fixed in space
Azuma, R. T. (1997). A survey of augmented reality. Presence, 6(4), 355-385.](https://image.slidesharecdn.com/introductionar-180929123632/75/COMP-4010-Lecture-7-Introduction-to-Augmented-Reality-3-2048.jpg)
![Academic Research Beginning
• 1994: Motion stabilized display [Azuma]
• 1995: Fiducial tracking in video [Bajura / Neumann]
• 1996: UNC hybrid magnetic-vision tracker](https://image.slidesharecdn.com/introductionar-180929123632/75/COMP-4010-Lecture-7-Introduction-to-Augmented-Reality-19-2048.jpg)
![Augmented Reality Definition
•Defining Characteristics [Azuma 97]
• Combines Real andVirtual Images
• Both can be seen at the same time
• Interactive in real-time
• The virtual content can be interacted with
• Registered in 3D
• Virtual objects appear fixed in space
Azuma, R. T. (1997). A survey of augmented reality. Presence, 6(4), 355-385.](https://crownmelresort.com/image.slidesharecdn.com/introductionar-180929123632/75/COMP-4010-Lecture-7-Introduction-to-Augmented-Reality-3-2048.jpg)
![Academic Research Beginning
• 1994: Motion stabilized display [Azuma]
• 1995: Fiducial tracking in video [Bajura / Neumann]
• 1996: UNC hybrid magnetic-vision tracker](https://crownmelresort.com/image.slidesharecdn.com/introductionar-180929123632/75/COMP-4010-Lecture-7-Introduction-to-Augmented-Reality-19-2048.jpg)
Uploaded byMark Billinghurst
COMP 4010 - Lecture 7: Introduction to Augmented Reality
The document provides an extensive overview of augmented reality (AR), including its definition, historical context, technological advancements, and commercial applications. It traces the evolution of AR from its early explorations in the 1960s to its current utilization in gaming, marketing, and other fields, highlighting significant developments and examples along the way. Furthermore, it discusses the growing commercial landscape of AR, projecting continued expansion across various sectors.
More Related Content
Similar to COMP 4010 - Lecture 7: Introduction to Augmented Reality
COMP 4010 - Lecture 7: Introduction to Augmented Reality
- 1. LECTURE 7: INTRODUCTION TOAUGMENTED REALITY COMP 4010 – Virtual Reality Semester 5 – 2018 Bruce Thomas, Mark Billinghurst University of South Australia September 4th 2018
- 2. Augmented Reality 1977 –Star Wars
- 3. Augmented Reality Definition •DefiningCharacteristics [Azuma 97] • Combines Real andVirtual Images • Both can be seen at the same time • Interactive in real-time • The virtual content can be interacted with • Registered in 3D • Virtual objects appear fixed in space Azuma, R. T. (1997). A survey of augmented reality. Presence, 6(4), 355-385.
- 4. CNN 2008 ElectionDemo https://www.youtube.com/watch?v=v7fQ_EsMJMs
- 5. • Put ARpictures here Augmented Reality Examples
- 6.
- 7.
- 9. Pepper’s Ghost (1862) •Dates back to Giambattista della Porta (1584)
- 10. The Master Key(1901) – AR Glass • "It consists of this pair of spectacles. While you wear them every one you meet will be marked upon the forehead with a letter indicating his or her character. The good will bear the letter 'G,' the evil the letter 'E.' … Thus you may determine by a single look the true natures of all those you encounter.” L. Frank Baum
- 11. Early HUD (1958) F16– Head Up Display
- 12. First HMD • PhilcoHeadsight (1961) – Remote Camera Viewing
- 13. Sutherland HMD • 1968:Sutherland / Sproull’s first HMD system • see-through
- 14. USAirforce HMDs 1960 -70’s: US Air Force HMDs (T. Furness III)
- 15. SuperCockpit Program 1970 -80’s: US Air Force Super Cockpit (T. Furness III)
- 16. Modern Airforce HMDs •Honeywell Integrated Helmet and Display Sighting System (IHADSS) on AH-64 Apache attack helicopter in 1985
- 17. F35- HMD Demo(2014) • https://www.youtube.com/watch?v=Ay6g66FbkmQ
- 18. First Industrial Use •Early 1990’s: Boeing coined the term “AR.” Wire harness assembly application begun (T. Caudell, D. Mizell).
- 19. Academic Research Beginning •1994: Motion stabilized display [Azuma] • 1995: Fiducial tracking in video [Bajura / Neumann] • 1996: UNC hybrid magnetic-vision tracker
- 20. Development of theField • 1996: MIT Wearable Computing efforts • 1998: Dedicated conferences begin (ISMAR) • Late 90’s: Collaboration, outdoor, interaction • Late 90’s:Augmented sports broadcasts
- 21. Development of Tools •1996CyberCode (Rekimoto) • First matrix code tracking •1999 ARToolKit (Kato & Billinghurst) • Open source tracking library
- 22.
- 23. Mobile/Wearable Systems • 1995Navicam (Rekimoto) • Handheld AR • 1997 Touring Machine (Feiner) • Backpack AR • GPS, see-through display
- 24. History Summary •1960’s –80’s: Early Experimentation •1980’s – 90’s: Basic Research • Tracking, displays •1995 – 2005:Tools/Applications • Interaction, usability, theory •2005 - : Commercial Applications • Games, Medical, Industry
- 25. 2007 -AR ReachesMainstream • MIT Technology Review • March 2007 • list of the 10 most exciting technologies • Economist • Dec 6th 2007 • Reality, only better
- 26. 2009 -AR inMagazines • Esquire Magazine • Dec 2009 issue • 12 pages AR content • Many Others • Wired • Colors • Red Bull • Etc
- 27.
- 28.
- 29. 2008 - BrowserBasedAR • Flash + camera + 3D graphics • ARToolKit ported to Flash • High impact • High marketing value • Large potential install base • 1.6 Billion web users • Ease of development • Lots of developers, mature tools • Low cost of entry • Browser, web camera
- 30. Demo: GE SmartGrid • https://www.youtube.com/watch?v=vJO_AZkCL9U
- 31. 2005 - MobilePhoneAR •Mobile Phones • camera • processor • display •AR on Mobile Phones • Simple graphics • Optimized computer vision • Collaborative Interaction
- 32. ARAdvertising (HIT LabNZ 2007) • Txt message to download AR application (200K) • See virtual content popping out of real paper advert • Tested May 2007 by Saatchi and Saatchi
- 33.
- 34.
- 35. 2009 - OutdoorInformation Overlay • Mobile phone based • Tag real world locations • GPS + Compass input • Overlay graphics on live video • Applications • Travel guide,Advertising, etc • Wikitude, Layar, etc.. • iOS/Android, Public API released
- 36. Layar Demo (2007) •https://www.youtube.com/watch?v=b64_16K2e08
- 37.
- 38.
- 39. Epson Moverio BT-300 ▪Stereo see-through display ($700) ▪ 1280 RGB x 720 pixels, 23 degree FOV, 30Hz, 69g ▪ Android Powered, separate controller ▪ VGA camera, GPS, gyro, accelerometer
- 40.
- 41. Hololens (2016) -$3,000 USD • Integrated system – Windows • Stereo see-through display • Depth sensing tracking • Voice and gesture interaction
- 42.
- 43. Sensors • 4 Environmentcamera sensors (two on each side) • A depth camera (Time of Flight, 120o FOV), a 2.4MP photo/HD video camera • An ambient light sensor, 3 DOF IMU
- 44. Computing • Custom motherboard: 64 GB eMMC SSD and 8MB SRAM, 1GB of LPDDR3 RAM, Windows 10 • HPU: sensor processing and fusion, 8MB SRAM, 1GB of LPDDR3 RAM
- 45. Display • See-through display,30°×17.5°field of view - 720p or 1268x720 per eye • two HD 16:9 light engines - liquid crystal on silicon displays • total internal reflection waveguide optics
- 46. MagicLeap ML-1 (2018)- $2,300 USD • Bi-Focal Display – two focus planes • Horizontal FoV of 40o, vertical FoV of 30o, diagonal value of 50o • 1280×960 resolution, Eye-tracking • Separate display and computer • Nvidia "Parker" Tegra X2 CPU, 8GB RAM, 128 GB storeage • 6 DOF handheld controller, magnetic tracking
- 47.
- 48. Mobile Camera ARApps (2015 - ) • SnapChat - Lenses, World Lenses • Cinco de Mayo lens > 225 million views • Facebook - Camera Effects • Google – Word Lens/Translate
- 49. ARKit/ARcore (2017) • VisualInertial Odometry (VIO) systems • Mobile phone pose tracked by • Camera (Visual), Accelerometer & Gyroscope (Intertial) • Features • Plane detection, lighting detection, hardware optimisation • Links • https://developer.apple.com/arkit/ https://developers.google.com/ar/
- 50.
- 51. • Weak AR •Imprecise tracking • No knowledge of environment • Limited interactivity • Handheld AR • Strong AR • Very accurate tracking • Seamless integration into real world • Natural interaction • Head mounted AR Strong vs. Weak AR
- 52. Augmented RealityToday •KeyTechnologies Available •Robusttracking (ComputerVision, GPS/sensors) •Display (Handheld, HMDs) •Input Devices (Kinect, etc) •Developer tools (Vuforia,ARToolKit) •Commercial Business Growing •Gaming, GPS/Mobile, Online Advertisement • >$2Billion USD in 2017
- 53. AR BusinessToday • Marketing •Web-based, mobile • Mobile AR • Geo-located information and service • Driving demand for high end phones • Gaming • Mobile, Physical input (Kinect, PS Move) • Upcoming areas • Manufacturing, Medical, Military
- 54. AR BusinessToday • >$2Billionin 2017, growing strongly • 70-80+% Games and Marketing
- 56.
- 57. Crossing the Chasm- 5-10 years
- 58. Market Projections cf. 2014computer game market = $84 Billion USD
- 59. Forecast Number ofUsers
- 60. Pokemon GO Killer Combo:brand + social + mobile + geo-location + AR
- 61. Pokemon GO Effect •Fastest App to reach $500 million in Revenue • Only 63 days after launch, > $1 Billion in 6 months • Over 500 million downloads, > 25 million DAU • Nintendo stock price up by 50% (gain of $9 Billion USD)
- 62. Summary • Augmented Realityhas a long history going back to the 1960’s • Interest in AR has exploded over the last few years and is being commercialized quickly • AR is growing in a number of areas • Mobile AR • Web based AR • Marketing experiences
- 63.
- 64. • Web basedAR • Flash, HTML 5 based AR • Marketing, education • Outdoor Mobile AR • GPS, compass tracking • Viewing Points of Interest in real world • Eg: Junaio, Layar, Wikitude • Handheld AR • Vision based tracking • Marketing, gaming • Location Based Experiences • HMD, fixed screens • Museums, point of sale, advertising Typical AR Experiences
- 65. AR Books –MarkerlessTracking
- 66. Example:Haunted Book/AR Book •Camera hidden in lamp object • AR content seamlessly integrated into real book • Natural page turning/manipulation interaction Scherrer, C., Pilet, J., Fua, P., & Lepetit, V. (2008, September). The haunted book. In Proceedings of the 7th IEEE/ACM international Symposium on Mixed and Augmented Reality (pp. 163-164). IEEE Computer Society.
- 67.
- 68. Gaming:Rock-em Sock-em • SharedAR Demo • Markerless tracking
- 69.
- 70. Sales and Marketing •Connect with brands and branded objects • Location Based Experiences • Lynx Angels • Web based • Rayban glasses • Mobile • Ford Ka campaign • Print based • Red Bull Magazine
- 71. Pepsi AR Experience(2014) • Video see-through AR in bus shelter • Bus shelter appears under attack
- 72.
- 73. Assembly and Maintenance ©1993 S. Feiner, B. MacIntyre, & D. Seligmann, Columbia University © 1996 S. Feiner, B. MacIntyre, & A. Webster, Columbia University
- 74. Maintenance Systems • Ngrain •http://www.ngrain.com/ • Training authoring tool • Model based AR tracking • ScopeAR • http://www.scopear.com/ • Remote assistance • Image based tracking
- 75.
- 76. MedicalARTrials ú Sauer etal. 2000 at Siemens Corporate Research, NJ ú Stereo video see through F. Sauer, Ali Khamene, S. Vogt: An Augmented Reality Navigation System with a Single-Camera Tracker: System Design and Needle Biopsy Phantom Trial, MICCAI 2002
- 77.
- 78. Interactive Museum Experiences §BlackMagic § Virtual America’s Cup § 410,000 people in six months § MagicPlanet § TeManawa science museum § Virtual Astronomy § Collaborative AR experience § ARVolcano § Interactive AR kiosk § Scienceworks museum, Melbourne
- 79.
- 80. CityViewARApplication • Visualize Christchurchbefore the earthquakes
- 81.
- 82. Example: Holoportation • AugmentedReality + 3D capture + high bandwidth • http://research.microsoft.com/en- us/projects/holoportation/
- 83.
- 84. UsingAR in theWorkplace •Blending digital/physical worlds.. • Productivity • Marketing • Training • Collaboration
- 85. Example: Productivity • ARfor hands busy tasks • Warehouse picking (DHL, SAP) • Smart glasses show pick location • Simple user interface • Hands-free interaction • Improved performance RW VR
- 86.
- 87.
- 88.
- 89. Example: Marketing • Addmagic to companies products • Snapchat lenses • Face tracking technology • Simple interaction • Animated content • Significant ROI • $750K for 224 million views • c.f. $5 million for SuperBowl ad RW VR
- 90.
- 91. Example: Collaboration • UseMR technology for remote collaboration • See through another’s eyes, virtual avatars • Microsoft Remote Assist • HoloLens see-through display • Remote video sharing • AR drawing/annotation • Document sharing • Group calling RW VR
- 92.
- 93.
- 94. Summary •AR technology canbe used to develop a wide range of applications •Promising application areas include • Games • Education • Engineering • Medicine • Museums • Etc..
- 95.