Upgrade to Pro — share decks privately, control downloads, hide ads and more …

SpendTAR CASE STUDY

MangeshUX
March 01, 2023

SpendTAR CASE STUDY

Watch my full case study on Augmented reality.

MangeshUX

March 01, 2023
Tweet

Other Decks in Design

Transcript

  1. Summary SpendTAR is a application that utilizes augmented reality technology

    to enhance the museum visiting experience for users. It allows users to interact with exhibits in new and exciting ways, using their mobile device to overlay virtual information and objects onto the real world. With AR-enhanced exhibits, users can view 3D models of artifacts, explore the inner workings of complex machines, and even see how sculptures might have looked when they were first created. The app also provides informational content and wayfinding features to help users navigate the museum and locate exhibits of interest. In summary, an AR museum app offers a unique and engaging way for visitors to explore and learn about museum exhibits, creating a more interactive and immersive experience. What is AR(Augmented Reality) Augmented Reality (AR) is a technology that allows virtual objects and information to be overlaid onto the real world. It is a way of enhancing the physical environment around us by adding digital elements, which can be viewed and interacted with using a device such as a smartphone or a tablet. AR works by using a camera and sensors in a device to recognize the physical environment and then overlay digital content onto it. This can include anything from simple text or graphics, to 3D models and animations that appear to be part of the real world.
  2. “In April 2022, the Prime Minister of India, Mr. Narendra

    Modi, inaugurated Pradhan Mantri Sangrahalay (PM Museum) in New Delhi. Indian startup, Tagbin, along with other technology partners, digitised the museum at an estimated cost of US$ 40 million (Rs. 300 crore) by leveraging technologies such as AR/VR.” Project Background Introducing AR technology in the museum to take the next step of revolution to make the experience of people visiting the museum is more immersive and unforgettable. Scope of Project The Indian AR/VR market is expected to witness a robust CAGR of 38% by 2027 through technological advances. Demand for AR/VR in the edtech, manufacturing, healthcare and retail sectors is high and can soon expand to sectors such as travel, hospitality and media & entertainment. There is potential for integration of technologies such as AI with AR/VR and AR-powered autonomous cars in future. Adopting 5G technology will strengthen the mobile network and increase data speed, accelerating the adoption of AR/VR. Accessing AR via web browsers apart from mobile devices could be another reality. In India, smartphone penetration was 54% in 2020 and is expected to reach 96% by 2040, further improving AR/VR-based technology accessibility.
  3. Challenges Testing: Testing the app is critical to ensuring that

    it works as intended. Comprehensive testing must be conducted to identify and fix bugs and other issues before the app is released to the public. Storytelling: Developing a coherent and engaging storytelling strategy. Design: Creating an appealing design that is both visually attractive and functional. The design should be intuitive and easy to use, while also providing the necessary features to fulfill the app's purpose. Business Goals Create an interactive product with visitors so they can spend more time in the museum. So we can charge them as per time they spend in the museum. The Problem The implementation of an AR solution to enhance visitor experience, Museums are facing challenges with staffing shortages, inadequate tour guides, difficulty with facility navigation, and misguidance in exhibit interpretation. These issues are causing frustration and confusion for visitors, leading to a decrease in overall satisfaction and engagement with the museum's exhibits. Create an AR based app to address these problems and make visitors experience to visitors experience more immersive and interactive. Why AR It creates unique digital experiences that blend the best of the digital and physical worlds. Also, it does not need any special hardware or software to savor the experience. Mainstream smartphones and mobile apps are sufficient to experience Augmented Reality.
  4. 1. Understand Users & Product 2. Problems 3. Solution &

    Ideas 4. Design 5. Measure Impact Thinking Process Framework
  5. “Taking fir st step” After conducting extensive se has been

    revealed that AR tec been previously used in any m While people are familiar with its implementation in museum and untested concept." condary research, it hnology has not useum worldwide. the concept of AR, s is a relatively new
  6. Who are the visitors? Through comprehensive secondary research, I identified

    distinct categories of museum visitors based on factors such as age, goals, purpose of visit, profession, and residency. Mid age Students Local/ Non local Study, Curious Cursory visitors Profession Age Resident Purpose Casual visitors Study Visitors Any age group Kids, Tourist Local/ Non local Fun, Explore, Entertain 40 + Doctors, palentologiest Local/ Non local Research
  7. Mid age Students Local/ Non local Study, Curious Any age

    group Kids, Tourist Local/ Non local Fun, Explore, Entertain Cursory visitors Casual visitors Study Visitors 40 + Doctors, palentologiest Local/ Non local Research Who are the visitors? Through comprehensive secondary research, I identified distinct categories of museum visitors based on factors such as age, goals, purpose of visit, profession, and residency. Profession Age Resident Purpose
  8. Mid age Students Local/ Non local Study, Curious Any age

    group Kids, Tourist Local/ Non local Fun, Explore, Entertain 40 + Doctors, palentologiest Local/ Non local Research Cursory visitors Casual visitors Study Visitors Who are the visitors? Through comprehensive secondary research, I identified distinct categories of museum visitors based on factors such as age, goals, purpose of visit, profession, and residency. Profession Age Resident Purpose
  9. “Pe on rs a” There are a lot of categories

    we can decide on by conducting a survey of visitors standing outside of the museum but depending on the secondary research let’s decide whether most of the 3 users are visiting museums. Based on those characteristics I created personas.
  10. Discuss problems Empathize Insights When it is possible to include

    AR tech. My focus is on identifying the current challenges faced by museum visitors and the different types of museums, with the ultimate goal of integrating our technology into these spaces.
  11. To gain an overview of the products and exhibits in

    different museums, I have started exploring the different types of museums and their specific offerings. The ultimate goal is to understand and appreciate a variety of fields and their respective exhibits.
  12. Archaeology museums. They display archeological artifacts. They can be open-air

    museums or they can exhibit items in a building. Art museums Also known as art galleries. They are spaces for showing art objects, most commonly visual art objects as paintings, sculpture, photography, illustrations, drawings, ceramics or metalwork. First publicly owned art museum in Europe was Amerbach-Cabinet in Basel (Now Kunstmuseum Basel). Encyclopedic museums. They are usually large institutions and they offer visitors a wide variety of information on many themes, both local and global. They are not thematically defined nor specialized. Historic house museums A house or a building turned into a museum for a variety of reasons, most commonly because the person that lived in it was important or something important happened in it. House is often equipped with furniture like it was in the time when it was used. Visitors of the house learn through guides that tell story of the house and its inhabitants. Living history museums Type of a museum in which historic events are performed by actors to immerse a viewer and show how certain events looked like or how some crafts were performed because there is no other way to see them now because they are obsolete. History museums They collect objects and artifacts that tell a chronological story about particular locality. Objects that are collected could be documents, artifacts, archeological findings and other. They could be in a building, historic house or a historic site.
  13. Maritime museums Specialized museums for displaying maritime history, culture or

    archaeology. Primarily archaeological maritime museums exhibit artifacts and preserved shipwrecks recovered from bodies of water. Maritime history museums, show and educate the public about humanity's maritime past. Military and war museums Museums specialized in military histories. Usually organized from a point of view of a one nation and conflicts in which that country has taken part. They collect and present weapons, uniforms, decorations, war technology and other objects. Mobile museums Museums that have no specific strict place of exhibiting. They could be exhibited from a vehicle or they could move from museum to museum as guests. Also a name for a parts of exhibitions of a museum that are sent to another museum. Natural history museums Usually display objects from nature like stuffed animals or pressed plants. They educate about natural history, dinosaurs, zoology, oceanography, anthropology, evolution, environmental issues, and more. Open-air museums Museums specialized in military histories. Usually organized from a point of view of a one nation and conflicts in which that country has taken part. They collect and present weapons, uniforms, decorations, war technology and other objects. Science museums Specialized for science and history of science. In the beginning they were static displays of objects but now they are made so the visitors can participate and that way better learn about different branches of science.
  14. To better understand the issues present in museums, it's important

    to differentiate between two types of problems: those related to museum management and those experienced by museum visitors Problems Occurred for visitors Arrival at the facility Finding support facilities (restrooms, food, gift shop, etc.) Orientation and circulation during exhibit viewing Exiting or leaving the facility
  15. To better understand the issues present in museums, it's important

    to differentiate between two types of problems: those related to museum management and those experienced by museum visitors Problems Occurred in the museam management Staffing Lack of Information. Managing Collection The Disconnect between Academia and Museums
  16. Through extensive web research, a set of significant challenges related

    to museums have been identified. However, before proposing any solutions, a comprehensive understanding of each problem and its underlying cause is imperative. This will enable a more effective approach to addressing the challenges faced by museum visitors
  17. Lack of Information In India, Museums are sometimes ‘Punishment Postings’

    for IAS officers. It is also common practice to appoint officers as Museum Directors with no knowledge of arts management or curatorial practices. Further, there is no training organized for such Directors to equip them with the requisite skills to lead city/state museums! So that almost kills the point of developing a vision for the museum. One of the main problems that visitors face in museums is a lack of information. Many museums have a large number of exhibits, but the information provided about each exhibit is often limited. Visitors are left with unanswered questions and are unable to fully appreciate the exhibits without adequate information. This can be especially frustrating for visitors who are interested in a particular topic or exhibit, but are unable to find the information they need to fully understand it.
  18. Staffing One of the problems that can occur in museums

    is staffing. This includes having a lack of staff or a lack of qualified staff. When there is a lack of staff, it can lead to long wait times, disorganization, and visitors not getting the help they need. On the other hand, a lack of qualified staff can lead to incorrect information being provided to visitors or inadequate maintenance of the exhibits. This can lead to a negative experience for visitors and potentially harm the museum's reputation.
  19. Arrival in the facility visitors face is the process of

    arrival at the facility. This includes long lines, confusing entrances, and difficulty finding parking. Visitors may also have to navigate through multiple buildings or floors within the museum, which can be overwhelming and confusing. These issues can lead to frustration and a negative experience for visitors.
  20. Finding support facility Support facilities such as restrooms, cafes, and

    gift shops are essential for visitors' comfort and convenience. However, visitors often have difficulty locating these facilities due to poor signage or inadequate placement. This can cause frustration and disrupt the visitor's overall experience. Also extension of this is with language problems. Many museums are in their local languages.
  21. Crowd Control 18.9% found these road signs confusing because of

    conflicts in the signage, a lack of signs at critical points, and the size of these signs being relatively small. As well as visitors have a limited time to explore everything in the museum. Visitors often face the inconvenience of overcrowding in certain areas of the museum, leading to difficulty in exploring exhibits and long wait times to move forward. This can result in visitors feeling rushed or unable to fully engage with the displays they are interested in, leading to a subpar museum experience
  22. Ok ! Before Next Upon careful examination of each problem,

    it became clear that not every issue required the implementation of AR technology. Therefore, I identified the scope of AR and selected specific problems that could be solved through an immersive AR experience for the user.
  23. Discuss problems To visualize my ideas and concepts, I utilized

    storyboarding as a tool to sketch out different scenarios and better understand the needs and expectations of museum visitors
  24. Lack of information Storyboard of any official having data entry

    in the museum and counting information about Items in the museum. This storyboard represent a solution for museum management and not relatable to AR. To ensure better museum management, it is imperative to train officials to effectively manage and control museum- related data. Our solution is to design an app that provides comprehensive guidance on museum management, including data entry, cataloging, and record-keeping. While it may not be possible to arrange training sessions, we can develop a comprehensive guide that details the various aspects of museum management. The app can be customized for each museum, or alternatively, can include all museum data in one place, categorized for easy access. This will enable officials to efficiently manage museum data and streamline their workflow.
  25. Staffing Storyboard of artificial tour guide. Lack of staff is

    a common issue in many museums, which can result in visitors mishandling exhibits and damaging historical items. To address this, we propose the use of a virtual guide that can warn visitors about handling and maintain a safe distance from the artifacts. The solution involves creating a realistic 3D model that can act as a guide in the absence of staff or when there is a shortage of guides. This virtual guide will be designed to look like a real human guide, and will be equipped with interactive features such as voice assistance and animations that will provide visitors with information about the exhibits and ensure they are treated with care. By implementing this solution, we can improve visitor experience and prevent damage to valuable historical artifacts.
  26. Arrival in the facility. Storyboard on arrival of the visitor

    The app would provide detailed information about each exhibit, along with a short tour of the museum using a 3D Google map. To ensure that visitors are aware of the app, we proposed creating a QR code that can be scanned upon arrival at the museum, which would then direct them to the download link for the app. This solution would not only enhance the visitor experience by providing them with more information and a better way to navigate through the museum, but it would also reduce the burden on museum staff who are often overwhelmed with the task of providing information to visitors
  27. Finding a Support facility. Creating a storyboard on navigational support

    and translate feature. One of the pain points for visitors is finding their way around the museum, especially when they are in need of essential amenities such as food, restrooms, or gift shops. To tackle this problem, I propose creating an AI-powered map or navigator that will guide visitors to their desired locations. This map will also include information about the exhibits, displays, and artifacts in the museum. Additionally, we can include scannable features on words or symbols throughout the museum. Visitors can use their smartphone cameras to scan these features and receive relevant information or translations in their preferred language. This will enhance the overall experience of the visitors and provide them with easy access to the information they need.
  28. Orientation and circulation during exhibit viewing(Crowd Control) Creating a storyboard

    on navigational support and translate feature. To enhance the visitor experience, we propose implementing a feature that helps visitors navigate through the museum by providing real-time information about the most crowded areas. By utilizing sensors placed throughout the museum, our app can calculate the estimated wait time for popular exhibits and provide alternative suggestions for exhibits with shorter wait times. Additionally, the app can display a heatmap of the museum, indicating areas with high traffic and suggesting alternative routes for visitors to avoid crowds. This feature will improve the overall visitor experience by reducing frustration and wait times, allowing visitors to make the most of their time in the museum
  29. Discuss problems Those are the possible solution I suppose to

    give to the visitors and management of the museum through AR and 2D based app. Now as we know our user base, I need our product more interactive and engaging for visitors. Thinking about the casual visitors To enhance the engagement of casual visitors, we can brainstorm various ideas such as adding gamification elements like scavenger hunts, puzzles, and quizzes related to the exhibits in the museum. We can also create an interactive 3D model that allows visitors to explore and learn about the exhibits in a more engaging way. I had taken this step to visualize the ideas and sorting out by technical efficiency.
  30. Scan QR to see the detailed story behind the painting.

    To engage casual visitors and keep their attention, we aim to create compelling stories that bring to life the characters in the paintings as well as the life of the painter. One way we achieve this is by creating 3D models of these characters, however, we understand that this can be a heavy undertaking. Therefore, we also plan to include short video clips of the main characters and play them on the remaining parts. The key here is to capture the visitor's attention and engage them in every little detail
  31. The translator feature would provide visitors with translations of any

    language or symbol they encounter in the museum. To make the feature more engaging and interactive, we suggested incorporating animations or words in a relatable language to ensure that visitors are able to fully understand and appreciate the exhibits they are viewing. By providing this feature, we hope to make the museum accessible to a wider range of visitors, regardless of their language proficiency. This will not only enhance their experience but also promote cultural exchange and understanding
  32. Providing guidance to visitors in a large museum can be

    challenging and time-consuming. To overcome this problem, we propose creating interactive products that save visitors' time and provide an immersive experience. One such solution is to provide VR products in the museum, which can guide visitors and create an immersive experience. By using VR, visitors can easily navigate through the museum and save time, reducing their frustration. Additionally, the immersive experience created by VR can engage visitors and enhance their overall museum experience.
  33. Using a navigation system we can save visitors time like

    this the green area is currently with less traffic. Showing red arrows indicates a crowded area. So people will move fast and will not be stuck in line for much time.
  34. Another problem was staffing and manhandling, Here we can create

    to save and protect a restricted areas from visitors. Create 3d guidance system of restricted are that will show the user stay away or keep distance.
  35. Those are sculptures we don't know who are they, If

    we assume that their no guide available in this place Who will tell the visitor a story behind the sculpture? why this sculpture is created? To solve these kinds of problems we are providing feature auto-detection of any sculpture. For that, we need to scan all the things in the museum and create a story including questions like How, Why, Where, etc. If possible create a short video using VFX and 3D models.
  36. Choosing and proritizing an idea As mentioned in the previous

    section, if we have multiple competing solutions, we can rank them based on impact and effort. But since we’ve already decided what to do, we’ll skip this step.
  37. Making sense of everything Creating a scenario can help us

    identify potential areas for improvement. Therefore, I developed a scenario to explore these opportunities ™– The user arrives at the museumt e– Scans the QR code to connect to wif” ƒ– This assumes they’re visiting the city and might not have enough mobile datat h– Scans QR code to download the museum apV ƒ– We need to make sure that the app size isn’t big enough so that they don’t keep waiting outside forevert v– They login through the apV ƒ– Mobile number + OTS X– They can create their profile later because, right now, their main task is to visit the museumt H– They buy the tickec F– They enter the museum by showing their purchased tickets on their phone… E– Once they’re in, the screen asks permission for the camera to scan the surroundinr D– The app tracks their GPS to know their exact locatiof B– Based on their precise location, it recommends a path
  38. '` Scans the QR code to connect to wifX G`

    This assumes they’re visiting the city and might not have enough mobile data7 0` Scans QR code to download the museum ap G` We need to make sure that the app size isn’t big enough so that they don’t keep waiting outside forever7 9` They login through the ap G` Mobile number + OT ` They can create their profile later because, right now, their main task is to visit the museum7 ` They buy the ticke% È` They enter the museum by showing their purchased tickets on their phoneI Ç` Once they’re in, the screen asks permission for the camera to scan the surroundin5 Æ` The app tracks their GPS to know their exact locatio( Ä` Based on their precise location, it recommends a patC cÃ` If there are multiple exhibits, they can also select an exhibit that they’re interested in, and the app guides toward them7 cc` As they walk around, the camera scans the surroundings and adds a layer of graphics to make the experience more immersive7 c'` E.g., If they’re viewing a dinosaur’s model, when they point their phone to that model, the model comes to life. The surrounding around the modal also changes to reflect their original surrounding7 c0` E.g., if they’re viewing a ship replica, the surrounding on the screen change to a ship sailing in the water, and information related to that ship can be read on the screen. We can also add audio feedback, like waves crashing if they’re wearing headphones. Making sense of everything Creating a scenario can help us identify potential areas for improvement. Therefore, I developed a scenario to explore these opportunities
  39. Museum Onboarding Character Sound Text QR scan Info detail Restricted

    area Navigation Model scan Info detail Facility list Direction 3D model Guide Map Help Auto Estimated time Preview
  40. Name Ideation AugMus AR world SpendTAR XPerience History AR Real

    XP In AR DOA SpendTAR Real XP Choosing a name that play with user mind spend time with AR
  41. Color Theory Aware Lonely Confused Important Insignaficant Frustated Fascinated Relaxed

    I used a widely adaptive color chart that maps out human emotions to create a color library that reflects the different emotions I want to convey.
  42. Visuals With color emotions in mind, I am experimenting with

    various visuals to captivate user attention and create an aesthetically pleasing experience.
  43. Font Ideation Piazzolla Choosing the right font was a challenging

    task as each type of museum represents a different era of history. However, after careful consideration, I was able to identify and select appropriate fonts that complemented the unique themes of each museum. JejuGothic SpendTAR Real XP SF pro SpendTAR Real XP Play SpendTAR Real XP Piazzolla SpendTAR Real XP Average SpendTAR Real XP Arima Madurai SpendTAR Real XP Quacker Slate SpendTAR Real XP SLATE SpendTAR Real XP Helv Children SpendTAR Real XP Days One SpendTAR Real XP
  44. Final Result Logo Type Logo mark Days one Aa Bb

    Cc Dd Ee Ff Gg Hh Ii Jj Kk Ll Mm Nn Oo Pp Qq Rr Ss Tt Uu Vv Ww Xx Yy Zz 1 2 3 4 5 6 7 8 9 0 Header text Piazzolla Aa Bb Cc Dd Ee Ff Gg Hh Ii Jj Kk Ll Mm Nn Oo Pp Qq Rr Ss Tt Uu Vv Ww Xx Yy Zz 1 2 3 4 5 6 7 8 9 0 Body text Piazzolla Aa Bb Cc Dd Ee Ff Gg Hh Ii Jj Kk Ll Mm Nn Oo Pp Qq Rr Ss Tt Uu Vv Ww Xx Yy Zz 1 2 3 4 5 6 7 8 9 0 Body text(Instructions) Poppins Aa Bb Cc Dd Ee Ff Gg Hh Ii Jj Kk Ll Mm Nn Oo Pp Qq Rr Ss Tt Uu Vv Ww Xx Yy Zz 1 2 3 4 5 6 7 8 9 0 Visuals
  45. Design I began creating the user interface by sketching different

    layout options on paper. Through these sketches, I was able to visualize and refine my design decisions in the early stages. Moving forward, I transitioned to digital lo-fi wireframes, focusing purely on the layout without any colors or text. This helped me refine my designs even further. After making necessary changes, I added colors and text to create the final look of the app. To ensure consistency, I created a design system and components. After making additional changes to the mockups, I began working on prototypes
  46. UI screens Onboarding I designed onboarding screens for the app

    keeping in mind the majority of the users. The screens explain the various features of the app and help users understand it quickly
  47. UI screens Auto mode I utilized a 3D model to

    develop an artificial tour guide capable of leading visitors through the entire museum. Additionally, a navigation feature was integrated to help users reach their desired location more efficiently, minimizing any unnecessary delays
  48. UI screens Manual mode The auto mode feature is designed

    to assist first-time visitors of the museum who are unfamiliar with the exhibits. On the other hand, manual mode is tailored for professionals who already have prior knowledge of the museum and are specifically seeking particular information.
  49. Remain work NPS score We could look at the NPS

    score before and after launching the app to gauge how it has affected users’ perceptions. Number of returning visitors We could also look at the number of returning visitors to know if they liked the experience. Drop off rates Finally, we could look at the drop-off rates to determine the usability issues.
  50. Learnings Understanding the user base is crucial. In this case,

    the target users were casual visitors to the museum. To engage them, the app had to be interactive and provide additional value beyond just giving directions or information.
  51. Learnings Brainstorming and visualizing ideas is an important step. By

    considering different options and sorting them by technical efficiency, I was able to identify the best features to include in the app
  52. Learnings Problem-solving requires creativity. For example, I came up with

    solutions to address language barriers, provide information about sculptures, and guide visitors through the museum.