Evaluation of the Online Virtual Reality 360° World Cultural Heritage Tourism under the Charter on Interpretation and Presentation of Cultural Heritage during the Covid-2019 Outbreak


 This study has formulated an evaluation framework for the interpretation and presentation performance of Online virtual reality 360°world cultural heritage tourism (OVRWCHT) approach during the covid-2019 break. The research framework is based on seven main principles of the Charter of the World Cultural Heritage Interpretation and Presentation theory, and establishes evaluation criteria for each principle. The World Cultural Heritage Site Hailongtun Tusi was selected as the case study, the Online virtual reality 360° system was for this site was established and evaluated accordingly. A collection of 1062 effective online questionnaires were support the evaluation. The results show that the OVRWCHT made by the research team which has received relatively wide recognition from stakeholders during the COVID-2019 outbreak period. However, it still needs more data support to improve technology and theory, especially transferability of OVRWCHT in other countries besides China. Finally, this study suggests that the ICOMOS should continue to issue relevant charters (documents) on how emerging technologies which may activate cultural heritage interpretation and presentation.


Introduction
Online virtual reality 360°world cultural heritage tourism (OVRWCHT) interpretation and presentation technology helps many tourists learn the outstanding universal value of world cultural heritage remotely.
Although a signi cant numbers of tourists still hope to go to the world cultural heritage site in person, the COVID-2019 outbreak from 2020 to present interrupted the trip of the vast majority of world cultural heritage enthusiasts. Under the COVID-2019 outbreak, many countries have implemented strict community isolation policies, limiting the normal travel of the vast majority of people. Nations across the world have imposed travel restrictions, even 93 percent of the global population lives in countries with coronavirus-related travel restrictions, during the COVID-2019 outbreak [1]. Network and remote technology have become an important way for the general public to understand the outside world. While people staying at home, they get more nostalgic for their past eld trips. Emerging technologies, especially arti cial intelligence, three-dimensional visualization and other advanced technologies give new ideas to avoid distant and dangerous trips. OVRWCHT played an increasing important role for the heritage tourism in China.
Online virtual reality 360° is not a new concept, nor is it a new attempt to apply it to world cultural heritage. However, this technology still satis es many Chinese people's exploration of world cultural heritage during the COVID-2019 outbreak. Therefore, the questions have been raised on what is the role of cultural heritage interpretation and presentation during the covid-2019 outbreaking? How the heritage interpretation and presentation may help to promote the outstanding universal value during the COVID-2019 outbreaking? Is that possible that emerging technologies would really do better than the traditional approach in cultural heritage interpretation and presentation?
This research believes that better service for world cultural heritage is not only from a technical point of view, but also needs to focus on the nature of World Heritage interpretation and presentation. Therefore,the aim of this research is to evaluate the interpretation and presentation performance of OVRWCHT during the covid-2019 outbreak period. In order to achieve the purpose of the research, this study establishes a theoretical framework to analyze the effectiveness of OVRWCHT based on the seven principles of the Charter of Cultural Heritage Interpretation and Presentation. An OVRWCHT was established tted the interpretation and presentation of world heritage site Hailongtun Tusi. A questionnaire survey was launched in China from May 28th to June 2nd, 2020. One of the purposes of the questionnaire survey is to verify the effectiveness of OVRWCHT. A total of 1062 valid questionnaires were collected, which veri ed the effectiveness of OVRWCHT in the interpretation and presentation of world cultural heritage.

Literature Review
Lacking enough research on cultural heritage during the COVID-2019 outbreak Various heritage originations published their statements on cultural heritage during the COVID-19 outbreak, for example, International Centre for the Study of the Preservation and Restoration of Cultural Property(ICCROM) published the statement on heritage in times of COVID,suggested how to support cultural bearers, artists, and craftspersons during COVID-19 outbreak [2]. Montlaur (2020)

from World
Monuments Funds expressed the concerns on the safety of those engaged in work around the world and economic support [3]. Council of Europe promised that education, heritage and culture do not stop to exist, and positively support the emerging technology applying to the heritage sector [4]. Nevertheless, Nadia Al-Said from the International Peace Institute argued that the lockdowns and no cure or vaccine caused a signi cant negative impact on economic and social life during the COVID-19 outbreak [5].
However, there are very limited academic researches combined the Cultural Heritage and COVID-19 Outbreak, but the concept that COVID-19 reformulated the lifestyle of humanity to access to cultural heritage have been accepted widely. Kuzelewska and Tomaszuk (2020) supported this opinion and also research on the case-law of the European Court of Human Rights in this eld [6] .

Interpretation and Presentation of Cultural Heritage
Charter on Interpretation and Presentation of Cultural Heritage (Tilden's Charter) has been rati ed by the 16th General Assembly of ICOMOS, on 4th October 2008, with the aim to de ne the basic principles of Interpretation and Presentation as essential components of heritage conservation efforts [7]. An increasing number of researches concerns on various aspects of heritage interpretation globally, some research claimed Tilden's Charter would be a useful tool for cultural conservation, protection and management [8][9][10]. Other researches applied the 2008 Charter to the community in the museum [11]; investigate the effect of tour interpretation on perceived heritage values base on tour guiding interpretation at a heritage destination [12,13]; satisfaction, attitudes and experience of visitors [14,15]; Heritage and hermeneutics[16]; visitors' preferences for interpretation [17,18]; interpretation and city heritage [19,20]; geoheritage interpretation [21] and heritage tourism interpretation [22,23].
However, Van Den Dries (2016) argued the Tilden's Charter lead to the dilemma base case research of Tell Balata, Palestine [24]. Asfaw and Gebreslassie (2016) supported it and suggested to develop appropriate interpretation system, preparing different interpretation infrastructures could be useful remedies [25].
Villasante (2019) also rede ned the concept of heritage interpretation by a stakeholders approach with theoretical and practical value, for their use in educational context [26].
Along with the development of emerging technologies, the Virtual reality augmented reality, arti cial intelligence, 3D printing, panoramic camera and other technologies began to be more widely used in the interpretation of cultural heritage. Rahaman (2018) proposed a conceptual framework for digital heritage interpretation with fteen considerations, then implemented and tested on an online platform to assess its impact on end-users' interpretation level [27].
Furthermore, given that the Charter only provides the essential points for heritage, there are still need detailed indictors and principles for assessing approaches for heritage interpretation and presentation. For example, an increasing number of the emerging technologies had been applied to cultural heritage interpretation and presentation, but few types of research focus on its standards, guidance and ethic.

The virtual reality technology and tourism experience
The application of the virtual/ augmented reality technology is not a new topic. Chung et al. (2015) focus on the role of augmented reality application for a heritage site from the tourists' intention to visit a destination, their research result base on shows that technology readiness was a predictor of perceived usefulness [28]. The role of augmented reality have different forms than virtual reality, and this research only uses 145 cases for analyzing may not able to re ect a comprehensive pictures on emerging technology. Tussyadiah et al. (2017) although pointed out the virtual reality technology offers opportunities for tourism, the challenges existing in understand the effectiveness of VR experience. Their research indicated that the feeling of being in the virtual environment increases the enjoyment of VR experiences, it provides empirical evidence to con rm the effectiveness of VR in changing the tourists' attitude and behavior [29]. However, some researchers believe the desire of tourists may have a stronger role than the nature of VR design. For example, Gonzalez-Rodriguez et al. (2020)evaluated the tourists' virtual tour experience during the visiting a cultural heritage destination by assessed 119 online comments, the ndings indicating the importance of desire of tourists on tourism sector [30] Nevertheless, this research considered that the 119 online comments still show the limited data for support the conclusion. Palace, Dunhuang and other panoramic virtual roaming systems enable visitors to visit presentation and historic sites without need of leaving home [31]. Shanghai Museum, Nanjing Museum and other museums with rst-class facilities also introduced the panoramic technology to build a virtual museum earlier [32]. The application of panoramic technology can break the shackles of geography and space, and interpret the connotation of cultural heritage more vividly, so as to achieve the widespread and effective dissemination of cultural values [33,34]. Basically, this consensus has been reached in academia in China.
Research Gap between Online Virtual Reality 360 applied and cultural heritage However, the application of panoramic technology in the scope of cultural heritage mostly lies in the technology of realizing virtual reality on the computer platform based on static images [32]. Lacking research on multimedia immersive experience and interaction design, and in the process of utilization, the application of panoramic technology is also facing con icts between digital technology and traditional culture, as well as the inability to reproduce the primordial nature of culture, and so on. Furthermore, these are lack of research to discuss the interrelationship between panoramic technology and Charter of Cultural Heritage Interpretation and Presentation. To address these problems, it requires panoramic technology to respect the original culture in the process of cultural heritage interpretation and presentation, further expand the application possibility of panoramic technology, and complement each other with the physical presentation of cultural heritage entities, and ultimately achieve the sustainable development of cultural heritage [35,36].
At present, the research is mainly based on the development of emerging technologies, while scenario application research is a supplement. Currently, the primary application research is mainly from the perspective of users. There is very limited research on the emerging technologies effectiveness of interpretation and presentation, nor has it tested its effectiveness in the COVID 19 epidemic stage. The study has formulated an analytic framework for this topic. The research framework is established mainly based on the seven main principles of the Charter on Interpretation and Presentation of Cultural Heritage, which serve as the important theoretical basis for interpretation and presentation of heritage. Based on these seven principles, relevant impact factors were made to be used for evaluation.

Methodology
The methodology of this study mainly consists of three components. The rst part is to select a World Cultural Heritage as a case study,and customize the OVRWCHT for it. The second part is to establish the OVRWCHT evaluation framework. The third part is to applying the case to evaluation framework with the support data of a questionnaire survey.

Developing the OVRWCHT for Hailongtun Tusi Site
Hailongtun, a world cultural heritage site, was selected as a case study for applying the OVRWCHT system with the follows reasons. Firstly, the authors of this research have participated in UNESCO World Heritage and sustainable tourism project from 2017 to 2019, authors had deep understanding of this site. The 3D point cloud of Hailongtun heritage had been established based on the UAV in 2019 by authors.
Secondly from a practical point of view, the Hailongtun cultural heritage administration is looking forward to building an online panoramic interpretation system but lack of a professional technology team. Hailongtun Tusi site is faced with the problem of inaccurate heritage interpretation of outstanding universal values. Moreover, during the epidemic period, the number of tourists decreased signi cantly, so it is urgent to use magnetic system for publicity. Therefore, The Hailongtun cultural heritage administration is very supportive of this study. Thirdly From the perspective of feasibility, the Hailongtun is only 1.6 square kilometers so that can established such system quickly in the case of limited human resource in this study.
The production process of online virtual reality 360 degrees is as follows. For the purpose of comprehensive presentation the world heritage Hailongtun Tusi Site cultural relic and its environment, the panoramic spherical mapping technology was used to complete the shooting and production of 360°p anoramic images of the planned shooting point. Establish panoramic roaming to increase good interaction between audience and application terminal. The virtual roaming combines the two forms of direct mouse click operation and button setting operation to achieve the right and left rotation, upwardlooking, overlooking and scene pushing and pulling operations of the audience during the roaming process. In the roaming process, the smooth transition between the scene points is achieved. The presentation of the overall layout is combined with the plan to create navigation, so that the audience can always grasp the actual position of the observation point, and at the same time not lose the direction of the overall layout of the scenic area. The interactive link between navigation map and 3D panorama is realized, and the combination of navigation map guide, picture presentation, text introduction and voice explanation enables the audience to obtain more information about the outstanding universal value of the world cultural heritage Hailongtun Tusi Site, when browsing and viewing. It is convenient for the audience to quickly switch to the presentation of interest through navigation Settings.

Collection and stitching of panoramic images of presentation
The image of the Hailongtun Tusi Site panorama navigation system is captured by DETUF4FD121 camera. The DETUF4FD121 camera is equipped with 4 full glass sh eye lenses. It can take pictures of 360 degrees around the center of the shot spot. (Fig. 1-4). More than 200 key points were selected within 160.42 hectares of Hailongtun property zone in 7 days, and more than 2000 scene pictures were taken for post collage, covering all the important relics and roads of Hailongtun Tusi Site property zone. More than 2000 pictures were taken for later processing. The presentation selected covers all the important sites and roads in Hailongtun Tusi Site property zone (Fig. 5).
With DetuStitch software from DETUF4FD121 camera the collage of panorama is completed (Fig. 6). Image processing software (Photoshop) is used to repair and unify the exposure and color of some images.

World Heritage Site Series Release
Finally, 153 panoramic images re ecting the whole landscape of Hailongtun property zone were selected to establish a one-way roaming path from the sight-seeing bus stop of Hailongtun Village Nianfang Bay(the start point) to Tou Dao Pass(the nal point). At the nine heritage Pass, restoration models, archaeological site survey map, voice and text interpretation of gateways had been added. Important points and intersections are added to highlight the outstanding universal value of Hailongtun ( Fig. 7 and Fig. 8). The audience can choose the content they are interested in by clicking on the hot spot icons in the panorama.
Create navigation on the basis of the property zone plan, so that the audience can understand the location of the current panoramic picture in real time, and a more three-dimensional overall impression of the whole world heritage site could be created. At the same time, a variety of scene switching modes, such as hot spots, small pictures, navigation, etc., make it convenient for the audience to jump to any tour location at will in the virtual tour, so that the audience can have an "immersive" tour experience in the panoramic virtual tour. Finally, the system is imported into the network cloud and is free of charge. Users can use any mobile phone or computer with network connection to access it. The link for the system is still available, http://m.detu.com/zh/pano/show/691589?from=timeline. So far, the system has reached 3.76 thousand online visitors.

Hailongtun OVRWCHT effectiveness evaluation research method
Effectiveness evaluation is based on the authenticity and accuracy of information. First, this study used the literature review method to study international teams in the related elds. Second, this research published a set of network questionnaires, based on the information obtained from the questionnaire, the indicators employed for evaluation had been selected. During the COVID 19 epidemic period, this study mainly tested the awareness of the public on OVRWCHT. Therefore, the test was conducted in the form of network questionnaire. The test is conducted in China, so the language of the questionnaire is mainly Chinese. Third, a combination research method in accordance with the actual situation in China is developed in this study to formulate a framework for evaluating the effectiveness of OVRWCHT. The evaluation effectiveness is mainly based on a set of indicators. How to evaluate the effectiveness is the focus of the study. Evaluation can be divided into two main forms: qualitative evaluation and quantitative evaluation. The qualitative evaluation mainly refers to the author's evaluation of OVRWCHT according to Charter of cultural Heritage interpretation and presentation, while quantitative evaluation focuses on the effect of the model in the form of online questionnaire (Table 1). 2. Does the OVRWCHT take into account its possible uses in school curricula, informal and lifelong learning program, communications and information media, special activities, events, and seasonal volunteer involvement?
3. Does the OVRWCHT may help training of quali ed professionals in the specialized elds of heritage interpretation and presentation?

Questionnaire survey
In this study, 1283 online questionnaires were collected, and the authenticity and validity of all the questionnaires were analyzed and screened, and the results were veri ed. Finally, 1062 valid questionnaires were obtained after removing the questionnaires with the similar IP address, suspected wrong email address and answers. The collection was conducted from May 28 to June 2, 2020. According to the questionnaire, the automatic access function of IP addresses of respondents was shown, and the respondents' geographical scope included all Chinese mainland provinces and Taiwan and Hongkong special administrative regions. There are more people lling in the questionnaire in the densely populated coastal provinces. In addition, 93 of the valid questionnaires were from abroad, accounting for 8.76% of all respondents (Fig. 9).
The age of the investigated population is under 60 years old, and it is distributed in several different age groups. The proportion of 18-25 years old is the highest, followed by 31-40 years old and 26-30 years old (Fig. 10). Due to the high proportion of young Internet users are in China, many of the respondents are relatively young. The age range lled in the Internet questionnaire is basically consistent with that of the actual Internet users in China.
Therefore, the survey samples cover the whole country and the main population age groups. Based on the demographic perspective, 1062 valid questionnaire samples can be considered to be representative and can be used for research and analysis.

Research Findings
Based on the research framework and indicators of Charter of Cultural Heritage Interpretation and Presentation listed in methodology, this research summarizes the research nding as fellow.

Principle 1: Assessment and Understanding
The evaluation focuses on whether the access of the general public to OVRWCHT is convenient, easy to use and easy to understand. Therefore, according to the results of the questionnaire ( Table 2 and  Table 3), in terms of the world cultural heritage interpretation and presentation experience, the visitors' scores on the use of emerging technologies are higher than that of traditional interpretation and presentation methods. In the total score of 5 points, the OVRWCHT approach score is 3.65, the traditional heritage site guide or audio guide score is 3.49, and the traditional world heritage site publicity board and brochure score is 3.20.
In terms of interpretation and presentation effect of highlighting outstanding universal values of world cultural heritage, the visitors' scores on the use of new technologies are also higher than that of traditional presentation methods. In the total score of 5 points, OVRWCHT score is 3.61, heritage site guide or audio guide score is 3.49, and World Heritage site publicity board and brochure score is 3.31.
Therefore, the data shows that the general public thinks that the application of OVRWCHT has a better sense of experience, is easy to use, and is easier to understand than the traditional way. In addition, OVRWCHT can promote the understanding and appreciation of cultural heritage, cultivate public awareness and public participation in cultural heritage protection. From the perspective of geographicalstatistics, OVRWCHT has carried out cultural heritage publicity in a broader geographical range of China's population areas, so that the public can directly access the main contents of cultural heritage online.
OVRWCHT is one of the important ways of off-site interpretation and presentation.
However, this study has not yet proved that OVRWCHT can de nitely inspire more level of interest, learning, and needs in-depth study. The main language of this system is Chinese, which cannot show the diversity of language.  The second principle concerns on evidences gathered through accepted scienti c and scholarly methods and traditions.
From the perspective of the producer of OVRWCHT, the online platform takes the main contents of the world cultural heritage as words, pictures, voice and other forms, so that the users of the online platform can get more information about the outstanding universal value. Based on the information source rules, the main heritage sites in the of the world cultural heritage Hailongtun Tusi heritage are recorded in the form of digital panoramic photos, and the online form is used to publicize the outstanding universal value of the heritage during the COVID-2019 outbreak period. The world cultural heritage information explained in the system, especially the introduction of key sites, and the three-dimensional reconstruction of key sites, all have accurate sources. The content of heritage interpretation is mainly based on the existing archaeological ndings, for example the Study of the Application for the World Heritage, and the Research Report on the Basic Information of Hailongtun Site. These information sources are reliable and evidence-based, which can be considered as evidences gathered through accepted scienti c and scholarly methods.
However, there is no introduction of oral history in OVRWCHT, and it is not directly related to the existing interpretation system of Hailongtun world cultural heritage.

Principle 3: Context and Setting
This principle concerns on the interpretation and presentation should relate to their wider social, cultural, historical, and natural contexts and settings.
Because OVRWCHT' users do not fully understand the context and setting of world cultural heritage before using this platform, so the assessment of this principle is mainly based on the authors' perspectives. This study believes that OVRWCHT attaches importance to the combination of natural and However, OVRWCHT failed to cover the local folk customs, intangible cultural heritage and local villagers' cultural customs in depth.

Principle 4: Authenticity
This principle concerns on how to respect the basic tenets of authenticity in the spirit of the Nara Document (1994). Because OVRWCHT' users may not fully understand the authenticity of world cultural heritage before using this platform, so the assessment of this principle is mainly based on the authors' perspectives.
This study believes that OVRWCHT strictly abides by the principle of authenticity, especially the interpretation of Heritage Authenticity in Nara Document (1994). This system also reduces the eld pressure of world heritage tourism, uses online digital guide to presentation and explain the current situation of heritage relatively accurately, avoids harm to presentation facilities, and basically achieves the purpose of protecting the authenticity of world heritage.
However, OVRWCHT failed to fully demonstrate the link between heritage and local communities in terms of authenticity. Due to the need of heritage protection, local community residents in Hailongtun have moved away, and this assessment has nothing to do with this system. This system does not use live concert and other forms to interpret the heritage value.

Principle 5: Sustainability
This principle concerns on the interpretation and presentation should be sensitive to its environment, with social, nancial, and environmental sustainability among its central goals.
According to the questionnaire, up to 93.79% of the respondents agree that arti cial intelligence, threedimensional visualization, light and shadow vision and other emerging technologies are important techonoligies to promote the sustainable tourism of world cultural heritage. Through cross analysis, the older the respondents are, the more supportive they are in the application of new technology in the eld of world cultural heritage interpretation and presentation. (Fig. 11 / 12) OVRWCHT shows that the objectives are consistent with the sustainable development objectives, and promotes heritage site protection, education and cultural services. Online system is also one of the ways to reduce the pressure of tourism and protect the world heritage during the epidemic.
However, OVRWCHT is not included in the current legal planning requirements of Hailongtun world cultural heritage, but the interpretation purpose of OVRWCHT does not con ict with the legal planning goal. The OVRWCHT is not integrated with the heritage assessment and does not involve the elements of permanent heritage facilities and maintenance. The OVRWCHT is closely related to the network system, and has little relationship with the existing interpretation facilities and tourists.

Principle 6: Inclusiveness
This principle concerns on the result of meaningful collaboration between heritage professionals, host and associated communities, and other stakeholders.
Because OVRWCHT users may not fully understand the inclusiveness of world cultural heritage, so the assessment of this principle is mainly based on the authors 'understandings.
From the perspective of stakeholders, world heritage managers, local residents and world heritage tourism practitioners all support the positive impacts of the OVRWCHT. The vast majority of stakeholders think that OVRWCHT is effective in promoting the outstanding universal value of world cultural heritage of Hailongtun, and the vast majority of stakeholders have a positive evaluation on it. For users, OVRWCHT is easy to be operated and heritage value information can be easily obtained. For heritage managers, OVRWCHT operation is more accurate, convenient and effective in explaining the core heritage value of world cultural heritage, and the cost is controllable. This OVRWCHT can provide navigation for a large number of tourists, facilitate world heritage management, and facilitate remote promotion of world heritage sites, so it is highly praised by local heritage management departments, and as an important digital project of heritage management institutions, this system was be launched on World Heritage Day on June 13, 2020. For tourism practitioners and community residents, online tourism can attract more tourists. There are many problems in the development of heritage tourism under the period of epidemic, and the pro t rate is reduced. OVRWCHT can promote tourism development and community development.
OVRWCHT allows the managers of world cultural heritage to directly contact tourists, so the middlemen of tourism operation industry may be eliminated. The content production of OVRWCHT heritage interpretation is based on the collaborative efforts of different stakeholders, respects for the opinions of stakeholders, and widely and repeatedly collecting the modi cation opinions. The online platform is produced by authors, whom worked for Tongji University, with clear copyright and use right.

Principle 7: Research, Training, and Evaluation
This principle concerns on continuing research, training, and evaluation which are essential components of the interpretation of a cultural heritage site.
Similar to the previous principle, this principle is evaluated by the author based on the research framework. This study believes that this assessment is an ongoing study of OVRWCHT, and the main purpose of this study is to assess the effectiveness of this platform. The OVRWCHT is continuously improved with the continuous research. This study collected the feedback of some stakeholders on the interpretation and presentation of the world cultural heritage Hailongtun Tusi through questionnaires.
This study is at the initial stage. At this stage, there is no plan and action for any professional training, nor international cooperation.

Discussion
Although this study tried its best to ensure the authenticity of information, most of the people who lled in the questionnaire are effected from epidemic during the COVID-2019 outbreak, so they may have different perceptions when providing data than during the non epidemic period. However, the impact on the overall authenticity of the research data may be very small.

Conclusion
This study proposes an evaluation framework for the interpretation and presentation performance of OVRWCHT approach during the covid-2019 break. The research framework is based on seven main principles of the Charter of the World Cultural Heritage Interpretation and Presentation theory, and establishes evaluation criteria for each principle. The research object is based on OVRWCHT of Hailongtun Tusi world cultural heritage made by the author's team. The research data is mainly based on the collection of 1062 effective online questionnaires and the analysis of the above online system in this study.
The results show that, whether in terms of users' experience or interpretation of outstanding universal value, the OVRWCHT is a three-dimensional heritage interpretation and presentation technology made by the research team which has received relatively wide recognition from stakeholders during the COVID-2019 outbreak period. According to the research framework, OVRWCHT generally conforms to the seven interpretation and presentation principles. However, at present, some of the detailed rules of the presentation principles are not related to online interpretation, so it cannot be evaluated. Panoramic 3D can be used as one of the important ways of heritage presentation and interpretation during the epidemic.      Mapping and restoration sets used in the system for interpretation of heritage Geographical Scope of respondents. Note: The designations employed and the presentation of the material on this map do not imply the expression of any opinion whatsoever on the part of Research Square concerning the legal status of any country, territory, city or area or of its authorities, or concerning the delimitation of its frontiers or boundaries. This map has been provided by the authors.