Next Article in Journal
Bat Hibernation: In Groups or Individually?
Previous Article in Journal
Aggregate Type and Concrete Age Effects on Anchor Breakout Performance: Large Database and Insights
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Correlations between SSQ Scores and ECG Data during Virtual Reality Walking by Display Type

1
Department of Biomedical Engineering, School of ICT Convergence Engineering, College of Science & Technology, Konkuk University, Chungju 27478, Republic of Korea
2
Research Institute of Biomedical Engineering, Konkuk University, Chungju 27478, Republic of Korea
*
Author to whom correspondence should be addressed.
Appl. Sci. 2024, 14(5), 2123; https://doi.org/10.3390/app14052123
Submission received: 13 January 2024 / Revised: 12 February 2024 / Accepted: 1 March 2024 / Published: 4 March 2024

Abstract

:
To encourage the application of virtual reality (VR) in physical rehabilitation, this study analyzed the occurrence of motion sickness when walking on a treadmill in virtual straight paths presented on two types of displays (screen and head-mounted displays (HMDs)) at a constant speed of 3.6 km/h. The simulator sickness questionnaire (SSQ) scores, which indicate motion sickness, were collected from the participants. In addition, the heart rate (HR) and heart rate variability (HRV; RMSSD and LF/HF ratio) were measured from electrocardiogram data. The correlations between the SSQ scores and HR and HRV were examined to identify a reliable variable for evaluating motion sickness. The SSQ scores were used to classify the data into the motion-sickness and no-motion-sickness groups. The data were classified into the motion-sickness group if a minimum difference of 15 points existed between the walking and baseline phases when using the screen and HMD; otherwise, the data were classified into the no-motion-sickness group. The HR and LF/HF ratio were higher, whereas the RMSSD was lower in the motion-sickness group. Moreover, within the motion-sickness group, the reduction in RMSSD and increase in HR and LF/HF ratio were greater with the HMD than with the screen. Regression analysis was performed on the HR, HRV, and SSQ scores to differentiate between the motion-sickness and no-motion-sickness groups. The regression analysis results showed a high negative correlation between the SSQ score and RMSSD. The results of this study can assist in controlling the occurrence of motion sickness in VR-based applications.

1. Introduction

The demand for head-mounted displays (HMDs) for viewing virtual reality (VR) content has been increasing annually. In particular, VR technology has seen significant growth in the wake of COVID-19, owing to remote meetings becoming increasingly common. Moreover, the increase in the number of people who want to gain various experiences from the comfort of their homes through VR devices has led to a rapid increase in the number of VR users [1].
However, several side effects of VR have been reported, the most common being cybersickness, also known as simulator sickness or motion sickness, which occurs when using VR; it is accompanied by symptoms similar to those of actual motion sickness, such as eye fatigue, disorientation, and nausea [2]. Cybersickness is a condition characterized by symptoms such as nausea, dizziness, and headaches experienced by users in virtual reality (VR) environments, with the sensory conflict theory being reported as the primary cause. This refers to the discrepancy between visual information in the virtual environment and the motion and position senses from the inner ear, leading to motion sickness. Additionally, factors in VR environments such as parabolic motion representation, update latency, limited field of view, and individual differences among users have also been reported as causes of cybersickness [3]. Although studies have been conducted to identify and quantify the causes of cybersickness, its symptoms and degree vary among individuals, making research difficult.
In most previous studies, a moving virtual environment was presented to stationary seated subjects, and the degree of motion sickness was measured. For subjective evaluations, the VR sickness questionnaire, which includes the simulator sickness questionnaire (SSQ), was used [4], and the motion sickness susceptibility questionnaire (MSSQ) was used to determine the individual differences in motion sickness due to various stimuli [5]. For objective evaluations, heart rate (HR) and heart rate variability (HRV) analyses through electrocardiograms (ECGs) were primarily used. In addition, electroencephalographs, which indirectly measure the electrical activity in the neurons of the brain [6,7], breathing rate [8], and body temperature [9], were used for evaluating motion sickness.
One of these biosignals, the HRV, indicates the changes in the HR intervals related to autonomic nervous system control, including the sympathetic and parasympathetic nervous systems [10]. Parasympathetic activity slows down the HR; conversely, sympathetic activity increases the HR. The dynamic balance between the parasympathetic and sympathetic activities causes continuous oscillation of the HR, which is called the HRV [11]. Physiological indicators such as the HRV parameters allow researchers to quickly ascertain the physical conditions of the study participants. HRV parameters can be used to examine the condition of a study participant based on their parasympathetic and sympathetic activities; therefore, the HRV parameters that are most highly correlated with cybersickness should be studied.
Accordingly, questionnaires and various biosignal measurements are being used to examine these correlations with motion sickness; however, the majority of the existing cybersickness studies have been performed in a state of limited movement, and studies on motion sickness during regular movements such as walking are limited. In particular, the use of VR in walking rehabilitation is currently increasing; consequently, it has become necessary to examine cybersickness and control the factors affecting it [12,13]. Parijat et al. (2011) examined the gait variables in 16 healthy seniors after walking on a treadmill while wearing or not wearing an HMD displaying a walking trail environment [12]. Increased variability in the gait variable and joint flexion were observed within 10 min of performing VR walking when compared with normal walking; however, after 15 min, the walking characteristics became similar to those of normal walking. This confirms that the acclimation time is important when designing VR-based training. In the case of Lheureux et al. (2020), 10 Parkinson’s patients in their 60s performed treadmill walking with track walking/treadmill walking/VR, and we tried to compare the walking variables at that time [13]. As a result, VR walking has no difference in stride time variability (i.e., coefficient of variation, CV) or fractal dynamics (i.e., α value of detailed function analysis, DFA) under different walking conditions, but the step length and gait cadence were improved compared to treadmill walking. These studies show that VR can be used to implement gait rehabilitation. When VR is used to perform rehabilitation, side effects such as cybersickness are considered a major limitation. To use VR in various fields in addition to rehabilitation, there is a need for research on cybersickness during VR use that is accompanied by movement, namely, walking. Many studies have been conducted on cybersickness that occurs when viewing virtual environments; however, research on cybersickness that occurs when viewing virtual environments accompanied by regular movements is lacking. Therefore, this study aimed to use a subjective evaluation (SSQ) and an objective evaluation (ECG) to determine the cybersickness that occurs when subjects are presented with a virtual straight path on two types of displays (screen and HMD) and walk at a constant speed on a treadmill. In addition, this study analyzed the difference in HR and HRV (root mean square of the successive differences (RMSSD), LF/HF ratio) between the motion-sickness group and no-motion-sickness group, as classified using the SSQ, and analyzed the correlation between the SSQ score that determined the presence of motion sickness and HR and HRV to find reliable variables that allow motion sickness to be evaluated via ECG.

2. Research Methods

2.1. Experimental Design

Eleven men in their 20s (age 23.7 ± 2.5, height 176.5 ± 5.5 cm, weight 74.6 ± 12 kg) participated in this study. The protocol for the research project was approved by the Institutional Review Committee of Konkuk University, where this study was performed, and conforms to the provisions of the Declaration of Helsinki (IRB number: 7001355-202307-HR-675).
In the experiments, Unity 3D (Unity Technologies, San Francisco, CA, USA) was used to present the subjects with a virtual straight walking path (Figure 1), and they walked continuously on a treadmill (DRAX, RX9200, Anyang, Gyeonggi-do, Republic of Korea). The virtual scene was presented to the subjects via a screen (160 cm × 120 cm) and an HMD (Oculus Quest 2, Meta, weight: 503 g) (Figure 2).
The experiment was conducted under two conditions: screen walking, where participants walked on a treadmill while looking at a screen (160 cm × 120 cm), and VR walking, where participants walked on a treadmill while wearing a Head-Mounted Display (HMD). In both conditions, the screen moved in sync with the participant’s walking speed on the treadmill. The experimental design for both conditions was identical, as shown in Figure 3. The baseline segment involved participants standing still and looking at the screen for 1 min in a rest state. During the walking segment, participants performed a total of 15 min of walking on a straight pathway, with the walking speed fixed at 3.6 km/h. The rest segment was a break period, during which participants were instructed to stand still and look at the screen to return to a rested state. The experiment was conducted randomly, with a 30 min rest period after the walking experiment of one condition before performing the walking experiment of the other condition. Each condition was performed once, without repetition.

2.2. Data Measurement and Analysis

The subjective and objective indicators of cybersickness were measured under two conditions (screen-assisted walking and HMD-assisted walking). The Simulator Sickness Questionnaire (SSQ) survey was used as a subjective indicator, and the most commonly used evaluation method to measure subjective motion sickness in cybersickness [14], and there are many variations in the type or number of items. Therefore, although the total score can vary in each study, the SSQ score is considered highly reliable because it includes evaluation items that consider various circumstances leading to cybersickness, and it is not only affected by the visualization screen but also by control methods such as joysticks [15]. The SSQ consists of five main items, namely, eyestrain, overall discomfort, nausea, concentration, and headache, as well as 28 sub-items that belong to these items; a score of 1–7 is entered for each item. In this study, the SSQ questionnaires were completed by each participant directly after the baseline and walking phases in each of the two experimental conditions (screen and HMD). The SSQ test for each phase took about 3 min.
ECGs were measured as the objective indicators, and the Trigno EKG sensor (Delsys, Natick, MA, USA) was used as the measurement equipment. For the experiment, two electrodes were used, with one attached under each side of the chest. The HR and HRV were extracted using HRV analysis (ANS Lab Tools). For the HRV, the RMSSD and LF/HF ratio were used to examine the activation of the sympathetic and parasympathetic nerves. The RMSSD is the root mean square of the differences in the RR interval and is calculated by using the time difference between consecutive heartbeats in milliseconds, squaring each value, finding the average of the result, and determining the square root of the total. It reflects the beat-to-beat variance in the HR and is used as a domain measurement to estimate the changes in the HRV [16]. A high value of the LF/HF ratio indicates that the sympathetic nerves are activated or that the activation of the parasympathetic nerves is blocked. In short, this value can help quantify the overall balance between the sympathetic and parasympathetic nervous systems. The HR, RMSSD, and LF/HF ratio measured in the experiments under the two conditions were analyzed based on variations in the values, which were determined by subtracting the baseline data from the walking interval data.
To analyze the correlation between the occurrence of cybersickness and HR and HRV, the SSQ score of each subject was used to divide the subjects into two groups (motion sickness and no motion sickness) and perform an analysis. The SSQ scores after the baseline phase and those after the walking phase were compared; subjects with a score difference of less than 15 points were classified as the no-motion-sickness group, whereas those with a score difference of more than 15 points were classified as the motion-sickness group. Thus, six subjects were classified under the no-motion-sickness group (age 23.5 ± 5.8, height 175.2 ± 5.8 cm, weight 68.2 ± 8.8 kg), and five subjects were classified under the motion-sickness group (age 24 ± 1.4, height 178.0 ± 5.3 cm, weight 82.4 ± 11.1 kg) according to the differences in their SSQ scores, and an analysis of the HR and HRV according to the occurrence of motion sickness was performed.
To examine the differences in SSQ scores, HR, RMSSD, and LF/HF ratio differences between the two conditions (screen and HMD) and the two groups (motion-sickness group, no-motion-sickness group), we conducted a two-way ANOVA using SPSS 25 (IBM, Armonk, NY, USA). Specifically, we first performed paired-sample t-tests to assess SSQ scores, HR, RMSSD, and LF/HF ratio differences within each group across the two conditions. Second, we utilized independent-sample t-tests to examine SSQ scores, HR, RMSSD, and LF/HF ratio differences between the two groups within each condition. Lastly, to determine whether objective indicators such as HR, RMSSD, and LF/HF ratio differences could also be used to distinguish between the motion-sickness and no-motion-sickness groups, in addition to the subjective indicator of SSQ scores, we conducted linear regression analysis. This analysis aimed to clarify whether higher SSQ scores correspond to higher or lower values of HR, RMSSD, or LF/HF ratio. Using SSQ scores as the dependent variable and the remaining variables (HR, RMSSD, LF/HF ratio differences) as independent variables, we sought to identify which variable best represents SSQ scores and could therefore serve as an objective indicator for distinguishing between the motion-sickness and no-motion-sickness groups.

3. Experimental Results

Figure 4 presents a graph of the SSQ scores of the two groups under the two experimental conditions (screen-assisted walking and HMD-assisted walking). The score of the no-motion-sickness group was 2.3 for screen-assisted walking and 4.2 for HMD-assisted walking, that is, the score with the HMD was higher by 1.9. In the motion-sickness group, the score was 21 with the screen and 34.6 with the HMD, that is, an increase of 13.6. Statistical analysis confirmed that the increase in the SSQ scores between the two groups was significant (p < 0.001). The t-test showed significant results under the two conditions for the motion-sickness group (p = 0.005), and there was a significant difference in the SSQ score between the two groups during the HMD-assisted walking phase (p < 0.001).
Table 1 presents the HR, RMSSD, and LF/HF ratio differences for the two groups (no motion sickness and motion sickness) under the two conditions. Figure 5a shows the HR difference between the two groups (no motion sickness and motion sickness) under the two conditions. The results of a two-way ANOVA showed that only the difference in HR was significant between the two groups (p = 0.047). That is, there was a significant increase in HR difference in the motion-sickness group when compared with that in the no-motion-sickness group. In addition, the t-test results showed that there was a significant increase in HR when the HMD was used compared to when the screen was used in the motion-sickness group (p = 0.04). Moreover, the motion-sickness group showed a significant increase in HR difference when compared with that of the no-motion-sickness group when wearing the HMD (p = 0.006).
Figure 5b shows the RMSSD data results for the two conditions (HMD and screen) and two groups. The two-way ANOVA results confirmed the difference in RMSSD between the two groups (p = 0.037). That is, the reduction in the RMSSD of the motion-sickness group when compared with that of the no-motion-sickness group was significant. The t-test results showed that the RMSSD decreased by a greater extent during walking with the HMD than during walking with the screen in the motion-sickness group (p = 0.027). In addition, the RMSSD decreased by a greater extent in the motion-sickness group than in the no-motion-sickness group when wearing the HMD (p = 0.012).
Figure 5c shows the LF/HF ratios; the analysis of the LH/HF ratios for the two groups under the two conditions did not show statistical significance for the groups or conditions. The t-test results showed that the increase in the LF/HF ratio in the motion-sickness group was greater during screen-assisted walking than during HMD-assisted walking (p = 0.04), and the increase in the LF/HF ratio was greater in the motion-sickness group than in the non-motion-sickness group when walking with the HMD (p = 0.05).
In the linear regression analysis, a stepwise method was used, and the SSQ scores were designated as dependent variables, whereas the HR, RMSSD, and LF/HF ratio were designated as independent variables. From the analysis, the RMSSD was selected as the variable of interest, and the results were significant at p < 0.001 (Table 2). These results were found to have an explanatory power of approximately 62%, with R2 = 0.617 (Figure 6).

4. Discussion

Following recent research results that showed that walking in virtual environments is effective for rehabilitation, this study aimed to analyze the correlations between HR, HRV, and SSQ scores with regard to motion sickness symptoms that can occur when walking, which is the most basic human movement, in a virtual environment. The HR difference was higher in the motion-sickness group than in the no-motion-sickness group, and the increase in HR difference was higher during HMD-assisted walking than during screen-assisted walking in the motion-sickness group. In addition, the RMSSD difference was lower in the motion-sickness group than in the no-motion-sickness group, and the decrease was greater during HMD-assisted walking than during screen-assisted walking in the motion-sickness group. The increase in the LF/HF ratio was greater during HMD-assisted walking than during screen-assisted walking in the motion-sickness group. The results of a regression analysis of the HR, HRV difference, and SSQ scores, which differentiated the motion-sickness and no-motion-sickness groups, showed that there was a high negative correlation between the SSQ scores and RMSSD difference.
Nalivaiko et al. (2015) asked 26 subjects to view a virtual roller coaster, evaluated the degree of motion sickness symptoms through an MSSQ survey, and measured their HRs and finger temperatures [17]. The results showed that there was little change in the HR for patients with nausea scores of less than five. However, the HR increased overall in patients with scores of five or greater (occurrence of cybersickness), and their finger temperatures were higher. Lin et al. (2018) presented three types of virtual environments to 25 subjects and asked the subjects to provide their motion sickness scores [7]. The changes in the symptoms were confirmed based on the HR and HRV of the group that experienced motion sickness and the group that did not experience motion sickness based on their motion sickness scores. As a result, it was found that the HR increased as the symptom scores increased, and the HRV was higher for the sickness group. Kim et al. (2022) presented VR content to 16 subjects, performed an SSQ survey, and measured the biosignals (blood pressure, cortisol, and HR) before and after viewing of the content [18]. It was found that the HR and cortisol levels were greatly increased in subjects who experienced cybersickness. Although the stimuli conditions differed from those in previous studies, the present study also found that the HR increased in the motion-sickness group when compared with that in the no-motion-sickness group during VR-assisted walking, which was the focus of this study, and the change in the HR of the motion-sickness group was greater during HMD-assisted walking than during screen-assisted walking. Particularly, it was found that the sympathetic nerves were activated more intensively during HMD-assisted walking than during screen-assisted walking in the motion-sickness group.
The RMSSD is the primary measure used to predict the beat-to-beat variability in the high-frequency band of the HRV; a larger RMSSD value indicates a more stable condition. Magaki and Vallance (2019) presented virtual environments in which 16 subjects attempted to locate five objects for five minutes under two conditions (using PCs and HMDs) and measured their HRs and SSQ scores [19]. Motion sickness symptoms in HMD-equipped walking were stronger, and there was a significant reduction in the mean value of NN intervals (NNMean), standard deviation of the NN intervals (SDNN), and RMSSD in the HMD conditions when compared with PC-equipped walking. Although these variables can be potential indicators of cybersickness, their correlation with the intensity of motion sickness remains uncertain. Gavgani et al. (2017) used the data from 12 subjects in their 20s and 30s who experienced a virtual roller coaster via HMDs (including scenes of embarking, moving forward, and moving backward) to determine the resulting degree of motion sickness symptoms (nausea) and measured the skin conductivity and ECGs [20]. Based on the results, they reported that the intensity of motion sickness was higher during forward-moving scenes than during backward-moving scenes, and the skin conductivity increased when motion sickness occurred, confirming the correlation between skin conductivity and motion sickness. In addition, there was an inverse correlation between the RMSSD and motion sickness symptoms, and the RMSSD was significantly reduced when the symptom level was high. In this study, RMSSD reflected the short-term variability in the HR and was a measurement of the parasympathetic nervous control of the heart. The RMSSD decreased to a greater extent in the motion-sickness group than in the no-motion-sickness group. Moreover, the difference was greater during HMD-assisted walking than during screen-assisted walking in the motion-sickness group. That is, it was found that the subjects became unstable during walking when motion sickness symptoms occurred, and the instability was greater when the stimuli were presented via an HMD than a screen.
The LF/HF ratio compares the relative power of the low-frequency band (0.04–0.15 Hz) to that of the high-frequency band (0.15–0.4 Hz). Under controlled conditions, this ratio can be used to estimate the ratio of sympathetic nervous system activity to parasympathetic nervous system activity [21]. Hsin et al. (2022) used HMDs to present 360° VR scenes to 28 subjects for ten minutes and assessed motion sickness using the HRV and SSQ questionnaire [22]. Ten patients had scores of 20 points or less, indicating mild simulator sickness, and the frequency of the SS symptoms increased as the screen speed increased. The SSQ scores showed a positive correlation with the very low frequency (VLF) band, and the VLF power was higher in the motion-sickness group than in the no-motion-sickness group, with a greater difference occurring in the 6–10 min interval. Kiryu and Iijima (2014) divided 15 male participants in their 20s into motion-sickness and no-motion-sickness groups according to the difference in the SSQ scores before and after repeated (five times) exposure to visual first-person-perspective motion sickness-inducing content [23]. The LF and HF time series data were acquired, and the LF values of 120% or above and HF values of below 80% were recorded as peak values. The motion sickness symptoms clearly increased as the frequency of the peaks increased. This study aimed to confirm that the LF/HF ratio is correlated with cybersickness by comparing the amount of change in the frequency of peaks and the amount of change in the LF/HF ratio at the peaks. The results showed that the LF/HF ratio increased when the frequency of the peak values increased, confirming the correlation between the LF/HF ratio and cybersickness. In addition, because the increase in the LF/HF ratio decreases over time when the frequency of the peaks decreases, it is expected that cybersickness is likely to have occurred because of a specific cybersickness-inducing trigger factor rather than simply because of prolonged exposure to virtual stimuli. Setiowati et al. (2019) conducted experiments with 15 participants wearing HMDs and performing driving simulation tasks for 15 min [24]. Subsequently, they conducted SSQ surveys in which the nausea score was negatively correlated with the LF/HF ratio; however, there was no statistically significant correlation with the RMSSD. In the present study, the LF/HF ratio increased to a greater extent in the motion-sickness group than in the non-motion-sickness group. Within the motion-sickness group, the difference was greater during HMD-assisted walking than during screen-assisted walking. Psychological stress due to motion sickness is significantly correlated with an increase in the LF/HF ratio [25]. LF power is related to sympathetic activity, and HF power is related to parasympathetic activity [26]. This indicates that the cybersickness induced in the participants increased the LF power and decreased the HF power. The increase in the LF power indicates that the sympathetic nervous system is dominant, which can be considered a bodily reaction to external stimuli.
This study aimed to find reliable data for determining the variable that can predict the presence of motion sickness among several variables measured on an ECG. The RMSSD had a high negative correlation with the SSQ scores; that is, the RMSSD scores decreased as the SSQ scores increased. It is possible that the RMSSD data can be used as a reliable variable that acts as an objective indicator to differentiate the motion-sickness group from the no-motion-sickness group during walking. RMSSD is one of the main variables used to analyze the short-term components of HRV. This variable represents the short-term heartbeat variability factors and is an indicator of the controlling capacity of the parasympathetic nerves. The reduction in RMSSD with an increase in the degree of motion sickness during walking in a virtual environment represents an inappropriate response by the autonomic nervous system function and appears to influence the cardiovascular system response.
Previous studies have measured motion sickness-related biosignals after constraining body movements. Hence, these studies cannot be compared with the present study, which measured motion sickness-related biosignals during walking. However, this study can be considered important fundamental research on rehabilitation incorporating virtual environments because it identified the HRV variables that can determine the presence of motion sickness when walking in VR. For example, if a patient’s RMSSD value changes abruptly, the intensity of rehabilitation activities can be automatically reduced to allow the patient to participate more comfortably in the rehabilitation process. Additionally, monitoring RMSSD can detect early signs of cybersickness in the VR environment. By promptly responding when symptoms of motion sickness begin to appear, i.e., by adjusting or pausing VR activities, it is possible to minimize patient discomfort and enhance the efficiency of rehabilitation. In the future, we plan to conduct experiments according to age and patient groups requiring rehabilitation to identify the variables that can determine the presence of motion sickness when walking in VR. In addition, we aim to classify the SSQ scores, which measure the degree of motion sickness, by item to identify the symptoms that appear most prominently during VR walking and apply this to the motion sickness evaluations. We also plan to examine the changes in walking pattern that occur during VR walking by group and age and analyze the correlation between the degree of motion sickness and changes in the walking pattern.

5. The Limitation of This Study

The limitation of this study is a small number of subjects, and further studies will be needed according to various age groups and genders. In addition, it was performed under two conditions, i.e., screen and HMD, and VR studies with various parameters applied will need to be further conducted. Certain indicators, such as the SSQ survey, ECG, HR, and HRV, were used for evaluating cyber motion sickness, but they may not have reflected all of the complex characteristics of cyber motion sickness. Further insight into other potential indicators (brain waves, skin conductivity, hormone levels, etc.) will be needed. Despite these limitations, this study contributes significantly to deepening the understanding of cyber motion sickness in a VR environment and suggesting the direction of future research. Based on the results of the study, studies targeting a wider population, experimental designs involving various VR environments and interactions, the exploration of additional physiological and psychological indicators, and studies evaluating long-term effects will be needed.

Author Contributions

Conceptualization, J.-S.C. and M.-H.C.; methodology, J.-S.C. and M.-H.C.; formal analysis, K.-Y.K. and T.-H.L.; investigation, K.-Y.K. and J.-S.C.; writing—original draft preparation, M.-H.C. and J.-S.C.; writing—review and editing, M.-H.C. and J.-S.C.; visualization, K.-Y.K.; project administration, J.-S.C.; funding acquisition, J.-S.C. All authors have read and agreed to the published version of the manuscript.

Funding

This study was supported by Konkuk University in 2021.

Institutional Review Board Statement

The protocol for the research project was approved by the Institutional Review Committee of Konkuk University, where this study was performed, and conforms to the provisions of the Declaration of Helsinki (IRB number: 7001355-202307-HR-675).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

The data presented in this study are available on request from the corresponding author.

Acknowledgments

This study was supported by Konkuk University in 2021.

Conflicts of Interest

The authors declare no conflicts of interest.

References

  1. Sarkady, D.; Neuburger, L.; Egger, R. Virtual Reality as a Travel Substitution Tool during COVID-19; Springer: Cham, Switzerland, 2021; pp. 452–463. [Google Scholar]
  2. Arns, L.L.; Cerney, M.M. The relationship between age and incidence of cybersickness among immersive environment users. In Proceedings of the VR 2005—Virtual Reality, Bonn, Germany, 12–16 March 2005; pp. 267–268. [Google Scholar] [CrossRef]
  3. Kooijman, L.; Asadi, H.; Mohamed, S.; Nahavandi, S. A virtual reality study investigating the effect of cybersickness on the relationship between vection and presence across environments with varying levels of ecological relevance. In Proceedings of the 15th International Conference on Human System Interaction (HSI), Melbourne, Australia, 28–31 July 2022; pp. 1–8. [Google Scholar] [CrossRef]
  4. Kim, H.K.; Park, J.; Choi, Y.; Choe, M. Virtual reality sickness questionnaire (VRSQ): Motion sickness measurement index in a virtual reality environment. Appl. Ergon. 2018, 69, 66–73. [Google Scholar] [CrossRef] [PubMed]
  5. Golding, J.F. Motion sickness susceptibility questionnaire revised and its relationship to other forms of sickness. Brain Res. Bull. 1998, 47, 507–516. [Google Scholar] [CrossRef] [PubMed]
  6. Krokos, E.; Varshney, A. Quantifying VR cybersickness using EEG. Virtual Real. 2022, 26, 77–89. [Google Scholar] [CrossRef]
  7. Lin, Y.T.; Chien, Y.Y.; Wang, H.H.; Lin, F.C.; Huang, Y.P. 65-3: The quantization of cybersickness level using EEG and ECG for virtual reality head-mounted display. Soc. Inf. Disp. (SID) 2018, 49, 862–865. [Google Scholar] [CrossRef]
  8. Lin, C.T.; Lin, C.L.; Chiu, T.W.; Duann, J.R.; Jung, T.P. Effect of respiratory modulation on relationship between heart rate variability and motion sickness. In Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Boston, MA, USA, 30 August–3 September 2011; pp. 1921–1924. [Google Scholar] [CrossRef]
  9. Nalivaiko, E.; Rudd, J.A.; So, R.H. Motion sickness, nausea and thermoregulation: The “toxic” hypothesis. Temperature 2014, 1, 164–171. [Google Scholar] [CrossRef] [PubMed]
  10. Billman, G.E.; Huikuri, H.V.; Sacha, J.; Trimmel, K. An introduction to heart rate variability: Methodological considerations and clinical applications. Front. Physiol. 2015, 6, 55. [Google Scholar] [CrossRef] [PubMed]
  11. Renkin, E.M. Handbook of physiology: Section 2, The cardiovascular system. In Microcirculation; American Physiological Society: Bethesda, WI, USA, 1984; Volume 4. [Google Scholar]
  12. Parijat, P.; Lockhart, T.E. Can virtual reality be used as a gait training tool for older adults? In Proceedings of the Human Factors and Ergonomics Society Annual Meeting, Las Vegas, NV, USA, 19–23 September 2011; Volume 55, pp. 157–161. [Google Scholar] [CrossRef]
  13. Lheureux, A.; Lebleu, J.; Frisque, C.; Sion, C.; Stoquart, G.; Warlop, T.; Detrembleur, C.; Lejeune, T. Immersive virtual reality to restore natural long-range autocorrelations in Parkinson’s disease patients’ gait during treadmill walking. Front. Physiol. 2020, 11, 572063. [Google Scholar] [CrossRef] [PubMed]
  14. Sevinc, V.; Berkman, M.I. Psychometric evaluation of Simulator Sickness Questionnaire and its variants as a measure of cybersickness in consumer virtual environments. Appl. Ergon. 2020, 82, 102958. [Google Scholar] [CrossRef] [PubMed]
  15. Jacob Habgood, M.P.; Moore, D.; Wilson, D.; Alapont, S. Rapid, continuous movement between nodes as an accessible virtual reality locomotion technique. In Proceedings of the IEEE Conference on Virtual Reality and 3D User Interfaces (VR), Tübingen/Reutlingen, Germany, 18–22 March 2018; pp. 371–378. [Google Scholar] [CrossRef]
  16. Shaffer, F.; McCraty, R.; Zerr, C.L. A healthy heart is not a metronome: An integrative review of the heart’s anatomy and heart rate variability. Front. Psychol. 2014, 5, 1040. [Google Scholar] [CrossRef] [PubMed]
  17. Nalivaiko, E.; Davis, S.L.; Blackmore, K.L.; Vakulin, A.; Nesbitt, K.V. Cybersickness provoked by head-mounted display affects cutaneous vascular tone, heart rate and reaction time. Physiol. Behav. 2015, 151, 583–590. [Google Scholar] [CrossRef] [PubMed]
  18. Kim, Y.S.; Won, J.; Jang, S.W.; Ko, J. Effects of cybersickness caused by head-mounted display–based virtual reality on physiological responses: Cross-sectional study. JMIR Serious Games 2022, 10, e37938. [Google Scholar] [CrossRef] [PubMed]
  19. Magaki, T.; Vallance, M. Developing an accessible evaluation method of VR cybersickness. In Proceedings of the IEEE Conference on Virtual Reality and 3D User Interfaces (VR), Osaka, Japan, 23–27 March 2019; pp. 1072–1073. [Google Scholar] [CrossRef]
  20. Gavgani, M.A.; Hodgson, D.M.; Nalivaiko, E. Effects of visual flow direction on signs and symptoms of cybersickness. PLoS ONE 2017, 8, e0182790. [Google Scholar]
  21. Shaffer, F.; Meehan, Z.M. A practical guide to resonance frequency assessment for heart rate variability. Biofeedback 2020, 14, 570400. [Google Scholar] [CrossRef] [PubMed]
  22. Hsin, L.J.; Chao, Y.P.; Chuang, H.H.; Kuo, T.B.; Yang, C.C.; Huang, C.G.; Kang, C.J.; Lin, W.N.; Fang, T.J.; Li, H.Y.; et al. Mild simulator sickness can alter heart rate variability, Mental workload, and learning outcomes in a 360° virtual reality application for medical education: A post hoc analysis of a randomized controlled trial. Virtual Real. 2023, 27, 3345–3361. [Google Scholar] [CrossRef] [PubMed]
  23. Kiryu, T.; Iijima, A. A multi-timescale autonomic regulation model for interpreting visually induced motion sickness. In Proceedings of the 3rd Global Conference on Consumer Electronics (GCCE), Tokyo, Japan, 7–10 October 2014; pp. 254–257. [Google Scholar] [CrossRef]
  24. Setiowati, N.O.; Wijayanto, T.; Trapsilawati, F. Identifying cybersickness when wearing a head-mounted display through heart rate variability data. IOP Conf. Ser. Mater. Sci. Eng. 2020, 885, 012069. [Google Scholar] [CrossRef]
  25. Sloan, R.P.; Shapiro, P.A.; Bagiella, E.; Boni, S.M.; Paik, M.; Bigger, J.T., Jr.; Steinman, R.C.; Gorman, J.M. Effect of mental stress throughout the day on cardiac autonomic control. Biol. Psychol. 1994, 37, 89–99. [Google Scholar] [CrossRef] [PubMed]
  26. Van Ravenswaaij-Arts, C.M.A.; Hopman, J.C.W.; Kollée, L.A.A.; Stoelinga, G.B.A.; Van Geijn, H.P. The Influence of Artificial Ventilation on Heart Rate Variability in Very Preterm Infants. Pediatr. Res. 1995, 37, 124–130. [Google Scholar] [CrossRef] [PubMed]
Figure 1. Virtual environment presented in the study (straight walking path).
Figure 1. Virtual environment presented in the study (straight walking path).
Applsci 14 02123 g001
Figure 2. Experimental environment under the two conditions: (a) screen-assisted walking; (b) HMD-assisted walking.
Figure 2. Experimental environment under the two conditions: (a) screen-assisted walking; (b) HMD-assisted walking.
Applsci 14 02123 g002
Figure 3. Experimental design.
Figure 3. Experimental design.
Applsci 14 02123 g003
Figure 4. SSQ score difference for the two groups and two conditions. (** and *** indicates statistical difference at the p < 0.01, and p < 0.001 levels, respectively).
Figure 4. SSQ score difference for the two groups and two conditions. (** and *** indicates statistical difference at the p < 0.01, and p < 0.001 levels, respectively).
Applsci 14 02123 g004
Figure 5. (a) HR, (b) RMSSD, and (c) LF/HF ratio difference for the two groups and two conditions. (* and ** indicates statistical difference at the p < 0.05 and p < 0.01 levels, respectively).
Figure 5. (a) HR, (b) RMSSD, and (c) LF/HF ratio difference for the two groups and two conditions. (* and ** indicates statistical difference at the p < 0.05 and p < 0.01 levels, respectively).
Applsci 14 02123 g005
Figure 6. Graph of regression analysis results for SSQ scores and RMSSD values.
Figure 6. Graph of regression analysis results for SSQ scores and RMSSD values.
Applsci 14 02123 g006
Table 1. HR, RMSSD, and LF/HF ratio for motion-sickness group and no-motion-sickness group for each phase (baseline, walking), and variations between the phases during virtual environment walking under two conditions (screen and HMD).
Table 1. HR, RMSSD, and LF/HF ratio for motion-sickness group and no-motion-sickness group for each phase (baseline, walking), and variations between the phases during virtual environment walking under two conditions (screen and HMD).
ScreenBaseline PhaseWalking PhaseVariation (Walking Phase—Baseline Phase)
HRRMSSDLF/HFHRRMSSDLF/HFHRRMSSDLF/HF
no-motion-sickness#16920.42.193.517.95.224.5−2.53.1
#26812.41.177.58.63.79.5−3.82.6
#3111.68.31.1115.46.33.53.8−22.4
#466.330.55.383.131.81.716.81.3−3.7
#511332.82.1109.131.42.9−3.9−1.40.8
#6106.65.75.4107.36.46.70.70.71.3
Avg. ± S.D89.1 ± 23.518.4 ± 11.52.9 ± 2.097.7 ± 15.317.1 ± 12.04.0 ± 1.88.58 ± 10.6−1.3 ± 1.91.1 ± 2.5
motion-sickness #174.914.23.583.911.859.0−2.41.5
#270.941.81.784.426.22.113.5−15.60.4
#373.458.60.487.227.23.513.8−31.43.1
#484.935.82.198.545.62.113.69.80
#562.350.6373.953.92.311.63.3−0.7
Avg. ± S.D73.3 ± 8.140.2 ± 16.92.1 ± 1.285.6 ± 8.833.0 ± 16.83.0 ± 1.312.3 ± 2.0−7.3 ± 16.40.86 ± 1.5
HMDBaseline phaseWalking phaseVariation (Walking phase—Baseline phase)
HRRMSSDLF/HFHRRMSSDLF/HFHRRMSSDLF/HF
no-motion-sickness#175.323.32.284.615.32.89.3−80.7
#265.86.73.480.36.85.414.50.12
#3111.95.41.4119.8−11.54.57.9−173.2
#466.138.91.278.227.23.812.1−11.72.6
#5107.237.53.7115491.57.811.6−2.2
#6106.65.75.4107.566.60.90.31.2
Avg. ± S.D88.8 ± 22.019.6 ± 15.92.9 ± 1.697.6 ± 18.615.5 ± 20.84.1 ± 1.88.7 ± 4.7−4.1 ± 10.21.3 ± 1.9
motion-sickness #167.1262.182.410.16.515.3−15.94.40
#264.446.8288.324.9423.9−21.92.00
#365.148.30.683.919.62.118.8−28.71.50
#494.142.51.5108.542.52.914.4−0.11.40
#570.535.32.284.52012.414.0−15.310.20
Avg. ± S.D72.2 ± 12.439.8 ± 9.21.7 ± 0.789.5 ± 10.823.4 ± 11.95.6 ± 4.217.3 ± 4.2−16.4 ± 10.63.9 ± 3.7
Table 2. Regression analysis results for SSQ scores and difference of HR, RMSSD, and LF/HF ratio (stepwise): entered variables and excluded variables.
Table 2. Regression analysis results for SSQ scores and difference of HR, RMSSD, and LF/HF ratio (stepwise): entered variables and excluded variables.
Entered VariablesBtSig.
RMSSD−1.045−5.6760.000
Excluded VariablesBtSig.
HR0.2231.5150.146
LF/HF−0.93−0.6050.552
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Choi, M.-H.; Kang, K.-Y.; Lee, T.-H.; Choi, J.-S. Correlations between SSQ Scores and ECG Data during Virtual Reality Walking by Display Type. Appl. Sci. 2024, 14, 2123. https://doi.org/10.3390/app14052123

AMA Style

Choi M-H, Kang K-Y, Lee T-H, Choi J-S. Correlations between SSQ Scores and ECG Data during Virtual Reality Walking by Display Type. Applied Sciences. 2024; 14(5):2123. https://doi.org/10.3390/app14052123

Chicago/Turabian Style

Choi, Mi-Hyun, Kyu-Young Kang, Tae-Hoon Lee, and Jin-Seung Choi. 2024. "Correlations between SSQ Scores and ECG Data during Virtual Reality Walking by Display Type" Applied Sciences 14, no. 5: 2123. https://doi.org/10.3390/app14052123

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop