Abstract

Virtual try-on technology (VTO) in virtual reality (VR) and augmented reality (AR) has been developed for years to create novel shopping experiences for users by allowing them to virtually wear fashion products. Compared to garments or facial accessories, fewer studies have focused on virtual footwear try-on, regardless of user study or technical development. Thus, it is necessary to examine the effectiveness of existing VTO applications on the user's affective responses. In this study, we compared the user experience of three different footwear try-on methods (real, VR, and AR) with both physiological and psychological measures. Subjects conducted a try-on experiment on different pairs of sneakers. Each subject’s gaze trajectory was recorded using an eye tracker and analyzed to show his/her visual attention in each method. Afterward, the subjects completed questionnaires to assess the sense of presence, usability, and the user experience score for the try-on processes, and subsequently attended a think-aloud procedure to express their thoughts. The analysis results of the collected data showed that the user experience produced by the VR and AR try-on is not comparable to that of the real environment. The results also revealed factors that negatively affect the quality of the user's interaction with the processes. These findings may provide insights into further improvements in VTO technology.

References

1.
Kim
,
J.
, and
Forsythe
,
S.
,
2008
, “
Adoption of Virtual Try-On Technology for Online Apparel Shopping
,”
J. Interact. Mark.
,
22
(
2
), pp.
45
59
.
2.
Plotkina
,
D.
, and
Saurel
,
H.
,
2019
, “
Me or Just Like me? The Role of Virtual Try-On and Physical Appearance in Apparel M-Retailing
,”
J. Retail. Consum. Serv.
,
51
, pp.
362
377
.
3.
Lee
,
H.
, and
Xu
,
Y.
,
2020
, “
Classification of Virtual Fitting Room Technologies in the Fashion Industry: From the Perspective of Consumer Experience
,”
Int. J. Fash. Des. Technol. Educ.
,
13
(
1
), pp.
1
10
.
4.
Baytar
,
F.
,
Chung
,
T. L. D.
, and
Shin
,
E.
,
2016
, “
Can Augmented Reality Help E-Shoppers Make Informed Purchases on Apparel Fit, Size, and Product Performance?
International Textile and Apparel Association Annual Conference
,
Vancouver, Canada
.
5.
Luh
,
Y. P.
,
Wang
,
J. B.
,
Chang
,
J. W.
,
Chang
,
S. Y.
, and
Chu
,
C. H.
,
2013
, “
Augmented Reality-Based Design Customization of Footwear for Children
,”
J. Intell. Manuf.
,
24
(
5
), pp.
905
917
.
6.
Yuan
,
M.
,
Khan
,
I. R.
,
Farbiz
,
F.
,
Yao
,
S.
,
Niswar
,
A.
, and
Foo
,
M. H.
,
2013
, “
A Mixed Reality Virtual Clothes Try-On System
,”
IEEE Trans. Multimed.
,
15
(
8
), pp.
1958
1968
.
7.
Scholz
,
J.
, and
Duffy
,
K.
,
2018
, “
We ARe at Home: How Augmented Reality Reshapes Mobile Marketing and Consumer-Brand Relationships
,”
J. Retail. Consum. Serv.
,
44
, pp.
11
23
.
8.
Shin
,
E.
, and
Baytar
,
F.
,
2014
, “
Apparel Fit and Size Concerns and Intentions to use Virtual try-on: Impacts of Body Satisfaction and Images of Models’ Bodies
,”
Cloth. Text. Res. J.
,
32
(
1
), pp.
20
33
.
9.
Keh
,
H. T.
,
Park
,
I. H.
,
Kelly
,
S.
, and
Du
,
X.
,
2016
, “
The Effects of Model Size and Race on Chinese Consumers’ Reactions: A Social Comparison Perspective
,”
Psychol. Mark.
,
33
(
3
), pp.
177
194
.
10.
Tang
,
A.
,
Biocca
,
F.
, and
Lim
,
L.
,
2004
, “
Comparing Differences in Presence During Social Interaction in Augmented Reality Versus Virtual Reality Environments: An Exploratory Study
,”
Proceedings of PRESENCE
,
Valencia, Spain
, pp.
204
208
.
11.
Werdayani
,
D.
, and
Widiaty
,
I.
,
2021
, “
Virtual Fitting Room Technology in Fashion Design
,”
IOP Conf. Ser.: Mater. Sci. Eng.
,
1098
(
2
), p.
022110
.
12.
Eisert
,
P.
,
Fechteler
,
P.
, and
Rurainsky
,
J.
,
2008
, “
3-D Tracking of Shoes for Virtual Mirror Applications
,”
IEEE Conference on Computer Vision and Pattern Recognition
,
Anchorage, AK
, IEEE, pp.
1
6
.
13.
Greci
,
L.
,
Sacco
,
M.
,
Cau
,
N.
, and
Buonanno
,
F.
,
2012
, “FootGlove: a Haptic Device Supporting the Customer in the Choice of the Best Fitting Shoes,”
Haptics: Perception, Devices, Mobility, and Communication
,
Springer
,
Berlin, Heidelberg
, pp.
148
159
.
14.
Mottura
,
S.
,
Greci
,
L.
,
Sacco
,
M.
, and
Boër
,
C. R.
,
2003
, “
An Augmented Reality System for the Customized Shoe Shop
,”
Second Interdisciplinary World Congress on Mass Customization and Personalization
,
Munich, Germany
.
15.
Jimeno-Morenilla
,
A.
,
Sánchez-Romero
,
J. L.
, and
Salas-Pérez
,
F.
,
2013
, “
Augmented and Virtual Reality Techniques for Footwear
,”
Comput. Ind.
,
64
(
9
), pp.
1371
1382
.
16.
An
,
S.
,
Che
,
G.
,
Guo
,
J.
,
Zhu
,
H.
,
Ye
,
J.
,
Zhou
,
F.
, and
Zhang
,
W.
,
2021
, “
ARShoe: Real-Time Augmented Reality Shoe try-on System on Smartphones
,”
Proceedings of the 29th ACM International Conference on Multimedia
,
Virtual Event
.
17.
Higuera-Trujillo
,
J. L.
,
Maldonado
,
J. L. T.
, and
Millán
,
C. L.
,
2017
, “
Psychological and Physiological Human Responses to Simulated and Real Environments: A Comparison Between Photographs, 360° Panoramas, and Virtual Reality
,”
Appl. Ergon.
,
65
, pp.
398
409
.
18.
Dey
,
A.
,
Billinghurst
,
M.
,
Lindeman
,
R. W.
, and
Swan
,
J.
,
2018
, “
A Systematic Review of 10 Years of Augmented Reality Usability Studies: 2005 to 2014
,”
Front. Robot. AI
,
5
, p.
37
.
19.
Brade
,
J.
,
Lorenz
,
M.
,
Busch
,
M.
,
Hammer
,
N.
,
Tscheligi
,
M.
, and
Klimant
,
P.
,
2017
, “
Being There Again–Presence in Real and Virtual Environments and its Relation to Usability and User Experience Using a Mobile Navigation Task
,”
Int. J. Hum-Comput. Stud.
,
101
, pp.
76
87
.
20.
Lessiter
,
J.
,
Freeman
,
J.
,
Keogh
,
E.
, and
Davidoff
,
J.
,
2001
, “
A Cross-Media Presence Questionnaire: The ITC-Sense of Presence Inventory
,”
Presence: Teleoperators Virtual Environ.
,
10
(
3
), pp.
282
297
.
21.
Bangor
,
A.
,
Kortum
,
P.
, and
Miller
,
J.
,
2009
, “
Determining What Individual SUS Scores Mean: Adding an Adjective Rating Scale
,”
J. Usability Stud.
,
4
(
3
), pp.
114
123
.
22.
Youngblut
,
C.
, and
Huie
,
O.
,
2003
, “
The Relationship Between Presence and Performance in Virtual Environments: Results of a VERTS Study
,”
Proceedings of IEEE Virtual Reality
,
Los Angeles, CA
, pp.
277
278
.
23.
Juan
,
M. C.
, and
Pérez
,
D.
,
2009
, “
Comparison of the Levels of Presence and Anxiety in an Acrophobic Environment Viewed via HMD or CAVE
,”
Presence: Teleoperators Virtual Environ.
,
18
(
3
), pp.
232
248
.
24.
Olsson
,
T.
,
Kärkkäinen
,
T.
,
Lagerstam
,
E.
, and
Ventä-Olkkonen
,
L.
,
2012
, “
User Evaluation of Mobile Augmented Reality Scenarios
,”
J. Ambient Intell. Smart Environ.
,
4
(
1
), pp.
29
47
.
25.
Irshad
,
S.
, and
Rambli
,
D. R. A.
,
2017
, “
Advances in Mobile Augmented Reality From User Experience Perspective: A Review of Studies
,”
International Visual Informatics Conference
,
Bangi, Malaysia
, pp.
466
477
.
26.
Dirin
,
A.
, and
Laine
,
T. H.
,
2018
, “
User Experience in Mobile Augmented Reality: Emotions, Challenges, Opportunities and Best Practices
,”
Comput.
,
7
(
2
), p.
33
.
27.
Stumpp
,
S.
,
Knopf
,
T.
, and
Michelis
,
D.
,
2019
, “
User Experience Design With Augmented Reality
,”
European Conference on Innovation and Entrepreneurship
,
Kalamata, Greece
, pp.
1032
1040
.
28.
Scheibmeir
,
J.
, and
Malaiya
,
Y. K.
,
2019
, “
Quality Model for Testing Augmented Reality Applications
,”
IEEE 10th Annual Ubiquitous Computing, Electronics & Mobile Communication Conference
,
New York
, pp.
219
226
.
29.
Arifin
,
Y.
,
Sastria
,
T. G.
, and
Barlian
,
E.
,
2018
, “
User Experience Metric for Augmented Reality Application: A Review
,”
Procedia Comput. Sci.
,
135
, pp.
648
656
.
30.
Ritsos
,
P. D.
,
Ritsos
,
D. P.
, and
Gougoulis
,
A. S.
,
2011
, “
Standards for Augmented Reality: A User Experience Perspective
,”
International AR Standards Meeting
,
Barcelona, Spain
, pp.
1
9
.
31.
Rahman
,
O.
,
2018
, “
Online Consumer Choice: Footwear Design and Visual Presentation
,”
J. Text. Appar. Technol. Manage.
,
10
(
4
).
32.
Slater
,
M.
, and
Steed
,
A.
,
2000
, “
A Virtual Presence Counter
,”
Presence: Teleoperators Virtual Environ.
,
9
(
5
), pp.
413
434
.
33.
Waltemate
,
T.
,
Gall
,
D.
,
Roth
,
D.
,
Botsch
,
M.
, and
Latoschik
,
M. E.
,
2018
, “
The Impact of Avatar Personalization and Immersion on Virtual Body Ownership, Presence, and Emotional Response
,”
IEEE Trans. Vis. Comput. Graph.
,
24
(
4
), pp.
1643
1652
.
34.
Yang
,
Y. I.
,
Yang
,
C. K.
, and
Chu
,
C. H.
,
2014
, “
A Virtual Try-On System in Augmented Reality Using RGB-D Cameras for Footwear Personalization
,”
J. Manuf. Syst.
,
33
(
4
), pp.
690
698
.
35.
Liu
,
Y. W.
,
Chu
,
C. H.
,
Chen
,
Y. A.
, and
Pan
,
J.
,
2018
, “
Avatar-Based Virtual Try-On of Footwear for New Retail
,”
International Conference on Electronic Commerce
,
Tianjin, China
.
36.
Rayner
,
K.
,
1998
, “
Eye Movements in Reading and Information Processing: 20 Years of Research
,”
Psychol. Bull.
,
124
(
3
), pp.
372
422
.
37.
Lombard
,
M.
, and
Ditton
,
T.
,
1997
, “
At the Heart of it all: The Concept of Presence
,”
J. Comput. Mediat. Commun.
,
3
(
2
), pp.
321
324
.
38.
Chyung
,
S. Y.
,
Roberts
,
K.
,
Swanson
,
I.
, and
Hankinson
,
A.
,
2017
, “
Evidence-Based Survey Design: The use of a Midpoint on the Likert Scale
,”
Perform. Improv.
,
56
(
10
), pp.
15
23
.
39.
Busch
,
M.
,
Lorenz
,
M.
,
Tscheligi
,
M.
,
Hochleitner
,
C.
, and
Schulz
,
T.
,
2014
, “
Being There for Real: Presence in Real and Virtual Environments and its Relation to Usability
,”
Proceedings of the 8th Nordic Conference on Human-Computer Interaction
,
Helsinki, Finland
, pp.
117
126
.
40.
Bizen
,
H.
,
Yoshida
,
M.
,
Jimbu
,
M.
, and
Kawai
,
Y.
,
2021
, “
Virtual Shoe Fitting System That Uses Augmented Reality to Measure Feet and Try on Shoes
,”
IEEE 3rd Global Conference on Life Sciences and Technologies (LifeTech)
,
Osaka, Japan
, pp.
217
219
.
41.
Chu
,
C. H.
,
Cheng
,
C. H.
,
Wu
,
H. S.
, and
Kuo
,
C. C.
,
2019
, “
A Cloud Service Framework for Virtual Try-On of Footwear in Augmented Reality
,”
ASME J. Comput. Inf. Sci. Eng.
,
19
(
2
), p.
021002
.
You do not currently have access to this content.