Abstract

Prototyping is a crucial part of new product development, and engineers and designers rely on prototyping to bring novel technologies to market. In recent years, tech-based startups like Tesla or Udacity have revolutionized their respective industries. However, many tech-based startups are unable to create a viable product with their available resources and fail before ever making it to market. In this work, we analyze survey responses from 34 startup representatives to investigate the relationship between prototyping practice, startup success, and perceived difficulty of startup tasks. K-means cluster analysis shows three distinct groups, differentiated by (1) their amount of available funding, (2) their use of prototyping best practices, and (3) their reported difficulty in startup tasks. High-performing startups reported having the highest funding, experiencing less difficulty in startup tasks, and using prototyping best practices more frequently than their peers.

References

1.
Sharif
,
A. M.
, and
Basri
,
S.
,
2011
, “
A Study on Risk Assessment for Small and Medium Software Development Projects
,”
Int. J. New Comput. Archit. Their. Appl.
,
1
(
2
), p.
325
.
2.
Rauch
,
E.
,
Dallasega
,
P.
, and
Matt
,
D. T.
,
2017
, “
Critical Factors for Introducing Lean Product Development to Small and Medium Sized Enterprises in Italy
,”
Procedia CIRP
,
60
, pp.
362
367
. 10.1016/j.procir.2017.01.031
3.
Rancic Moogk
,
D.
,
2012
, “
Minimum Viable Product and the Importance of Experimentation in Technology Startups
,”
Technol. Innov. Manag. Rev.
,
2
(
3
), pp.
23
26
. 10.22215/timreview/535
4.
Bjork
,
J.
,
Ljungblad
,
J.
, and
Bosch
,
J.
,
2013
,
From Start-Ups to SaaS Conglomerate: Life Cycles of Software Products Workshop (IW-LCSP 2013)
,
S.
Hyrynsalmi
,
K.
Wnuk
,
M.
Daneva
,
T.
Makila
, and
A.
Herrmann
, eds.,
CEUR-WS.org
,
Potsdam, Germany
, pp.
19
31
.
5.
Ghezzi
,
A.
,
Cavallaro
,
A.
,
Rangone
,
A.
, and
Balocco
,
R.
,
2015
, “
A Comparative Study on the Impact of Business Model Design & Lean Startup Approach Versus Traditional Business Plan on Mobile Startups Performance
,”
Proceedings of the 17th International Conference on Enterprise Information Systems
,
S.
Hammoudi
,
L.
Maciaszek
, and
E.
Teniente
, eds., SciTePress—Science and Technology Publications, Lda,
Barcelona, Spain
, pp.
196
203
.
6.
Liker
,
J. K.
, and
Morgan
,
J. M.
,
2006
, “
The Toyota Way of Services: The Case of Lean Product Development
,”
Acad. Manag. Perspect.
,
20
(
2
), pp.
5
20
. 10.5465/amp.2006.20591002
7.
Liker
,
J. K.
, and
Morgan
,
J.
,
2011
, “
Lean Product Development as a System: A Case Study of Body and Stamping Development at Ford
,”
EMJ—Eng. Manag. J.
,
23
(
1
), pp.
16
28
. 10.1080/10429247.2011.11431884
8.
Schrage
,
M.
,
1996
, “
The Culture(s) of Prototyping
,”
Des. Manag. J.
,
4
(
1
), pp.
55
65
.
9.
Jonson
,
B.
,
2005
, “
Design Ideation: The Conceptual Sketch in the Digital Age
,”
Des. Stud.
,
26
(
6
), pp.
613
624
. 10.1016/j.destud.2005.03.001
10.
Bradner
,
E.
,
Iorio
,
F.
, and
Davis
,
M.
,
2014
, “
Parameters Tell the Design Story: Ideation and Abstraction in Design Optimization
,”
Proceedings of the Symposium on Simulation for Architecture & Urban Design
,
Tampa, FL
,
Apr. 13–16
, pp.
172
197
.
11.
Gill
,
C.
,
Sanders
,
E.
, and
Shim
,
S.
,
2011
, “
Prototypes as Inquiry, Visualization and Communication
,”
DS 69 Proc. E PDE 2011, 13th International Conference on Engineering and Product Design Education
, (
September
), pp.
672
677
.
12.
Jensen
,
M. B.
,
Elverum
,
C. W.
, and
Steinert
,
M.
,
2017
, “
Eliciting Unknown Unknowns With Prototypes: Introducing Prototrials and Prototrial-Driven Cultures
,”
Design Studies
,
49
, pp.
1
31
. 10.1016/j.destud.2016.12.002
13.
May
,
B.
,
2012
, “
Applying Lean Startup: An Experience Report—Lean & Lean UX by a UX Veteran: Lessons Learned in Creating & Launching a Complex Consumer App
,”
Proceedings of Agile 2012
,
Dallas, TX
, pp.
141
147
.
14.
Dennehy
,
D.
,
Kasraian
,
L.
,
Raghallaigh
,
P. O.
, and
Conboy
,
K.
,
2016
, “
Product Market Fit Frameworks for Lean Product Development
,”
R&D Management Conference From Science to Society: Innovation and Value Creation
,
Cambridge, UK
, pp.
1
11
.
15.
Anderson
,
K. M.
,
Grasman
,
S. E.
,
Ayoub
,
K.
,
Introne
,
S.
, and
Smithwick
,
K.
,
2011
, “
Using Lean Product Development to Speed Time to Market for Medical Devices
,”
Proceeding of 61st Annual IIE Conference and Expo
,
Reno, NV
.
16.
Jimmerson
,
C.
, and
Weber
,
D.
,
2005
, “
Reducing Waste and Errors: Piloting Lean Principles at IHC
,”
Jt. Comm. J. Qual. Patient Saf.
,
31
(
5
), pp.
249
257
. 10.1016/S1553-7250(05)31032-4
17.
Benefield
,
G.
, and
Greening
,
D.
,
2013
, “
Agile/Lean Startup Organizations
,”
Proceedings of the Annual Hawaii International Conference on System Sciences
,
Hawaii
,
Jan. 7–10
, p.
4834
.
18.
Blank
,
S.
,
2013
, “
Why the Lean Start-up Changes Everything
,”
Harv. Bus. Rev.
,
91
(
5
).
19.
Unterkalmsteiner
,
M.
,
Giardino
,
C.
, and
Abrahamsson
,
P.
,
2016
, “
Software Development in Startup Companies: The Greenfield Startup Model
,”
IEEE Trans. Softw. Eng.
,
42
(
6
), pp.
585
604
. 10.1109/TSE.2015.2509970
20.
Bosch
,
J.
,
Olsson
,
H. H.
, and
Ljungblad
,
J.
,
2013
,
International Conference on Lean Enterprise Software and Systems
,
K.
Fitzgerald
,
K.
Conboy
,
K.
Power
,
R.
Valerdi
,
L.
Morgan
, and
K.
Stol
, eds.,
Springer
,
Berlin, Germany
, pp.
1
15
.
21.
Gautam
,
N.
, and
Singh
,
N.
,
2008
, “
Lean Product Development: Maximizing the Customer Perceived Value Through Design Change (Redesign)
,”
Int. J. Prod. Econ.
,
114
(
1
), pp.
313
332
. 10.1016/j.ijpe.2006.12.070
22.
Silva
,
S. E. P.
,
Calado
,
R. D.
,
Silva
,
M. B.
, and
Nascimento
,
M. A.
,
2013
, “
Lean Startup Applied in Healthcare: A Viable Methodology for Continuous Improvement in the Development of New Products and Services
,”
IFAC Proc.
,
6
(
PART 1
), pp.
295
299
. 10.3182/20130911-3-BR-3021.00054
23.
Pease
,
J. F.
, and
Dean
,
J. H.
,
2014
, “
Toward a Market-Based Lean Startup Product Design Method for the Developing World
,”
Proceedings of the 40th Design Automation Conference IDETC/CIE 2014
,
Buffalo, NY
,
ASME
, pp.
1
12
.
24.
Mund
,
K.
,
Pieterse
,
K.
, and
Cameron
,
S.
,
2015
, “
Lean Product Engineering in the South African Automotive Industry
,”
J. Manuf. Technol. Manag.
,
26
(
5
), pp.
703
724
. 10.1108/JMTM-05-2013-0062
25.
Davila
,
A.
,
Foster
,
G.
, and
Davila
,
A.
,
2019
, “
Management Control Systems in Early-Stage Startup Companies
,”
Am. Account. Assoc.
,
82
(
4
), pp.
907
937
.
26.
Baum
,
J. A. C.
,
Calabrese
,
T.
, and
Silverman
,
B. S.
,
2019
, “
Don’t Go It Alone: Alliance Network Composition and Startups’ Performance in Canadian Biotechnology
,”
Strateg. Manag. J.
,
21
(
3
), pp.
267
294
. 10.1002/(SICI)1097-0266(200003)21:3<267::AID-SMJ89>3.0.CO;2-8
27.
Seggie
,
S. H.
,
Soyer
,
E.
, and
Pauwels
,
K. H.
,
2017
, “
Combining Big Data and Lean Startup Methods for Business Model Evolution
,”
AMS Rev.
,
7
(
3–4
), pp.
154
169
. 10.1007/s13162-017-0104-9
28.
Melegati
,
J.
,
Goldman
,
A.
, and
Paulo
,
S.
,
2016
, “
Requirements Engineering in Software Startups : A Grounded Theory Approach
,”
Proceedings 22nd ICE/IEEE International Technology Management Conference
,
Trondheim, Norway
,
June
, pp.
57
65
.
29.
Dellermann
,
D.
,
Ebel
,
P.
,
Lipusch
,
N.
,
Popp
,
K. M.
, and
Leimeister
,
J. M.
,
2018
, “
Finding the Unicorn: Predicting Early Stage Startup Success Through a Hybrid Intelligence Method
,”
Thirty Eighth International Conference on Information Systems
,
South Korea
.
30.
Menold
,
J.
,
Simpson
,
T. W.
, and
Jablokow
,
K. W.
,
2018
, “
The Prototype for X Framework: Exploring the Effects of a Structured Prototyping Framework on Functional Prototypes
,”
Res. Eng. Des.
,
30
(
2
), pp.
1
15
. 10.1007/s00163-018-0289-4
31.
Menold
,
J.
,
Jablokow
,
K. W.
, and
Simpson
,
T. W.
,
2017
, “
Prototype for X (PFX): A Holistic Framework for Structuring Prototyping Methods to Support Engineering Design
,”
Des. Stud.
,
50
(
1
), pp.
70
112
. 10.1016/j.destud.2017.03.001
32.
Lauff
,
C.
,
Kotys-Schwartz
,
D.
, and
Rentschler
,
M. E.
,
2017
, “
What Is a Prototype?: Emergent Roles of Prototypes From Empirical Work in Three Diverse Companies
,”
29th International Conference on Design Theory and Methodology
,
Cleveland, OH
,
August
, Vol. 7, p. V007T06A033.
33.
Wu
,
J.
, and
Atkinson
,
R. D.
,
2017
,
How Technology-Based Start-Ups Support U.S. Economic Growth, Information Technology & Innovation Foundation (ITIF)
,
November
, pp.
1
150
.
34.
2016
,
eurostat, “Business Economy — Size Class Analysis,” eurostat.
35.
Hendricks
,
D.
,
2014
, “
6 $25 Billion Companies That Started in a Garage Inc.Com
.,” https://www.inc.com/drew-hendricks/6-25-billion-companies-that-started-in-a-garage.html Accessed August 21, 2019.
36.
Cantamessa
,
M.
,
Gatteschi
,
V.
,
Perboli
,
G.
, and
Rosano
,
M.
,
2018
, “
Startups’ Roads to Failure
,”
Sustain
,
10
(
7
), pp.
1
19
. 10.3390/su10072346
37.
Williams
,
D. A.
,
2014
, “
Resources and Failure of SMEs: Another Look
,”
J. Dev. Entrep.
,
19
(
01
), p.
1450007
. 10.1142/s1084946714500071
38.
Charan
,
R.
, and
Useem
,
J.
,
2002
,
Why Companies Fail: CEOs Offer Every Excuse but the Right One: Their Own Errors. Here Are Ten Mistakes to Avoid,” Fortune – Europe Ed
., pp.
36
46
.
39.
Yazdipour
,
R.
, and
Constand
,
R.
,
2010
, “
Predicting Firm Failure : A Behavioral Finance Perspective
,”
J. Entrep. Financ
,
14
(
3
), pp.
90
104
.
40.
Scott-Young
,
C.
, and
Samson
,
D.
,
2008
, “
Project Success and Project Team Management: Evidence From Capital Projects in the Process Industries
,”
J. Oper. Manag.
,
26
(
6
), pp.
749
766
. 10.1016/j.jom.2007.10.006
41.
Riquelme
,
H.
, and
Watson
,
J.
,
2002
, “
Do Venture Capitalists’ Implicit Theories on New Business Success/Failure Have Empirical Validity?
,”
Int. Small Bus. J.
,
20
(
4
), pp.
395
420
. 10.1177/0266242602204002
42.
York
,
J. L.
, and
Danes
,
J. E.
,
2014
, “
Customer Development, Innovation, and Decision-Making Biases Int He Lean Startup
,”
J. Small Bus. Strateg.
,
24
(
2
), pp.
21
40
.
43.
Brown
,
T.
,
2008
, “
Design Thinking
,”
Harv. Bus. Rev.
,
86
(
6
).
44.
Ries
,
E.
,
2011
,
The Lean Startup: How Today’s Entrepreneurs Use Continuous Innovation to Create Radically Successful Businesses
,
Crown Publishing Group
,
United States
.
45.
Thomke
,
S.
, and
Bell
,
D. E.
,
2001
, “
Sequential Testing in Product Development
,”
Manage. Sci.
,
47
(
2
), pp.
308
323
. 10.1287/mnsc.47.2.308.9838
46.
Thomke
,
S.
,
1998
, “
Managing Experimentation in the Design of New Products
,”
Manage. Sci.
,
44
(
6
), pp.
743
762
. 10.1287/mnsc.44.6.743
47.
Oppenheim
,
B. W.
,
2004
, “
Lean Product Development Flow
,”
Syst. Eng.
,
7
(
4
), pp.
352
376
. 10.1002/sys.20014
48.
Kriesi
,
C.
,
Blindheim
,
J.
,
Bjelland
,
Ø
, and
Steinert
,
M.
,
2016
, “
Creating Dynamic Requirements Through Iteratively Prototyping Critical Functionalities
,”
The 26th CIRP Design Conference
,
Stockholm, Sweden
.
49.
Dow
,
S. P.
,
Glassco
,
A.
, and
Kass
,
J.
,
2009
, “
The Effect of Parallel Prototyping on Design Performance, Learning, and Self-Efficacy
,”
Stanford Tech Rep.
,
10
, pp.
331
346
.
50.
Camburn
,
B. A.
,
Sng
,
K. H.
,
Perez
,
K. B.
,
Otto
,
K.
,
Wood
,
K. L.
,
Jensen
,
D.
, and
Crawford
,
R.
,
2015
, “
The Way Makers Prototype: Principles of DIY Design
,”
27th International Conference on Design Theory and Methodology
,
Boston, MA
,
August
, Vol.
7
, p.
V007T06A004
.
51.
Yang
,
M. C.
,
2005
, “
A Study of Prototypes, Design Activity, and Design Outcome
,”
Des. Stud.
,
26
(
6
), pp.
649
669
. 10.1016/j.destud.2005.04.005
52.
Greenberg
,
M. D.
,
Hariharan
,
K.
,
Gerber
,
E.
, and
Pardo
,
B.
,
2013
, “
Crowdfunding Support Tools: Predicting Success & Failure
,”
Proceedings of Conference on Human Factors in Computing Systems (CHI2013), Changing Perspectives
,
Paris, France
,
Apr. 27–May 2
, pp.
1815
1820
.
53.
Bucciarelli
,
L. L.
,
2002
, “
Between Thought and Object in Engineering Design
,”
Des. Stud.
,
23
(
3
), pp.
219
231
. 10.1016/S0142-694X(01)00035-7
54.
Brereton
,
M.
, and
Mcgarry
,
B.
,
2000
, “
An Observational Study of How Objects Support Engineering Design Thinking and Communication : Implications for the Design of Tangible Media.
,”
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI)
,
Hague
, pp.
1
6
.
55.
Viswanathan
,
V. K.
, and
Linsey
,
J. S.
,
2012
, “
Physical Models and Design Thinking: A Study of Functionality, Novelty and Variety of Ideas
,”
ASME J. Mech. Des.
,
134
(
9
), p.
091004
. 10.1115/1.4007148
56.
Viswanathan
,
V.
, and
Linsey
,
J.
,
2011
, “
Understanding Physical Models in Design Cognition: A Triangulation of Qualitative and Laboratory Studies
,”
Proceedings of Frontiers in Education Conference, FIE
,
Rapid City, SD
,
Oct. 12–15
.
57.
Lemons
,
G.
,
Carberry
,
A.
,
Swan
,
C.
,
Jarvin
,
L.
, and
Rogers
,
C.
,
2010
, “
The Benefits of Model Building in Teaching Engineering Design
,”
Des. Stud.
,
31
(
3
), pp.
288
309
. 10.1016/j.destud.2010.02.001
58.
Leifer
,
L. J.
, and
Steinert
,
M.
,
2013
, “
Dancing With Ambiguity: Causality Behavior, Design Thinking, and Triple-Loop-Learning
,”
Inf. Knowl. Syst. Manage
,
10
, pp.
151
173
. 10.3233/IKS-2012-0191
59.
Manez
,
J. A.
,
Rochina-Barrachina
,
M. E.
,
Sanchis
,
A.
, and
Sanchis
,
J. A.
,
2015
, “
The Role of Sunk Costs in the Decision to Invest in R & D
,”
J. Ind. Econ.
,
57
(
4
), pp.
712
735
. 10.1111/j.1467-6451.2009.00398.x
60.
Schwienbacher
,
A.
,
2017
, “
Entrepreneurial Risk-Taking in Crowdfunding Campaigns
,”
Small Bus. Econ.
,
51
(
January
), pp.
843
859
. 10.1007/s11187-017-9965-4
61.
Kan
,
K.
, and
Tsai
,
W. D.
,
2006
, “
Entrepreneurship and Risk Aversion
,”
Small Bus. Econ.
,
26
(
5
), pp.
465
474
. 10.1007/s11187-005-5603-7
62.
Xu
,
H.
, and
Ruef
,
M.
,
2004
, “
The Myth of the Risk-Tolerant Entrepreneur
,”
Strateg. Organ.
,
2
(
4
), pp.
331
355
. 10.1177/1476127004047617
63.
Kennedy
,
B. M.
,
Sobek
,
D. K.
, and
Kennedy
,
M. N.
,
2014
, “
Reducing Rework by Applying Set-Based Practices Early in the Systems Engineering Process
,”
Syst. Eng.
,
17
(
3
), pp.
278
296
. 10.1002/sys.21269
64.
Audretsch
,
D. B.
,
Bönte
,
W.
, and
Mahagaonkar
,
P.
,
2012
, “
Financial Signaling by Innovative Nascent Ventures: The Relevance of Patents and Prototypes
,”
Res. Policy
,
41
(
8
), pp.
1407
1421
. 10.1016/j.respol.2012.02.003
65.
Mehlenbacher
,
A. R.
,
2017
, “
Crowdfunding Science: Exigencies and Strategies in an Emerging Genre of Science Communication
,”
Tech. Commun. Q
,
26
(
2
), pp.
127
144
. 10.1080/10572252.2017.1287361
66.
Ruhnka
,
J. C.
, and
Young
,
J. E.
,
1991
, “
Some Hypotheses About Risk in Venture Capital Investing
,”
J. Bus. Ventur.
,
6
(
2
), pp.
115
133
. 10.1016/0883-9026(91)90014-5
67.
Hui
,
J.
,
Gerber
,
E.
, and
Greenberg
,
M.
,
2012
, “Easy Money? The Demands of Crowdfunding Work,”
Technical Report No. 4
,
Northwestern University, Segal Design Institute
,
Evanston, IL
, pp.
1
11
.
68.
Haswell
,
S.
, and
Holmes
,
S.
,
1989
, “
Estimating the Small Business Failure Rate: A Reappraisal
,”
J. Small Bus. Manag.
,
27
(
3
), p.
68
.
69.
Townsend
,
D. M.
, and
Busenitz
,
L. W.
,
2015
, “
Turning Water Into Wine? Exploring the Role of Dynamic Capabilities in Early-Stage Capitalization Processes
,”
J. Bus. Ventur.
,
30
(
2
), pp.
292
306
. 10.1016/j.jbusvent.2014.07.008
70.
Patel
,
N.
,
2015
, “
90% of Startups Fail: Here’s What You Need To Know About the 10%
,” Forbes.
71.
Deininger
,
M.
,
Daly
,
S. R.
,
Sienko
,
K. H.
, and
Lee
,
J. C.
,
2017
, “
Novice Designers’ Use of Prototypes in Engineering Design
,”
Des. Stud.
,
51
, pp.
25
65
. 10.1016/j.destud.2017.04.002
72.
Jensen
,
M.
,
Balters
,
S.
, and
Steinert
,
M.
,
2015
, “
Measuring Prototypes—a Standardized Quantitative Description of Prototypes and Their Outcome for Data Collection and Analysis
,”
Proceedings of the 20th International Conference on Engineering Design (ICED15)
,
Milan, Italy
, pp.
1
14
.
73.
Blomkvist
,
J.
, and
Holmlid
,
S.
,
2011
, “
Existing Prototyping Perspectives: Considerations for Service Design
,”
4th Nordic Design Research Conference
,
Helsinki, Finland
,
May
, pp.
1
10
.
74.
Reynolds
,
P. D.
, and
Curtin
,
R. T.
,
2008
, “
Business Creation in the United States: Panel Study of Entrepreneurial Dynamics II Initial Assessment
,”
Foundations and Trends® in Entrepreneurship
,
4
(
3
), pp
155
307
.
75.
Reynolds
,
P. D.
,
2006
, “
New Firm Creation in the United States: A PSED I Overview
,”
Foundation and Trends® in Entrepreneurship
.
76.
Miller
,
P.
, and
Bound
,
K.
,
2011
,
The Startup Factories The Rise of Accelerator Programmes to Support New Technology Ventures
,
NESTA
,
London, UK
.
77.
Regmi
,
K.
,
Ahmed
,
S. A.
, and
Quinn
,
M.
,
2015
, “
Data Driven Analysis of Startup Accelerators
,”
Univers. J. Ind. Bus. Manag.
,
3
(
2
), pp.
54
57
.
78.
Hess
,
T.
, and
Summers
,
J. D.
,
2013
, “
Case Study: Evidence of Prototyping Roles in Conceptual Design
,”
International Conference on Engineering Design, ICED13
,
Glasgow, UK
.
79.
Camburn
,
B. A.
,
Dunlap
,
B. U.
,
Kuhr
,
R.
,
Viswanathan
,
V. K.
,
Linsey
,
J. S.
,
Jensen
,
D. D.
,
Crawford
,
R. H.
,
Otto
,
K.
, and
Wood
,
K. L.
,
2013
, “
Methods for Prototyping Strategies in Conceptual Phases of Design: Framework and Experimental Assessment
,”
International Design Engineering Technical Conferences and Computers and Information in Engineering Conference, ASME
,
Portland, OR
,
Aug. 5
, pp.
V005T06A033
V005T06A033
.
80.
Camburn
,
B.
,
Viswanathan
,
V.
,
Linsey
,
J.
,
Anderson
,
D.
,
Jensen
,
D.
,
Crawford
,
R.
,
Otto
,
K.
, and
Wood
,
K.
,
2017
, “
Design Prototyping Methods: State of the Art in Strategies, Techniques, and Guidelines
,”
Des. Sci.
,
3
(
e13
), pp.
1
33
.
81.
Moe
,
R. E.
,
Jensen
,
D. D.
, and
Wood
,
K. L.
,
2004
, “
Prototype Partitioning Based on Requirement Flexibility
,”
16th International Conference on Design Theory and Methodology
,
Salt Lake City, UT
, Vol.
3a
, pp.
65
77
.
82.
Hamon
,
C. L.
,
Green
,
M. G.
,
Dunlap
,
B.
,
Camburn
,
B. A.
,
Crawford
,
R. H.
, and
Jensen
,
D. D.
,
2014
, “
Virtual or Physical Prototypes? Development and Testing of a Prototyping Planning Tool
,”
121st ASEE Annual Conference and Exposition
,
Indianapolis, IN
.
You do not currently have access to this content.