You are on page 1of 15

CORPORATE VENTURING EVALUATION:

HOW START-UP PERFORMANCE IS


MEASURED IN CORPORATE VENTURING
DURING THE COLLABORATION PHASE
Steven Rottmann1
1 Mendel University in Brno, Czech Republic

Volume 5 Issue 2
ISSN 2694-7161
www.ejobsat.com

ABSTRACT
In the context of business performance assessment, current research often focuses on evaluating
effects of innovation projects with start-ups. Subsumed as corporate venturing (CV), investigating
the impact of these projects is becoming increasingly important. Thus, the number of studies on
the ex-post value of corporate venturing projects (CVP) has steadily increased over the last
years. In contrast, this research attempts to cover the evaluation of CVP in the period between
from the contract conclusion to termination. By conducting interviews, this research primarily
aims at identifying indicators applied for evaluating CVP performance during the cooperation of
subjects in the automotive industry. The results obtained show that evaluation is mostly based
on subjective criteria and that no formal indicators are implemented to manage CVP during the
collaboration phase. This research contributes to literature by revealing practically applied CVP
performance indicators during the collaboration phase and by discussing their weaknesses.

KEY WORDS
corporate venturing, performance measurement

JEL CODES
M10, M13, O32

1 INTRODUCTION AND OBJECTIVE

Corporate venturing (CV) is the umbrella practice, the theoretical understanding is still
term for entrepreneurial activities regarding in its beginnings (Maula et al., 2009). CV has
collaborations of established organizations with been discussed in literature every now and then.
new and innovative businesses (Reimsbach and Three major peaks of attention can be identified
Hauschild, 2012). Even though the relevance of so far. In 1960 there was the first peak,
CV has been acknowledged in literature and in when over 25% of the Fortune 500 businesses
ROTTMANN, Steven. 2019. Corporate Venturing Evaluation: How Start-Up Performance is Measured in
Corporate Venturing During the Collaboration Phase. European Journal of Business Science and Technology,
5 (2): 185–199. ISSN 2694-7161, DOI http://dx.doi.org/10.11118/ejobsat.v5i2.179.
186 Steven Rottmann

engaged into CV (Baldi et al., 2015). In 1980, Dollar in CV over a five-year period from 2011
the second attention peak was reached, when until 2016 (Boston Consulting Group, 2016).
corporates strived for diversification. The third Considering, that at least 50% of corporate
peak emerged in the 1990s. New technological venturing projects (CVP) fail, indicators to
trends, market opportunities and an improved evaluate when to end CVPs would increase the
legal environment with less regulation and economic performance of corporates {Carneiro
tax incentives fuelled the engagement in CV 2012 #72D: 995}. Consequently, such indica-
(Dauderstädt, 2013). Today, the attention on tors could not only be used to manage the
CV is increasing again. This is based on the fact, relationship, but also to influence the accom-
that corporates more and more collaborate with plishment of CV goals.
other organizations in order to keep up with a Following the need for such research (Pekkola
disruptive and fast developing world (Pekkola and Ukko, 2016; Bititci et al., 2012; Benson
and Ukko, 2016; Ferreira et al., 2012). CV is and Ziedonis, 2009), the present study aims to
a mean for corporates to achieve their goals in answer the following research question: which
order to fulfil stakeholders’ needs. To achieve indicators are practically applied within the
these goals, the management of CV becomes automotive industry to evaluate CVP during
crucial. Thus, an encompassing understanding the collaboration of subjects? Consequently,
of how to manage CV, including the underlying the research goal is to identify indicators for
mechanisms and indicators is needed. the evaluation of CVP during the cooperation
Yet, to the knowledge of the authors, research of subjects. Special emphasis will be held on
on CV management during the collaboration indicators which signal CVP problems and
phase is rare. Existing literature investigates let assume, that the termination of the co-
the ex-ante and ex-post phases of CV, e.g. start- operation is more economically advantageous
up selection criteria or measurement of ex-post for the corporate. Research will be carried
CV success. Even performance measurement out only in organizations working within the
literature does not offer a framework to evaluate automotive industry. By answering the research
CV during the collaboration phase (Pekkola question this research contributes to literature
and Ukko, 2016; Westphal et al., 2010). Yet, by offering first empirical insights into CVP
as stated by Busi and Bititci, a deeper under- performance evaluation during the cooperation
standing of CV and its evaluation measures is phase and by revealing practically applied
needed (Busi and Bititci, 2006). indicators in the automotive industry.
Also, from an empirical perspective CV In the following, basic theoretical information
proved its importance. An Accenture study and applied methods are made transparent.
reveals that 50 out of the top 100 companies Then empirical results and most important
from the Fortune 500 ranking engage in CV insights are shared. Afterwards the results will
(Berthon et al., 2015). Simultaneously, the be discussed, before a conclusion regarding the
investment sum increased (Brigl et al., 2016). indicators used for CVP evaluation during the
A Boston Consulting Group study states that collaboration phase is drawn.
German corporates invested 1,3 Billion US

2 THEORETICAL FRAMEWORK

After having shown the theoretical and practi- vative businesses (Chesbrough, 2002; Keil et
cal importance of CV, a common understanding al., 2008; Dushnitsky and Lenox, 2006; Freese,
of CV and its goals is created. According to 2006). Alongside others collaboration forms,
literature, CV is the umbrella term for en- like alliances and joint ventures, CV focuses
trepreneurial activities regarding collaborations on establishing mutual beneficial relationships
of established companies with new and inno- (Pekkola and Ukko, 2016; Lee and Kang, 2015).
Corporate Venturing Evaluation: How Start-Up Performance is Measured in Corporate Venturing … 187

CV collaborations represents the closest form Chesbrough, 2002). This can be seen in Tab. 1,
of relationships (Parung and Bititci, 2006). CV reviewing CV goal definitions.
can be structured in intern and external CV. Even though CV goals are formulated dif-
Internal CV refers to internal entrepreneurial ferently, they can be categorized into 6 cate-
activities. These are anchored by establishing a gories. The first category represents the goal
start-up inside the corporate’s boarder. In con- to create innovation and gain insight into new
trast, external CV focuses on entrepreneurial technologies. The goal to enter and develop
activities outside the corporate’s border (Daud- markets embodies the second category. Thirdly,
erstädt, 2013). In more detail, external CV the goal to create spill-over effects and cross-
describes the idea that a large, well-established selling opportunities builds a category. A fourth
organization (the corporate) engages into a category includes the goal to positively influ-
collaboration with a small autonomous business ence the brand and an organization’s repu-
(the start-up) with high potential for growth tation. The fifth category represents a more
and innovation (Reimsbach and Hauschild, qualitative goal, namely the enhancement of
2012). (entrepreneurial) culture. Finally, the sixth
CV represents a financial investment. Driven category encompasses the goal to generate
by the desire for control and mitigation of additional financial returns.
risk, organizations either invest directly or Literature argues, that although an organiza-
indirectly into start-ups. When organizations tion might target different goals, the “window
focus on controlling a start-up, they normally on technology” or the creation of innovation
take equity. When corporates strive for few is the most important one (Baldi et al.,
liability and management complexity rather 2015; Chemmanur et al., 2014; Reimsbach and
than control, they tend to take no equity Hauschild, 2012; Faisst, 2005; Dushnitsky and
(Neumann et al., 2019). Lenox, 2006).
Corporates engage in CV based on the Obviously, a mechanism to manage the or-
economical decision to jointly solve problems ganization towards achieving its objectives and
which cannot be solved by the corporate alone to evaluate the degree of objective realisation
(Camarinha-Matos et al., 2009). Especially in is needed (Pekkola and Ukko, 2016). This
the case of innovation start-ups are great CVP is known as performance measurement (PM).
partners, since start-ups are more innovative PM represents a systematic approach to plan,
than corporates and therefore offer access to measure, monitor, assess, reward, and control
innovation and new technologies (Chemma- the performance of organizations whilst using
nur et al., 2014; Engel, 2011; Bititci et al., suitable methods and tools (Pekkola and Ukko,
2012). However, also start-ups benefit from CV. 2016; Kaack, 2012). In general, PM represents a
Mostly, resources and managerial support is learning system, which is constantly optimized
provided by corporates. Financing also plays and refined to enhance its information and
an important role. Based on this support, steering function. More specifically, PM is a
CV backed start-ups reach a higher output in method to plan and conduct data collection
innovation (Chemmanur et al., 2014). Conse- regarding goal achievement. According to West-
quently, CV serves to leverage the benefits for phal et al. PM comprises two main elements.
both organizations (Maula, 2001; Faisst, 2005; The first element encompasses the definition
Dushnitsky and Lenox, 2006). of performance measurement systems (PMS)
When engaging in CV, corporates pursue to describe how performance measurement is
an individual set of strategic and financial set-up and conducted. The second element
goals (Reimsbach and Hauschild, 2012). Yet, represents the definition of dimensions and key
corporates do not focus mainly on financial performance indicators (KPI) to evaluate the
benefits, but rather on strategic ones (Covin business performance (Westphal et al., 2010).
and Miles, 2007; Dushnitsky and Lenox, 2006;
188 Steven Rottmann

Tab. 1: CV goals (Kann, 2000; Keil, 2000; Maula, 2001; Ernst et al., 2005; Covin and Miles, 2007; Dauderstädt, 2013;
Berthon et al., 2015)

Year Author(s) CV goals


2000 Kann External innovation
Fast market entry/new market entry
Expansion of demand
2000 Keil Establish entrepreneurship
Generate innovation
Enter/develop new markets
Gain knowledge
Diversification/strategic renewal
Growth
2001 Maula Financial gain: return/profit
Learn: insights in markets/new technology
Option building: fast market entry/discovery/development of markets/companies
Leverage: demand for own products/resources
2005 Ernst Identification of new/competing technologies
Access to complementary capabilities/resources/knowledge
Access to growth opportunities
2007 Covin, Miles Organizational development
Cultural change
Strategic benefits
Real option development
Financial returns
2013 Dauderstädt Generate of financial return
Develop ecosystem
Talent scouting
Access new products/technologies
Increase networking/option building
Improve image/positioning
Leverage internal resources
Outsource research & development
Increase intrapreneurship
Access specific skills/knowledge
2015 Berthon et al. Access specific skills/knowledge
New market entry
Improve internal R&D return
Accelerate inhouse innovation
Develop new products/services
Enhance company image/brand
Enhance entrepreneurial culture

A PMS is a system to measure and steer mation was collected to support management
the multi-dimensional strategic and operational decision making. Today also external informa-
performance in balance with its alternating tion concerning customers, markets, competi-
interdependences and thus represents A bundle tors and especially non-financial information
of different but linked performance measures plays an important role (Collier, 2005). Solely
(Ferreira et al., 2012; Collier, 2005). using financial measures is discussed critically,
The PMS’s focus changed over time. Origi- because strategic goals and effects get lost
nally, formal and financially measurable infor- (Pekkola and Ukko, 2016). These effects and
Corporate Venturing Evaluation: How Start-Up Performance is Measured in Corporate Venturing … 189

the status of goal realization can be trans- CVP evaluation during the collaboration phase
ferred into indicators (Ferreira et al., 2012). seems to be worthwhile, research regarding this
These indicators refer to different dimensions, topic is extremely limited (Basu et al., 2011;
e.g. efficiency and effective-ness, internal and Banik, 2011; Westphal et al., 2010; Weber,
external or financial and non-financial measures 2009). Systematically structured operational in-
(Pekkola and Ukko, 2016; Ferreira et al., 2012). dicators, which evaluate the strategic outcome
Literature discusses the value of both, financial and CVP success do not exist (Dauderstädt,
and non-financial KPIs. 2013; Kollmann and Kuckertz, 2010; Faisst,
The impact on business performance through 2005). Consequently, empirical research reading
PMS and KPIs is widely acknowledged applied indicators for CVP evaluation during
(Pekkola and Ukko, 2016; Dauderstädt, 2013). the collaboration phase plays an important role
Even though the establishment of a PMS for in gaining in-depth understanding of CV.

3 SEMI-STRUCTURED INTERVIEW

To deepen the understanding of CVP perfor- viewee selection sharpened the understanding.
mance evaluation during the collaboration of Furthermore, this approach reduced the ex-post
subjects, this research strives to give empirical rationalization bias. All interviews are based on
insights on applied performance indicators. a semi-structured interview guideline with pre-
Since only very limited research on this topic defined interview questions. This safeguards a
exists, the authors chose a qualitative approach common approach and the discussion of the
to explore the research topic. They conducted same topics in the different interviews, thus
multiple interviews in different organizations paving the way for comparison between the
as a starting point to gain insights into CVP interviews and organizations.
performance evaluation. Already the first inter- The interview had two main goals. Firstly,
views showed that organizations are not aware they served to investigate whether CVP per-
of the indicators they apply. Thus, the main formance indicators are established in organiza-
purpose of the interviews is to reveal indicators tions. Secondly, they served to reveal implicitly
used by organizations in the automotive indus- used CVP performance indicators, even if there
try to evaluate CVPs. was no official CV performance measurement
18 in-depth interviews were conducted in 4 system implemented. All interviews lasted be-
automotive or automotive supplier organiza- tween 45 and 120 minutes. In accordance with
tions over a 16-month period from April 2018 the interviewee, the interviews were transcribed
until July 2019. All companies are located and then analysed with MAXQDA software. In
in Germany. The investigated corporates are some cases, the researchers were only allowed to
well-established organizations which regularly take notes. Afterwards, the collected notes were
collaborate with start-ups in order to access confirmed with the interviewee.
innovation and gain technological insights. To- Each interview started gathering background
gether engaging in about 75 CVP a year, the information about the interviewee and her/his
organizations are chosen due to the proven CV responsibility. After gathering information
maturity. about the organization’s CV history, dependent
The interviews were conducted with 7 experts on the interviewee either strategic information
and focus on the CV process, goals and perfor- or information about applied CV performance
mance indicators. As interview strategy both, indicators were discussed.
the strategic and operational level of the CVP The authors analysed the data collected
were investigated. Therefore, the interviewees from the interviews by using a coding system.
were chosen according to different levels of In a first step the authors deduced relevant
closeness to the CVP. This cross-level inter- codes, based on a literature review and assigned
190 Steven Rottmann

these to the transcribed interviews. Afterwards, Since there is no awareness and no trans-
further codes were added based on the interview parency of the indicators for CVP performance
analysis. Codes with similar content got merged evaluation within the interviewed organiza-
into a bigger code and in further iterations into tions, the semi-structured interview represents
categories. These categories are codes, which the only way, to reveal the indicators in order
built overall indicator perspectives clustering to reach the article’s goal.
implicitly applied indicators according to their
evaluation focus.

4 RESULTS

Following the described approach, the inter- only based their judgement about a CVP on
views revealed not only applied CVP perfor- seven to 14 out of the total indicator list. As an
mance indicators, but also lead to some basic insight from the interview it can be concluded,
and foundational results and insights. Before that CVP managers apply different indicators
presenting the revealed CVP performance in- to draw conclusions on CVP performance.
dicators, these basic insights are shared. Thus, there is no consistent standard for CVP
As a first result, none of the interviewed evaluation during the collaboration of subjects
organizations applied an objective, clearly de- within an organization. Simultaneously, this
fined indicator system for the CVP evaluation. means that a CVP manager might draw his
Instead of using an indicator system, the evalu- conclusion about CVP performance on different
ation of CVP is solely based on the gut feeling indicators each time he evaluates the same CVP
created out of CVP manager’s experience and project, but also when evaluating another CVP
subjective judgement. However, all interviewed project. Consequently, it is likely that a CVP
organizations announced that they want and manager’s performance evaluation is influenced
need an indicator system for the evaluation and biased by his environment.
of CVP during the collaboration phase. As Looking at the indicators themselves, they
revealed by the interviews the major challenge can be clustered into 4 categories. These cat-
for the organizations is to define what to egories are the same for all interviewed orga-
measure and how to measure. nizations. The category “financial indicators”
Nevertheless, based on the in-depth investiga- includes two measures. The first indicator was
tion the authors were able to reveal CVP per- used by four out of four interviewed organiza-
formance indicators which have been implicitly tions and describes the ratio between invested
applied. Even though none of these indicators capital and planned investment. It measures
is documented or officially announced, the CVP the investment status and offers insight into
managers implicitly used these indicators to the start-up’s capital consumption. For this
generate their gut feeling. Consequently, this indicator milestones with dedicated budgets
research contributes to a deeper understanding are defined. In case the capital consumption
of CVP evaluation by revealing these implicitly exceeds the budget, it is assumed that the start-
applied indicators. The research findings and up is inefficient and might not reach the target
thus the revelation of the implicit performance objective.
indicators applied by the CVP managers are The second indicator of the financial category
presented in Tab. 2. is the corporate’s share of venture’s revenue.
The indicators listed in Tab. 2 are implicitly The interviewed organization use this indicator
and unknowingly used by CVP managers to to determine the drive and commitment to-
evaluate whether a CVP is beneficial for an wards the CVP and the contracting corporate.
organization or not. In total 16 performance When the corporate’s share of the venture’s
indicators were revealed. Yet, CVP managers revenue decreases, it is assumed that the start-
Corporate Venturing Evaluation: How Start-Up Performance is Measured in Corporate Venturing … 191

ups loyalty decreases as well. This might lead the start-up is not required to deliver the
to negatively affect indicators from another solution right away. A notification that the
category. In conclusion for the financial cat- request was received, and that the start-up
egory, CVP performance evaluation is done works on a solution is enough. A short re-
by implicitly considering progress indicator, sponse time conveys commitment to the CVP,
like capital consumption, rather than output reliability and thus helps building trust. Trust
indicators, like profit. reduces monitoring activities, leaves freedom
The second category encompasses indicators for creativity as well as for trial and error.
regarding collaboration. In total five indica- As a result, response time represents an ap-
tors regarding collaboration were identified: proximator for trust. Even though it does
team stability respectively team fluctuation, not measure any output or outcome, organiza-
management support, response time, number tions rely on this indicator. With “number of
of conflicts and number of social interactions. conflicts” another CVP performance indicator
Considering team stability, the CVP managers for the collaboration category was revealed.
evaluate how often changes regarding the team Number of conflicts has two layers, which are
constellation happen. Changes regarding the evaluated by CVP managers. The first layer
team are used as an indicator for two aspects: represents social conflicts between the start-up’s
(1) reduction of team performance because of and corporate’s teams. The second layer refers
the norming process and (2) withdrawal of to number of problems, which cannot be solved
resources and/or knowledge. Both affect the between the teams and therefore are escalated
CVP performance negatively. All interviewed to a higher decision level. A high number of
companies rely on the team stability indicator. conflicts slows down the CVP collaboration
Remarkably, team fluctuation is seen negatively and affects performance negatively. Using this
by all CVP managers. None of them considered indicator complements the evaluation of CVP
that a change in the team constellation might performance by adding an approximator to
bring in additional knowledge or specific expe- evaluate the CVP atmosphere and thus the
rience. chemistry between organizations.
A CVP performance indicator which is used Moreover, one out of the four interviewed or-
by three out of four interviewed organizations ganizations applied an indicator measuring the
is management support. Interpreted slightly number of social interactions. Social interaction
different by each organization, this indica- simply refers to the number of “off the job”
tor reaches from management’s benevolence socializing. It is seen as a performance indicator
to management’s commitment and prioritiza- directly affecting the CVP collaboration. If the
tion. Mostly the commitment is determined CVP team has a strong personal bond, they
by management’s attendance at meetings or share information and support each other as
postponement of meetings and decisions. The quickly as possible. This personal bond beyond
assumption behind is, that with less attendance the job is tried to grab by measuring the
a CVP becomes deprioritized and loses grip, number of social interaction and events after
which will lead to the failure of the CVP. working hours. In summary of the collaboration
As a result, it can be deduced that in CVP category, the focus of the applied indicators
performance evaluation not only the outcome of again lies on progress indicators. Mostly, ap-
the CVP team is crucial, but also management proximators are used which try to make trust
involvement. The consideration of management quantifiable. Interestingly, not only the pure
involvement represents a difference to tradi- CVP output performance is considered, but
tional PMS. also the involvement of management as a key
Also used by three out of four companies, the element for CVP success.
response time is seen as an CV performance The next category refers to innovation. As
indicator. Response time means the time a described above, CVP focus on innovation
start-up takes to respond to a request. Yet, and the window on technology in the case of
192 Steven Rottmann

Tab. 2: Revealed set of indicators for CVP performance evaluation in automotive interviewed organizations

Indicator Org. A Org. B Org C. Org. D Sum


Finance
Invested capital/planned capital × × × × 4
Corporate share of venture’s revenue × × 2
Collaboration
Team stability/change × × × × 4
Management support × × × 3
Response time × × × 3
Conflicts × × × 3
Social interactions × × 2
Innovation
Impulses × × × 3
Features tested/updates × × × 3
Off-the-job time × 1
Process
On-time-delivery × × × × 4
Implemented best practices × × × 3
Slow decisions/not available incidents × × × 3
Information e×change sessions × × × 3
E×change session attendance rate × × 2
Celebrated successes × 1
14 10 13 7

the investigated organizations. Still, only three ganizations use this indicator to evaluate the
performance indicators were revealed: number quality of the start-up’s deliverables. The cor-
of impulses, number of features tested/ updates porates compare successfully tested features
and off the job time. Three out of four in- with the total features tested. The closer the
terviewed companies use “number of impulses” ratio is to 1, the better the quality. Apart
as indicator for CVP performance. With this from that, the number of qualified updates
indicator the organizations try to monitor the is considered. Having current project manage-
CVP innovativeness. It is assumed that a high ment data and proper documentation available
number of impulses increases the likelihood (called qualified updates) is as important as
of innovation and success. Referring to this the features tested. In case the quality de-
interpretation an idea represents an impulse as creases, it is assumed that either the start-up
much as a proposal of a joint workshop or an is not capable of delivering the innovation or
innovative solution. The only restriction is, that that the commitment decreasing. Both aspects
impulses must refer to the product or service reduce CVP performance. Interestingly, all
the CVP team is working on. In contrast, it interviewed companies which use this indicator
embodies a loss of commitment and effort, if also used the indicator “number of impulses”.
the number of impulses decreases. For CVP Another innovation indicator, which is applied
managers this indicates that the CVP might not by one corporate, measures off-the-job time.
be able to achieve the CVP innovation goal. Off-the-job time sums up the time, the CVP
The number of features tested/qualified up- team is not working on the innovation, but is
dates represents another CVP performance caught in meetings or in administrative tasks.
indicator. Three out of four interviewed or-
Corporate Venturing Evaluation: How Start-Up Performance is Measured in Corporate Venturing … 193

The probability of innovation and a successful Time-to-market is essential for innovations.


CVP decreases with a high off-the-job time. Consequently, three out of four interviewed
In conclusion, it can be deduced that the organizations use the number of slow decisions
innovation category tends to rather focus on or not available incidents of the start- up’s
output than on progress. This is a difference management as a CV performance indicator.
towards the other CVP performance evaluation Both, slow decisions and unavailability of the
categories. Nevertheless, no traditional lagging start-up’s management implicitly mirror, that
indicators like number of patents are used. The the priority of the CVP is not very high. In
applied indicators rather try to anticipate the case the CVP has highest priority, the start-
likelihood of innovation by referring to impulses up’s management will find the time to cope with
and elements of the desired innovation. Simulta- decision or requests from the corporate. This
neously, it can be deduced that the assumption indicator is strongly interlinked to the collabo-
behind is, that innovation is plannable and ration category and the indicator management
therefore dedicated features can be determined support.
ex-ante. A quite popular indicator represents the
The last category uses a process perspective. number of information exchange sessions. Three
It encompasses six performance indicators to interviewed organizations use this measure to
evaluate CVPs at an early point of time. Firstly, evaluate the CVP. The assumption is, that
the number of on-time deliveries is measured. meetings with the purpose to exchange infor-
Therefore, milestones and assigned deliverables mation help to provide relevant information
are predefined. If the results are delivered at and thus augment the likelihood of innovation.
the pre-defined milestone, the CVP is evaluated Moreover, information exchange sessions are
as successful. The indicator simply builds the associated with joint problem-solving. Thus, the
ratio between promised deliverables and actual interviewed organizations argue that frequent
deliverables based on the milestone plan. The meetings increase performance. As a result, the
closer the ratio is approaching 1, the better basic requirement of collaborations is targeted
the performance. Four out of four interviewed with this indicator. Only if the information flow
organizations deployed this performance indi- between entities is enabled, innovation leading
cator. Asking the interview question, which to CVP success is possible.
revealed indicator is the most important one, Two out of three interviewed organizations
all interviewees answered that on-time delivery complement this indicator with the exchange
is most crucial. This indicator implies that a session attendance rate. Since measuring only
CVP is plannable and has a clearly defined the number of information exchange sessions
outcome. also implies, that Even though on- is not representing the entire picture, these
time delivery implies plannability and a clearly two organizations also measure whether the
defined structure of innovation relevant experts participate (assuming that
Another process indicator is the number of the meeting participants are relevant for the
implemented best practices. Three out of four session). A high attendance rate safeguards
investigated companies apply this indicator to information exchange between relevant experts
implement improvements. It is assumed that and thus fosters innovation. Consequently, good
the relationship and way of working improves information exchange is likely to increase the
by a high number of best practices. Simulta- CV performance.
neously, implemented best practices increases The last process indicator which was revealed
the likelihood of innovation and therefore CVP is only used by one interviewed organization.
performance. As a result, this indicator aims to It is the number of celebrated successes. This
improve one of the main issues in CV, namely indicator refers to two topics. On the one
the disconnection between corporate and start- hand, the number of celebrated successes only
up regarding processes. increases if the innovative outcome for the mile-
stones has been achieved. Thus, representing
194 Steven Rottmann

the overarching success of the CVP. On the and process. Apart from that, the interviewed
other hand, this indicator implicitly supports organizations use quite similar indicators with
building the relationship between the teams, only little variance. All investigated companies
since a joint celebration fosters the personal implicitly evaluate the start-ups and CVP
bond and increases motivation. Implicitly the based on 16 financial and strategic aspects.
number of celebrated successes sums up the The finance category is the least important
overall performance and thus represents a CVP category for all interviewed organizations. Even
performance indicator. though, innovation represents the main goal
Summarizing the process category, this cate- of the CV collaboration, only three indicators
gory encompasses the most indicators in com- directly refer to this category. Interestingly,
parison to the other three categories. The im- most applied indicators embody progress indi-
plicitly applied indicators represent a mixture cators, which rather approximate the outcome.
of traditional indicators like on-time delivery Most of the indicators try to capture qualitative
and more dynamic indicators like number of not performance elements and transfer them in an
available incidents. The indicators are rather approximated quantitative measure. In compar-
used to monitor the development instead of ison to traditional performance measurement,
leading to a digital decision stating whether the the CVP indicators not only focus on the team’s
goal is achieved or missed. performance, but also considers management
In conclusion, all interviewed organizations performance by measuring for example avail-
implicitly apply indicators to evaluate CVP ability. As an insight, all implicitly applied CVP
during the collaboration of subjects. None of performance indicators contribute to build trust
the organizations uses a defined, standardized between the corporate and the start-up. These
set of indicators, nor are thresholds for the results help to understand the mechanisms how
implicitly applied indicators defined. Only due corporates evaluate CVP performance during
to the interview the authors were able to reveal the collaboration of subjects. Moreover, the
the applied CVP performance indicators. The revealed indicators contribute to a deepened
revealed indicators can be categorized in 4 cate- understanding of CVP evaluation during the
gories which are the same for all interviewed or- collaboration phase.
ganizations: finance, collaboration, innovation

5 DISCUSSION

After having presented the empirical results, show, the investigated organizations implicitly
a discussion of the results, especially the 16 apply 16 different CVP performance indicators
performance indicators applied for CVP eval- during the collaboration phase. These indi-
uation during the collaboration phase gives the cators are discussed in the light of existing
opportunity for further insights regarding the indicators from various research areas.
research topic. Existing literature focuses on traditional
In the present study the author coped with performance measurement methodologies and
the lack of missing empirical research and indicators. Yet, the usage of established mea-
empirically examined the applied indicators to sures – not developed for CV – has its lim-
evaluate CVP. It became obvious that none of itations (Banik, 2011; Keil, 2000). Existing
the interviewed companies established a formal frameworks focus on measuring performance
CVP evaluation framework for the collabora- of single businesses (Pekkola and Ukko, 2016;
tion phase with defined performance indicators. Westphal et al., 2010). Frameworks which focus
Still, all interviewed organizations long for such on CVP evaluation during the collaboration
a framework and desire a guideline with defined phase and thus cross-company management
indicators. As the empirical research results are hardly existing (Westphal et al., 2010).
Corporate Venturing Evaluation: How Start-Up Performance is Measured in Corporate Venturing … 195

Available CV performance measurement re- number of team changes is not enough. In order
search almost exclusively evaluates CV suc- to be reliable, only random team changes should
cess determinants or CV strategies. Systemat- be considered negatively. From the authors
ically structured operational indicators, which point of view, this indicator should not be
evaluate CVP during the collaboration itself adopted from venture capital literature and not
are lacking (Dauderstädt, 2013; Faisst, 2005; be considered in CVP performance evaluation
Kollmann and Kuckertz, 2010). Literature ac- during the collaboration phase.
knowledges, that a CV performance evaluation Top management support is stated to be
framework is crucial to increase transparency one of the most important indicators for CVP
and effectiveness regarding CVP (Faisst, 2005). performance, not only by the interviewed orga-
Therefore, CV specific requirements need to be nizations, but also in literature (Schween, 1996;
met (Westphal et al., 2010; Faisst, 2005). To Banik, 2011). Still, the indicator top manage-
develop a CV specific and practically usable ment support should be discussed critically.
performance indicator set, empirical insights Top management support is very important
help to understand CVP performance evalua- for successful CVP. However, it must not be
tion. confused with approval of all CVP requests.
Even though, implicit performance indicators Moreover, there is no clearly defined way of
have been identified, three of the four indicator measuring top management support. From the
categories are quite vague – with exception authors point of view, top management support
of the financial category. In general, a huge could rather be measured by the indicator “not
point for critique is that all interviewed orga- available incidents”. Since top management sup-
nizations only refer to managers’ gut feelings port is a vague term, the author recommends
when evaluating CVP performance. There are to clearly define measurable events in order to
no clearly defined indicators, thresholds or consider this indicator for CVP performance
guidelines for orientation in order to define evaluation.
good CVP performance. This holds true for Two out of four interviewed organizations use
all indicators. This overarching result will not the indicator “number of social interactions”.
be mentioned further in the discussion. Only This indicator is also discussed controversially
selected indicators with need for discussion are in literature (Maula, 2001). From the authors
presented in the following. point of view, this indicator could lead to wrong
Looking at the collaboration indicator cate- evaluations. Implicitly, the number of social
gory, team stability for example is used by four interactions might increase performance. Yet,
out of four interviewed organizations. Changes setting this indicator in stone would also lead
in the CV team are assumed to have negative to a more negative evaluation of CVP, which
impact. Having a solid team aligns with existing simply does not offer the possibility to visit joint
venture capital literature. However, venture events – for example because of geographical
capital looks at the team constellation ex ante distance. Moreover, social interaction could also
in order to determine whether a team is capable lead to negative effects, when people recognize
of being successful. In this context literature at social events that they do not trust one
states that a stable team positively impacts per- another. Based on the geographical influence
formance (De Clercq et al., 2006). Yet, during a and the missing focus of a clear goal when con-
CVP this holds only partially true. Sometimes, sidering this indicator, the authors recommend
changes in the team bring new expert knowl- further investigation whether this indicator is
edge into the CVP. Thus, in case of high-quality suitable for CVP evaluation.
staffing the change of team constellation might Even though all CVP focus on innovation,
even increase CVP performance. Since experts basic definition and thresholds are missing to
oftentimes add value only to specific topics or have conclusive innovation indicators. Based on
phases, a change of the team constellation might the vagueness of the implicitly applied indica-
even be necessary. Consequently, counting the tors, it is almost impossible to deduce reliable
196 Steven Rottmann

conclusions about CVP performance. From the sessions might distort the picture. Firstly, the
authors perspective at least a clear process of amount of necessary exchange sessions depends
how to define thresholds for each CVP and a on the project. Too many exchange sessions
up front acceptance of the thresholds between for example even might decrease performance,
the CV parties needs to be given. Defining a since the CV team spends much time in non-
standard threshold without considering specific value-adding meetings. Thus, a suitable number
CVP does not make sense, since each CVP has of sessions needs to be defined. Secondly,
different requirements. exchange sessions themselves are not enough to
Looking at the process category, the before transfer relevant information. Also, the relevant
mentioned challenge of missing thresholds and experts need to be present. Consequently, the
clearly defined indicator hamper objective mea- number of exchange session is only relevant
surement. Especially when focussing on the in combination with the attendance rate of
number of slow decision/not available incidents relevant experts and managers (Camarinha-
two topics need to be critically discussed. Matos et al., 2009; Westphal et al., 2010). Only
Firstly, it is not defined what a slow decision with the right people, quality of the information
is and how it is measured. On the one hand, exchange sessions can be guaranteed. From the
“slow decision” is decision specific and depends authors perspective, these indicators only give
on the individual perception of everyone. On insights into CVP performance when considered
the other hand, even if a slow decision could be together.
defined, there would still be the question how Even though the authors revealed the in-
to measure it referring to starting point. This dicator “number of celebrated successes”, this
discussion also emerges in entrepreneurship indicator seems to be a practical appearance,
literature (Sadowski, 2001; Toschi, 2009). In not discussed in in literature so far. At first
entrepreneurship literature this indicator is seen sight, the indicator seems to correlate with
as the basis for fast innovation – the key goal of the number of social interactions. However, the
CV. From the authors perspective, measuring number of celebrated success has a broader
not available incidents would be easier to perspective and from the authors perspective
measure in comparison to slow decisions. Still, is more relevant for CVP performance eval-
it needs to be defined when non-availability can uation. Celebrated successes include various
be counted as not available incident. Is it a components. Firstly, it means that endeavours
not available incident when the decider is on have been successfully finished. Secondly, it
vacation? Does a not available incident refer to means that the milestone plan including the
all events or only for important decision with deliverables have been successfully achieved.
time pressure? How much time needs to pass Thirdly, the number of features tested/updates
until missing availability can be counted as not was great enough to achieve the targeted
available incident? So far, this indicator plays outcome, which also implicates that the number
only a minor role, however it offers quite some of impulses and off-the-job-time was in balance.
insights into CVP performance. Consequently, Fourthly, it strengthens the personal bonding
the authors recommend analysing the practical between the organizations, which would also
applicability of the indicator number of not partly cover the indicator number of social
available incidents. interactions. Fifthly, it increases motivation
Another process indicator represents the of the CV team which inherently influences
number of exchange sessions. Not only for the performance positively. To the knowledge of the
interviewed companies, but also for various author, this indicator is its infancy and further
literature streams this indicator is relevant investigation is needed.
for performance evaluation (De Clercq et al., All in all, this empirical research reveals
2006; Dauderstädt, 2013; Camarinha-Matos et practically applied indicators. In the discussion
al., 2009). Yet, from the authors point of part of the paper, the authors shed light
view, solely looking at the number of exchange on the weaknesses and insufficiencies of the
Corporate Venturing Evaluation: How Start-Up Performance is Measured in Corporate Venturing … 197

implicitly applied CVP performance indicators research contributes to CV literature and a


for the collaboration phase. By revealing the deeper understanding of CVP performance
indicators and discussing their weaknesses, this evaluation.

6 CONCLUSION

Even though the importance and value-add of itly applied performance indicators. Also, this
CVP has been widely acknowledged in litera- empirical research explains why the revealed
ture, the understanding of CVP performance indicators are applied. Finally, this research
evaluation during the collaboration phase is in contributes to literature not only by revealing
its beginning (Dauderstädt, 2013; Husted and applied indicators, but also by comparing these
Vintergaard, 2004; De Clercq et al., 2006). Em- indicators with indicators extracted from vari-
pirical studies coping with CVP performance ous literature streams and shedding light on the
evaluation during the collaboration phase are weaknesses and insufficiencies in the context of
lacking. Therefore, this study addressed the CVP.
need for empirical data on practically applied From a managerial perspective this research
CVP performance indicators. To reveal these contributes by proposing four CVP perfor-
indicators, the authors conducted 18 in-depth mance perspectives and the revelation of 16
interviews at four automotive companies. CVP performance indicators applied by var-
The results show that even though the in- ious organizations in order to set the basis
terviewed organizations longed for an objective for defining a CVP performance measurement
and clearly defined set of indicators, the actual framework. By explaining applied indicators
evaluation was based on subjective gut feeling. and critically examining them, the authors give
The authors made visible, which factors lead to an orientation for managing CVPs during the
the CV managers’ gut feelings and summarized collaboration of subjects.
implicit indicators. In total 16 CVP perfor- Nevertheless, interviews can only be a start-
mance indicators, used for the evaluation of ing point of the research. One of the research’s
CVP during the collaboration phase have been limitation is the restricted generalizability. In
revealed. They all align with one of the four order to establish a proven set of CVP perfor-
categories: finance, collaboration, innovation mance indicators for the collaboration phase,
and process. quantitative research is needed to validate
The study contributes to existing literature and generalize the research’s results. Moreover,
by expanding theoretical knowledge of CVP further research is needed to investigate the
performance measurement during the collabora- transferability of the revealed CVP perfor-
tion phase. As one of the first in-depth studies of mance indicators to different industries.
the CVP collaboration phase, it revealed implic-

7 REFERENCES

Baldi, F., Baglieri, D. and Corea, F. 2015. Balancing Banik, C. 2011. Corporate Venture Capital –
Risk and Learning Opportunities in Corporate Eine empirische Untersuchung zur Abgrenzung
Venture Capital Investments: Evidence from the gegenüber Venture Capital basierend auf dem
Biopharmaceutical Industry. Entrepreneurship Umsatz- und Beschäftigungswachstum und anhand
Research Journal, 5 (3), 221–250. von Realoptionen von Schweizer Jungunternehmen.
PhD thesis, Universität Rostock.
198 Steven Rottmann

Basu, S., Phelps, C. and Kotha, S. 2011. Towards De Clercq, D., Fried, V. H., Lehtonen, O. and
Understanding Who Makes Corporate Venture Sapienza, H. J. 2006. An Entrepreneur’s Guide
Capital Investments and Why. Journal of Business to the Venture Capital Galaxy. Academy of
Venturing, 26 (2), 153–171. Management Perspectives, 20 (3), 90–112.
Benson, D. and Ziedonis, R. H. 2009. Corporate Dushnitsky, G. and Lenox, M. J. 2006. When Does
Venture Capital as a Window on New Technologies: Corporate Venture Capital Investment Create
Implications for the Performance of Corporate Firm Value? Journal of Business Venturing, 21 (6),
Investors When Acquiring Start-ups. Organization 753–772.
Science, 20 (2), 329–351. Engel, J. S. 2011. Accelerating Corporate Innovation:
Berthon, B., Kavathekar, J., Morvan, L., Lessons from the Venture Capital Model.
Hintermann, F., Vazirani, M. and Research-Technology Management, 54 (3), 36–43.
Mirshokrai, C. 2015. Harnessing the Power Ernst, H., Witt, P. and Brachtendorf, G. 2005.
of Entrepreneurs to Open Innovation: Creating Corporate Venture Capital as a Strategy for
a Culture of Entrepreneurship and Innovation External Innovation: An Exploratory Empirical
Through Digital Collaboration. Accenture. Young Study. R&D Management, 35 (3), 233–242.
Entrepreneurs’ Alliance Summit, Turkey.
Faisst, U. 2005. Integrated Enterprise Balancing:
Bititci, U. S., Garengo, P., Dörfler, V. Beiträge zum integrierten, IT-unterstützten
and Nudurupati, S. S. 2012. Performance Ertrags- und Risikomanagement. PhD thesis,
Measurement: Challenges for Tomorrow. Universität Augsburg.
International Journal of Management Reviews,
14 (3), 305–327. Ferreira, P. S., Shamsuzzoha, A. A., Toscano, C.
and Cunha, P. 2012. Framework for Performance
Boston Consulting Group. 2016. Corporates More and Measurement and Management in a Collaborative
More Arise as Start-up Investors. Press, release on Business Environment. International Journal
2016, May 2. of Productivity and Performance Management,
Brigl, M., Hong, M., Roos, A., Schmieg, F. and 61 (6), 672–690.
Wu, X. 2016. Corporate Venturing Shift Gears. Freese, B. 2006. Corporate-Venture-Capital-Einheiten
BCG (Boston Consulting Group) Global Research. als Wissensbroker: Empirische Untersuchung
Busi, M. and Bititci, U. S. 2006. Collaborative interorganisationaler Beziehungen zwischen
Performance Management: Present Gaps and Industrie- und Start-up-Unternehmen. 1st ed.
Future Research. International Journal of Wiesbaden: Deutscher Universitätsverlag.
Productivity and Performance Management, Husted, K. and Vintergaard, C. 2004. Stimulating
55 (1), 7–25. Innovation Through Corporate Venture Bases.
Camarinha-Matos, L., Paraskakis, I. and Journal of World Business, 39 (3), 296–306.
Afsarmanesh, H. (eds.). 2009. Leveraging Kaack, J. 2012. Performance Measurement für die
Knowledge for Innovation in Collaborative Unternehmenssicherheit. Wiesbaden: Gabler
Networks. Proceedings from 10th IFIP WG 5.5 Verlag.
Working Conference on Virtual Enterprises,
PRO-VE 2009, Thessaloniki, Greece. Kann, A. 2000. Strategic Venture Capital Investing
by Corporations: A Framework for Structuring
Chemmanur, T. J., Loutskina, E. and Tian, X. 2014. and Valuing Corporate Venture Capital Programs.
Corporate Venture Capital, Value Creation, and PhD thesis, Stanford University.
Innovation. Review of Financial Studies, 27 (8),
2434–2473. Keil, T. 2000. External Corporate Venturing:
Cognition, Speed, and Capability Development.
Chesbrough, H. 2002. Making Sense of Corporate PhD thesis, Helsinki University of Technology
Venture Capital. Harvard Business Review, 3, Espoo.
90–100.
Keil, T., Autio, E. and George, G. 2008. Corporate
Collier, P. M. 2005. Entrepreneurial Control and Venture Capital, Disembodied Experimentation
the Construction of a Relevant Accounting. and Capability Development. Journal of
Management Accounting Research, 16 (3), Management Studies, 45 (8), 1475–1505.
321–339.
Kollmann, T. and Kuckertz, A. 2010. Evaluation
Covin, J. G. and Miles, M. P. 2007. Strategic Use of Uncertainty of Venture Capitalists’ Investment
Corporate Venturing. Entrepreneurship Theory Criteria. Journal of Business Research, 63 (7),
and Practice, 31 (2), 183–207. 741–747.
Dauderstädt, P. 2013. Success Factors in Strategic
Corporate Venturing. PhD thesis, Technischen
Universität Berlin.
Corporate Venturing Evaluation: How Start-Up Performance is Measured in Corporate Venturing … 199

Lee, S. U. and Kang, J. 2015. Technological Reimsbach, D. and Hauschild, B. 2012. Corporate
Diversification Through Corporate Venture Venturing: an Extended Typology. Journal of
Capital Investments: Creating Various Options to Management Control, 23 (1), 71–80.
Strengthen Dynamic Capabilities. Industry and Sadowski, D. 2001. Entrepreneurial Spirits.
Innovation, 22 (5), 349–374. Wiesbaden: Gabler Verlag.
Maula, M. V. J. 2001. Corporate Venture Capital and Schween, K. 1996. Corporate Venture
the Value-Added for Technology-Based New Firms. Capital: Risikokapitalfinanzierung deutscher
PhD thesis, Helsinki University of Technology, Industrieunternehmen. Wiesbaden: Gabler Verlag.
Espoo.
Toschi, L. 2009. Corporate Venture Capital: How
Maula, M. V. J., Autio, E. and Murray, G. C. Established Firms Use External Resources to
2009. Corporate Venture Capital and the Balance Create New Competencies. PhD thesis, University
of Risks and Rewards for Portfolio Companies. of Bologna.
Journal of Business Venturing, 24 (3), 274–286.
Weber, C. 2009. Corporate Venture Capitalists with
Neumann, M., Hintzen, D., Riel, A., Waldhausen, G. a ‘Bird’s-Eye View’ – A Dynamic Social Network
and Dismon, H. 2019. Startup Engagement as Perspective. Schmalenbach Business Review, 61,
Part of the Technology Strategy Planning – How 195–224.
Rheinmetall Automotive Increases Innovation
by Using Corporate Venturing. Post-Print Westphal, I., Thoben, K.-D. and Seifert, M. 2010.
hal-02147818, HAL. Managing Collaboration Performance to Govern
Virtual Organizations. Journal of Intelligent
Parung, J., Bititci, U. S. 2006. A Conceptual Metric Manufacturing, 21 (3), 311–320.
for Managing Collaborative Network. Journal of
Modelling in Management, 1 (2), 116–136.
Pekkola, S. and Ukko, J. 2016. Designing
a Performance Measurement System for
Collaborative Network. International Journal of
Operations & Production Management, 36 (11),
1410–1434.

AUTHOR’S ADDRESS
Steven Rottmann, Department of Business Economics, Faculty of Business and Economics,
Mendel University in Brno, Zemědělská 1, 613 00 Brno, Czech Republic, e-mail:
steven.rottmann@gmx.de

You might also like