Objective: This paper investigates factors impacting team performance in the Multi-player Online Battle Arena gaming environment, League of Legends™, by testing an integrated Input Mediator-Outcome team effectiveness framework. Background: Secondary data and Naturally Occurring Data Sets (NODS) are data that have been collected from respondents without research interests in mind and can occur naturally in the environment. There are numerous sources of secondary data, including government data, financial databases, industry association groups, and Application Programming Interfaces, which this research utilizes to study the performance of teams. Methods: Path Analysis and Partial Least Squares Discriminant Analysis (PLS-DA) are analytical methods that are well suited for large data sets and sample sizes, confirmatory in nature, and can test a theoretical model. This research utilizes both in order to study factors impacting team performance. Results: A total of 5,927 matches from 742 teams are sampled and analyzed. Six team performance measures are used to discriminate between winning and losing teams, including role familiarity, team familiarity, team effectiveness, team efficiency, and the Kills, Deaths, Assist (KDA) ratio. Using path analysis and supervised PLS-DA, the models led to the successful prediction of 89.4% of the matches. The error rate for the PLS-DA model is 0.106 (Q2 = 0.523; R2 = 0.551). Conclusions: This work shows how objective, detailed data on teamwork may be used to provide insights into questions of the performance of teams. Additionally, the results demonstrate the value of using path analysis and PLS-DA to test an integrated framework. Application: This research highlights the value and feasibility of studying virtual teams for new insights into team performance.
References
1.
Burton-JonesA.LeeA. S. (2017). Thinking about measures and measurement in positivist research: A proposal for refocusing on fundamentals. Information Systems Research, 28(3), 451–467.
2.
ChinW. W.NewstedP. R. (1999). Structural equation modeling analysis with small samples using partial least squares. Statistical Strategies for Small Sample Research, 1(1), 307–341.
3.
ClaryC. M.KestensY. (2013). Field validation of secondary data sources: A novel measure of representativity applied to a canadian food outlet database. International Journal of Behavioral Nutrition and Physical Activity, 10(1), 1.
4.
Davis-KeanP. E.JagerJ.MaslowskyJ. (2015). Answering developmental questions using secondary data. Child Development Perspectives, 9(4), 256–261.
5.
DayG. S.MontgomeryD. B. (1999). Charting new directions for marketing. The Journal of Marketing, 3–13.
6.
EspinosaJ. A.SlaughterS. A.KrautR. E.HerbslebJ. D. (2007). Familiarity, complexity, and team performance in geographically distributed software development. Organization Science, 18(4), 613–630.
7.
FerrariS. (2013). From generative to conventional play: Moba and league of legends. In Proceedings of DiGRA 2013: DeFragging Game Studies.
HoustonM. B. (2004). Assessing the validity of secondary data proxies for marketing constructs. Journal of Business Research, 57(2), 154–161.
10.
HoustonM. B.JohnsonS. A. (2000). Buyer–supplier contracts versus joint ventures: Determinants and consequences of transaction structure. Journal of Marketing Research, 37(1), 1–15.
11.
KimY. J.EngelD.WoolleyA. W.LinJ. Y.-T.McArthurN.MaloneT. W. (2017). What makes a strong team?: Using collective intelligence to predict team performance in league of legends. In Proceedings of Computer Supported Cooperative Work (pp. 2316–2329).
12.
LeavittA.KeeganB. C.ClarkJ. (2016). Ping to win?: Non verbal communication and team performance in competitive online multiplayer games. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (pp. 4337–4350). ACM.
13.
LehmannD. R. (1985). Market research and analysis.
14.
LimB.-C.KleinK. J. (2006). Team mental models and team performance: A field study of the effects of team mental model similarity and accuracy. Journal of Organizational Behavior, 27(4), 403–418.
PobiedinaN.NeidhardtJ.Calatrava MorenoM. d. C.WerthnerH. (2013). Ranking factors of team success. In Proceedings of the 22nd International Conference on World Wide Web (pp. 1185–1194). ACM.
17.
RindfleischA.HeideJ. B. (1997). Transaction cost analysis: Past, present, and future applications. The Journal of Marketing, 30–54.
18.
SangsterM.-D. D.MendoncaD. J.GrayW. D. (2016). Big data meets team expertise in a dynamic task environment. In Proceedings of the Human Factors and Ergonomics Society Annual Meeting (Vol. 60, 1, pp. 158–162). SAGE Publications.
19.
SchreiberJ. B.NoraA.StageF. K.BarlowE. A.KingJ. (2006). Reporting structural equation modeling and confirmatory factor analysis results: A review. The Journal of Educational Research, 99(6), 323–338.
20.
SosikJ. J.KahaiS. S.PiovosoM. J. (2009). Silver bullet or voodoo statistics? a primer for using the partial least squares data analytic technique in group and organization research. Group & Organization Management, 34(1), 5–36.
21.
WalbridgeM. (2008). Analysis: Defense of the ancients-an underground revolution. Gamasutra. Retrieved June, 23.
22.
WebbE.CampbellD. T.SchwartzR. D.SechrestL. (1966). Unobtrusive measures: Nonreactive research in the social sciences. Chicago: Rand McNally.
