End-to-End Data Pipeline in Games for Real-Time Data Analytics

Abstract

Data pipeline architecture in game is a system that captures, organizes, and routes data, which enables reporting or data analytics. Such results can be utilized by game developers. A main challenge is that to allow huge data from the game clients to flow to the system, while the core game processing must not be interrupted. This paper reviews thorough concepts related to the game analytics. In addition, the observations of the data pipeline components in games are made and discussed to evaluate the challenges which are real-time data pipeline and in-memory process implementation.