Creating a Financial Data Lake for Academic Fintech Research

Daniel Broby, Huckleberry Hopper

Research output: Working paperOther working paper

30 Downloads (Pure)

Abstract

This paper presents the case for a Financial Technology (Fintech) data lake. Fintech is impacting business models and its concepts require testing. The definition of Fintech is imprecise, but it is characterized by the use of technology as applied to digital financial transformation. The software and programming driving it is evolving and should be evaluated before being introduced into financial markets. Its development impacts "client money" and this can be risky unless supervised. Fortunately, such experimentation can be done in a controlled way using a regulatory sandbox. This allows Fintech concepts to be checked for reliability and robustness, using consenting live accounts (which receive a special regulatory exception). We propose a less risky supplementary approach, namely the testing of concepts on real but “blinded” financial big data files stored in a data lake. In this way, back-testing, out of sample experiments and forward performance checks can be done without the risk of losing money. We investigate how to implement such a data lake in order to do this.
Original languageEnglish
Place of PublicationGlasgow
PublisherUniversity of Strathclyde
Number of pages11
Publication statusPublished - 14 Nov 2019

Fingerprint

Financial data
Testing
Software
Financial markets
Experimentation
Experiment
Backtesting
Business model
Robustness
Programming

Keywords

  • Fintech
  • strategy
  • business models
  • innovation
  • financial services
  • data lake
  • data warehouses

Cite this

Broby, D., & Hopper, H. (2019). Creating a Financial Data Lake for Academic Fintech Research. Glasgow: University of Strathclyde.
Broby, Daniel ; Hopper, Huckleberry. / Creating a Financial Data Lake for Academic Fintech Research. Glasgow : University of Strathclyde, 2019.
@techreport{d8e187fffc9e47eea7286384da93d98b,
title = "Creating a Financial Data Lake for Academic Fintech Research",
abstract = "This paper presents the case for a Financial Technology (Fintech) data lake. Fintech is impacting business models and its concepts require testing. The definition of Fintech is imprecise, but it is characterized by the use of technology as applied to digital financial transformation. The software and programming driving it is evolving and should be evaluated before being introduced into financial markets. Its development impacts {"}client money{"} and this can be risky unless supervised. Fortunately, such experimentation can be done in a controlled way using a regulatory sandbox. This allows Fintech concepts to be checked for reliability and robustness, using consenting live accounts (which receive a special regulatory exception). We propose a less risky supplementary approach, namely the testing of concepts on real but “blinded” financial big data files stored in a data lake. In this way, back-testing, out of sample experiments and forward performance checks can be done without the risk of losing money. We investigate how to implement such a data lake in order to do this.",
keywords = "Fintech, strategy, business models, innovation, financial services, data lake, data warehouses",
author = "Daniel Broby and Huckleberry Hopper",
year = "2019",
month = "11",
day = "14",
language = "English",
publisher = "University of Strathclyde",
type = "WorkingPaper",
institution = "University of Strathclyde",

}

Broby, D & Hopper, H 2019 'Creating a Financial Data Lake for Academic Fintech Research' University of Strathclyde, Glasgow.

Creating a Financial Data Lake for Academic Fintech Research. / Broby, Daniel; Hopper, Huckleberry.

Glasgow : University of Strathclyde, 2019.

Research output: Working paperOther working paper

TY - UNPB

T1 - Creating a Financial Data Lake for Academic Fintech Research

AU - Broby, Daniel

AU - Hopper, Huckleberry

PY - 2019/11/14

Y1 - 2019/11/14

N2 - This paper presents the case for a Financial Technology (Fintech) data lake. Fintech is impacting business models and its concepts require testing. The definition of Fintech is imprecise, but it is characterized by the use of technology as applied to digital financial transformation. The software and programming driving it is evolving and should be evaluated before being introduced into financial markets. Its development impacts "client money" and this can be risky unless supervised. Fortunately, such experimentation can be done in a controlled way using a regulatory sandbox. This allows Fintech concepts to be checked for reliability and robustness, using consenting live accounts (which receive a special regulatory exception). We propose a less risky supplementary approach, namely the testing of concepts on real but “blinded” financial big data files stored in a data lake. In this way, back-testing, out of sample experiments and forward performance checks can be done without the risk of losing money. We investigate how to implement such a data lake in order to do this.

AB - This paper presents the case for a Financial Technology (Fintech) data lake. Fintech is impacting business models and its concepts require testing. The definition of Fintech is imprecise, but it is characterized by the use of technology as applied to digital financial transformation. The software and programming driving it is evolving and should be evaluated before being introduced into financial markets. Its development impacts "client money" and this can be risky unless supervised. Fortunately, such experimentation can be done in a controlled way using a regulatory sandbox. This allows Fintech concepts to be checked for reliability and robustness, using consenting live accounts (which receive a special regulatory exception). We propose a less risky supplementary approach, namely the testing of concepts on real but “blinded” financial big data files stored in a data lake. In this way, back-testing, out of sample experiments and forward performance checks can be done without the risk of losing money. We investigate how to implement such a data lake in order to do this.

KW - Fintech

KW - strategy

KW - business models

KW - innovation

KW - financial services

KW - data lake

KW - data warehouses

UR - https://www.strath.ac.uk/business/accountingfinance/centreforfinancialregulationandinnovation/

M3 - Other working paper

BT - Creating a Financial Data Lake for Academic Fintech Research

PB - University of Strathclyde

CY - Glasgow

ER -

Broby D, Hopper H. Creating a Financial Data Lake for Academic Fintech Research. Glasgow: University of Strathclyde. 2019 Nov 14.