Historical Cross-Country Company Data on Pi.Kappa_

Data extraction and matching: The EurHisFirm experience

Mon, 01 Jan 0001 00:00:00 +0000

Adam, S., Annaert, J., Buelens, F., Couasnon, B. B., Cule, B., de Vicq, A., Guerry, C., Hautcoeur, P.-C., Paquet, T., Rojas Camacho, A., Le Floch, I., Lemaitre, A., Karapanagiotis, P., Poukens, J., & Riva, A. (2021). Data extraction and matching: The EurHisFirm experience. Methodological Advances in the Extraction and Analysis of Historical Data. Kellogg School of Management - Northwestern University. https://hal.archives-ouvertes.fr/hal-03828381

This paper reports results from the design phase of EurHisFirm. Its goal is to integrate isolated and badly accessible financial data sets on 19 th and 20 th century European companies so that users can query the data as if they reside in one large database. In addition, it wants to stimulate database construction by providing not only methodology and tools to connect to and collaborate with existing ones, but also a collaborative platform, based on machine learning and artificial intelligence, that allows harvesting data in a semi-automatic way. We present the proof-of-concept results of this platform in addition to the performance of matching algorithms, which are necessary to connect and collate the different constituent databases as well as to connect them to contemporary commercial databases.

An Extensible Model for Historical Financial Data with an Application to German Company and Stock Market Data

Mon, 01 Jan 0001 00:00:00 +0000

Gram, D., Karapanagiotis, P., Krzyzanowski, J., Liebald, M., & Walz, U. (2021). An Extensible Model for Historical Financial Data with an Application to German Company and Stock Market Data. Proceedings of the ICTeSSH 2021 Conference. https://doi.org/10.21428/7a45813f.553a9b40

Broad, long-term financial, and economic datasets are a scarce resource, particularly in the European context. In this paper, we present an approach for an extensible data model that is adaptable to future changes in technologies and sources. This model may constitute a basis for digitised and structured long-term historical datasets. The data model covers the specific peculiarities of historical financial and economic data and is flexible enough to reach out for data of different types (quantitative as well as qualitative) from different historical sources, hence, achieving extensibility. Furthermore, based on historical German firm and stock market data, we discuss a relational implementation of this approach.

Technical Document on National Data Models

Mon, 01 Jan 0001 00:00:00 +0000

Karapanagiotis, P. (2019). Technical Document on National Data Models. EurHisFirm Deliverable 5.1. https://doi.org/10.5281/zenodo.3467926

The report reviews a selection of existing micro-level data-model implementations both from within as well as outside the consortium's countries and identifies best design practices. It proposes preliminary model concepts for EURHISFIRM's metadata scheme and evaluation criteria for assessing the effectiveness of historical, cross-country, company-level data models. Since there is no precedence in designing such models, the report methodologically introduces a conceptual 2-dimensional separation on the information space that EURHISFIRM's model aims to cover and reviews representative implementations from each subpart. The first dimension concerns the time domain. In this dimension, the reviewed models are classified either as contemporary or as historical. The second dimension concerns the cross-country domain. Models here are classified either as national or as international. The analysis constitutes one fundamental block upon which the process of synthesizing national models into a unified European common model builds.

Technical Document on Preliminary Common Data Model

Mon, 01 Jan 0001 00:00:00 +0000

Karapanagiotis, P. (2020). Technical Document on Preliminary Common Data Model. EurHisFirm Deliverable 5.2. https://doi.org/10.5281/zenodo.3686930

The second report of Work Package 5 completes the discussion of the preliminary back-end design concepts of the common data model. The approach of the report is characterized by the principle of least intrusiveness. The proposed solutions respect national idiosyncrasies and allow national centers to advance in a collaborative but independent manner. The report starts by reviewing the data formats of the countries of the consortium. It draws from identification theory and proposes appropriate principles and requirements for the common model’s identification design. It examines the functional and informational requirements for identifying various data items and for linking historical data from within the consortium to external databases with contemporary data. It outlines that the common model’s implementation mostly benefits from employing both relational and non-relational technologies to address different issues. It highlights appropriate, subsequent steps for cross-country harmonization, firm-linking, data transformation processes, and data governance.

Updated Technical Document on the Preliminary Data Model

Mon, 01 Jan 0001 00:00:00 +0000

Ranft, L. M., Karapanagiotis, P., Braswell, J., & König, W. (2021). Updated Technical Document on the Preliminary Data Model. EurHisFirm Deliverable 5.4. https://doi.org/10.5281/zenodo.4724802

The fourth report of Work Package 5 provides the latest revisions of the Common Data Model standard specifications. The different foundational elements of the Common Data Model are presented and explained. The report also summarises the results of stakeholder feedback and describes their implications on the Common Data Model. Finally, we give an outlook on the further development of the Common Data Model and its components.