Parts | Days | Selection | Search | Updates | Downloads | Help

AKjDPG: Arbeitsgruppe junge DPG

AKjDPG 2: Hacky Hour (joint session AKjDPG/AGI)

AKjDPG 2.2: Talk

Thursday, March 23, 2023, 14:45–15:30, ZEU/0148

Hands-on data management with open-source software: CaosDB — •Florian Spreckelsen and Daniel Hornung — IndiScale GmbH, Göttingen, Germany

Data management involves the storing, searching, retrieving and analyzing of data sets and their connections and circumstances. Good data management makes valuable data reusable, for current and future users. It also makes data findable (Where is the training data for sensor X of setup Y again?) and adds real utility to data, because data can be embedded into context (Which experimental settings were used for obtaining the data for project P, and how many failures were there?).

The open-source toolkit CaosDB is a practical implementation of an agile data management approach designed to handle all these tasks, and much more: The structure of data can be modified later without losing old information and without the need to migrate existing data. This encourages agile implementation of data management workflows instead of delaying until the perfect master plan is ready. And CaosDB comes with a powerful Python client, so access is as easy as a few lines of code. This session consists of a short live demonstration of the CaosDB Python client, and participants are encouraged to follow along on their own machines. For this, they can install CaosDB’s Python library and additional tools with pip install caosdb caosadvancedtools and make sure that they can load the library in Python with import caosdb. A Jupyter notebook will be made available online before the session.