7. Data management
Content: Due to the arrival of new technologies to easily generate masses of data, research has shifted from compute-intensive research to data-intensive research. Thus, data management has become a vital part of the research process. In this course, we will give you an overview of the services available for researchers in the Netherlands. Specifically, we will focus on SURFsara’s archive service, a service easily reachable from SURFsara’s compute infrastructure.
In the first part of the hands-on, you will gather experience with graphical user interfaces that help you to move your data and you will learn about their limitations.
In the second part of the hands-on, you will become familiar with data transfer protocols and their command line tools. Furthermore, we will show you tools to organise and package your data and how you can incorporate data movement and management into your workflows and computational pipelines.
- Duration: 4 hours
- Date and Time: see Schedule.
- Location: Science Park 904, Room: see Schedule.
- Target group:
- Prerequisites: Knowledge of bash/shell, Knowledge of python
- Course Presenter: Claudia Behnke / Arthur Newton / Narges Zarrabi (Surfsara)