DA-HPC-OR: Data Analytics for Improved HPC Operations and Research
Third-party funded project
Project title DA-HPC-OR: Data Analytics for Improved HPC Operations and Research
Principal Investigator(s) Ciorba, Florina M.
Co-Investigator(s) Gless, Sabine
Schneider, Gerhard
von Suchodoletz, Dirk
Lachiche, Nicolas
Samet, Ahmed
Sengstag, Thierry
Project Members Cavelan, Aurélien
Daedelow, Romy
Organisation / Research unit Departement Mathematik und Informatik / High Performance Computing (Ciorba)
Project Website http://hpc.dmi.unibas.ch/HPC/DA-HPC-OR.html
Project start 01.09.2018
Probable end 29.02.2020
Status Completed
Abstract

Analysis of data from high performance computing (HPC) systems to improve HPC operations and research is an unsolved problem. This project addresses the challenge of HPC data analysis in a reproducible and legal manner. The data originates in the HPC systems of the consortium: NEMO at University of Freiburg (NEMO-UniFR), sciCORE at University of Basel (sciCORE‑UniBas), and HPC at University of Strasbourg (HPC‑UniStra).

The goals of the project are to analyze the data collected at NEMO‑UniFR to improve their research and operations activities, and to offer monitoring, operational, and research insights to also improve the sciCORE-UniBas and HPC-UniStra activities. The proposed approach entails: monitoring of systems and applications; legal compliance via de-identification and anonymization; and data analysis. The methods used include: HPC monitoring, legal controlling, de‑identification, anonymization, data aggregation, data mining, and insight extraction.

The outcome will be solutions for improving the HPC operations and research of three Eucor HPC centers and satisfy the data protection and privacy requirements. The solutions are significant and transferable to other Eucor member institutions for the benefit of no/minimal legislative inquiries and data management overhead.

Financed by Other sources
Follow-up project of 3378826 Studying the Resilience of Applications and High Performance Computers
   

MCSS v5.8 PRO. 0.471 sec, queries - 0.000 sec ©Universität Basel  |  Impressum   |    
14/08/2020