Naslov
Study of Data Transfer Nodes Infrastructure in Enabling Big Data Movement between Research and Cloud Storage Networks

Autori
Regvart, Damir ; Mikuc, Miljenko ; Dakić, Vedran

Vrsta, podvrsta i kategorija rada
Radovi u zbornicima skupova, cjeloviti rad (in extenso), znanstveni

Izvornik
MIPRO 2023 46th ICT and Electronics Convention proceedings / - , 2023, 523-527

Skup
46th ICT and Electronics Convention – MIPRO 2023

Mjesto i datum
Opatija, Hrvatska, 22.05.2023. - 26.05.2023

Vrsta sudjelovanja
Predavanje

Vrsta recenzije
Međunarodna recenzija

Ključne riječi
DTN (Data Transfer Node), Science DMZ (Demilitarized Zone), big data transfer, orchestration of data streams

Sažetak
Data research projects generate huge amounts of data, which are usually stored in cloud networks for processing and storage. Transferring large amounts of data between multiple research sites, often within protected scientific DMZs (Demilitarized Zone) and cloud storage nodes, requires high-speed network connections. To ensure efficient data transfer and processing, parallel data streams are used between multiple research sites, with dedicated cloud infrastructure for processing and storage of a particular experiment. Since multiple nodes or sites are involved in data transfer, DTNs (Data Transfer Nodes) are used to solve the problems of fast data flow and performance between nodes that are not related to network throughput. DTNs include software transfer tools and highend hardware components that are tasked with preparing data for transfer. Several research groups are working to establish multiple DTN instances as part of a large-scale scientific data network. This paper provides a brief overview of the current state of the art in the use of DTN infrastructure and the challenges associated with preparing data for transfer.

Izvorni jezik
Engleski

Znanstvena područja
Računarstvo, Temeljne tehničke znanosti, Interdisciplinarne tehničke znanosti, Informacijske i komunikacijske znanosti

POVEZANOST RADA