SciStream: Architecture and Toolkit for Data Streaming between Federated Science Instrument

Rajkumar Kettimuthu
TrackTrack 1
DescriptionModern scientific instruments generate data at such high rates that online processing is needed for data reduction, feature detection, and experiment steering. These rates also demand memory-to-memory streaming from instrument to remote computer, because local computational capacity is limited and data transmissions that engage file system introduce unacceptable latencies. Such data streaming is challenging to realize in practice because of lack of direct external network connectivity for scientific instruments; and authentication/security requirements. We propose SciStream, a middlebox-based architecture with control protocols to enable secure data streaming from producer’s memory at one facility to consumer’s memory at another remote facility.

Presentation documents

All talks