Инструменты пользователя

Инструменты сайта



ru:event_mode_reference

Различия

Показаны различия между двумя версиями страницы.

Ссылка на это сравнение

Предыдущая версия справа и слеваПредыдущая версия
Следующая версия
Предыдущая версия
ru:event_mode_reference [2024/02/15 16:01] kirilovru:event_mode_reference [2024/02/15 16:12] (текущий) – [Some important topics concerning instrument control software] kirilov
Строка 44: Строка 44:
 <box 80% green> <box 80% green>
 As a contribution to the European Spallation Source as part of BrightnESS, the Paul Scherrer Institut is involved in the streaming of EPICS data and the writing of NeXus compliant HDF5 files. We combine this development with the transition of the AMOR instrument at the Paul Scherrer Institut to EPICS and a streaming based data architecture. To guide our development before ESS has operational equipment, we use a detailed simulation of the instrument AMOR at SINQ to test and integrate our data streaming components. We convert EPICS data sources to Google FlatBuffers as our message format and distribute them using Apache Kafka. On the file writing side, we combine the messages from EPICS data sources as well as from neutron events to write HDF5 files at rates up to 4.8 GiB/s using Parallel HDF. This platform will also be used for testing the experiment control software on top of EPICS As a contribution to the European Spallation Source as part of BrightnESS, the Paul Scherrer Institut is involved in the streaming of EPICS data and the writing of NeXus compliant HDF5 files. We combine this development with the transition of the AMOR instrument at the Paul Scherrer Institut to EPICS and a streaming based data architecture. To guide our development before ESS has operational equipment, we use a detailed simulation of the instrument AMOR at SINQ to test and integrate our data streaming components. We convert EPICS data sources to Google FlatBuffers as our message format and distribute them using Apache Kafka. On the file writing side, we combine the messages from EPICS data sources as well as from neutron events to write HDF5 files at rates up to 4.8 GiB/s using Parallel HDF. This platform will also be used for testing the experiment control software on top of EPICS
 +</box>
 +
 +  * [[https://accelconf.web.cern.ch/icalepcs2017/papers/tupha029.pdf|LIVE VISUALISATION OF EXPERIMENT DATA AT ISIS AND THE ESS]] **M.J.Clarke, F.A.Akeroyd, L.A Moore, et al.  (2017) **
 +
 +<box 80% green>
 +As part of the UK’s in-kind contribution to the European Spallation Source [1], ISIS [2] is working alongside the
 +ESS and other partners to develop a new data streaming system for managing and distributing neutron experiment
 +data. The new data streaming system is based on the open-source distributed streaming platform Apache Kafka [3].
 +A central requirement of the system is to be able to supply live experiment data for processing and visualisation in near real-time via the Mantid data analysis framework [4]. There already exists a basic TCP socket-based data streaming system at ISIS, but it has limitations in terms of scalability, reliability and functionality. The intention is for the new Kafka-based system to replace the existing system at ISIS. This migration will not only provide enhanced functionality for ISIS but also an opportunity for developing and testing the system prior to use at the ESS.
 </box> </box>
  
 [[index|Return to Contents]]\\ [[index|Return to Contents]]\\
  
- --- //[[akirilov@nf.jinr.ru|kirilov]] 2024/02/15 11:41//+ --- //[[akirilov@nf.jinr.ru|kirilov]] 2024/02/15 16:11//
ru/event_mode_reference.1708002077.txt.gz · Последнее изменение: kirilov