ru:event_mode_reference
Различия
Показаны различия между двумя версиями страницы.
Предыдущая версия справа и слеваПредыдущая версияСледующая версия | Предыдущая версия | ||
ru:event_mode_reference [2024/02/15 16:01] – kirilov | ru:event_mode_reference [2024/02/15 16:12] (текущий) – [Some important topics concerning instrument control software] kirilov | ||
---|---|---|---|
Строка 44: | Строка 44: | ||
<box 80% green> | <box 80% green> | ||
As a contribution to the European Spallation Source as part of BrightnESS, the Paul Scherrer Institut is involved in the streaming of EPICS data and the writing of NeXus compliant HDF5 files. We combine this development with the transition of the AMOR instrument at the Paul Scherrer Institut to EPICS and a streaming based data architecture. To guide our development before ESS has operational equipment, we use a detailed simulation of the instrument AMOR at SINQ to test and integrate our data streaming components. We convert EPICS data sources to Google FlatBuffers as our message format and distribute them using Apache Kafka. On the file writing side, we combine the messages from EPICS data sources as well as from neutron events to write HDF5 files at rates up to 4.8 GiB/s using Parallel HDF. This platform will also be used for testing the experiment control software on top of EPICS | As a contribution to the European Spallation Source as part of BrightnESS, the Paul Scherrer Institut is involved in the streaming of EPICS data and the writing of NeXus compliant HDF5 files. We combine this development with the transition of the AMOR instrument at the Paul Scherrer Institut to EPICS and a streaming based data architecture. To guide our development before ESS has operational equipment, we use a detailed simulation of the instrument AMOR at SINQ to test and integrate our data streaming components. We convert EPICS data sources to Google FlatBuffers as our message format and distribute them using Apache Kafka. On the file writing side, we combine the messages from EPICS data sources as well as from neutron events to write HDF5 files at rates up to 4.8 GiB/s using Parallel HDF. This platform will also be used for testing the experiment control software on top of EPICS | ||
+ | </ | ||
+ | |||
+ | * [[https:// | ||
+ | |||
+ | <box 80% green> | ||
+ | As part of the UK’s in-kind contribution to the European Spallation Source [1], ISIS [2] is working alongside the | ||
+ | ESS and other partners to develop a new data streaming system for managing and distributing neutron experiment | ||
+ | data. The new data streaming system is based on the open-source distributed streaming platform Apache Kafka [3]. | ||
+ | A central requirement of the system is to be able to supply live experiment data for processing and visualisation in near real-time via the Mantid data analysis framework [4]. There already exists a basic TCP socket-based data streaming system at ISIS, but it has limitations in terms of scalability, | ||
</ | </ | ||
[[index|Return to Contents]]\\ | [[index|Return to Contents]]\\ | ||
- | --- // | + | --- // |
ru/event_mode_reference.1708002077.txt.gz · Последнее изменение: — kirilov