guest ::
| Home > Documents in process > Toward Particle Accelerator Machine State Embeddings as a Modality for Large Language Models |
| Home > Documents in process > Toward Particle Accelerator Machine State Embeddings as a Modality for Large Language Models |
| Contribution to a conference proceedings | PUBDB-2025-03902 |
; ; ;
2025
This record in other databases:
Please use a persistent id in citations: doi:10.18429/JACoW-ICALEPCS2025-WEPD082
Abstract: Understanding and diagnosing the state of a particle accelerator requires navigating high-dimensional control system data, often involving hundreds of interdependent parameters. We propose a novel multimodal embedding framework that jointly learns representations of machine states from both numerical control system readouts and natural language descriptions. This enables the translation of complex machine conditions into human-readable summaries while maintaining fidelity to the underlying physical system. The obtained embeddings are subsequently adapted to an open-weights large language model via cross-attention conditioning. We demonstrate a first implementation trained on European XFEL machine state data. This work covers the embedding model architecture, training methodology, and presents initial examples demonstrating the model's capabilities in action. Due to the general concept of machine state, the model can be easily adapted to other facilities and control system environments.
|
The record appears in these collections: |
PDF
PDF (PDFA)