guest ::
| Home > Publications database > Compression and data reduction in serial crystallography > print |
| 001 | 632810 | ||
| 005 | 20250725213732.0 | ||
| 024 | 7 | _ | |a 10.1107/S2053273323095244 |2 doi |
| 024 | 7 | _ | |a 0108-7673 |2 ISSN |
| 024 | 7 | _ | |a 0567-7394 |2 ISSN |
| 024 | 7 | _ | |a 1600-5724 |2 ISSN |
| 024 | 7 | _ | |a 1600-8596 |2 ISSN |
| 024 | 7 | _ | |a 2053-2733 |2 ISSN |
| 037 | _ | _ | |a PUBDB-2025-02235 |
| 041 | _ | _ | |a English |
| 082 | _ | _ | |a 530 |
| 100 | 1 | _ | |a Galchenkova, Marina |0 P:(DE-H253)PIP1081165 |b 0 |
| 111 | 2 | _ | |a Twenty-Sixth Congress and General Assembly of the International Union of Crystallography |g IUCr 2023 |c Melbourne |d 2023-08-22 - 2023-08-29 |w Australia |
| 245 | _ | _ | |a Compression and data reduction in serial crystallography |
| 260 | _ | _ | |c 2023 |
| 336 | 7 | _ | |a Abstract |b abstract |m abstract |0 PUB:(DE-HGF)1 |s 1753430774_2691238 |2 PUB:(DE-HGF) |
| 336 | 7 | _ | |a Conference Paper |0 33 |2 EndNote |
| 336 | 7 | _ | |a INPROCEEDINGS |2 BibTeX |
| 336 | 7 | _ | |a conferenceObject |2 DRIVER |
| 336 | 7 | _ | |a Output Types/Conference Abstract |2 DataCite |
| 336 | 7 | _ | |a OTHER |2 ORCID |
| 520 | _ | _ | |a Protein crystallography is one of the most successful methods for biological structure determination. This technique requires many diffraction snapshots to get 3D structural information of the studied protein. Even more patterns are needed for studying fast protein dynamics that can be achieved using serial crystallography (SX). Fortunately, new X-ray facilities such as 4th generation synchrotrons and Free Electron Lasers (FELs) combined with newly developed X-ray detectors opened a way to carry out these experiments at a rate of more than 1000 images per second. The drawback of this increase in acquisition rate is the volume of collected data - up to 2 PB of data per experiment could be easily obtained. Therefore, new data reduction strategies have to be developed and deployed. Lossless data reduction methods will not change the data, but usually fail to achieve a high compression ratio. On the other hand, lossy compression methods can significantly reduce the amount of data, but they require careful evaluation of the resulting data quality. We have tested different approaches for both lossless and lossy compression applied to SX data, proposed some new ways for lossy compression and demonstrated appropriate methods for data quality assessment. By checking the resulting statistics of compressed data (like CC*/Rsplit, Rfree/Rwork) we have demonstrated that the volume of the measured data can be greatly reduced (10-100 times!) while the quality of the resulting data was kept almost constant. In addition, we tested lossy compression methods on the SAD dataset (thaumatin collected at 4.57 keV, measured at the SwissFEL) and demonstrated that even such very sensitive data can be successfully compressed. It allowed us to determine the limit of application for all considered lossy compressions. Some of the proposed compression strategies, tested on SX and MX datasets, can be used for other types of experiments, even with different sources (for example electron and neutron diffraction). |
| 536 | _ | _ | |a 633 - Life Sciences – Building Blocks of Life: Structure and Function (POF4-633) |0 G:(DE-HGF)POF4-633 |c POF4-633 |f POF IV |x 0 |
| 536 | _ | _ | |a AIM, DFG project G:(GEPRIS)390715994 - EXC 2056: CUI: Advanced Imaging of Matter (390715994) |0 G:(GEPRIS)390715994 |c 390715994 |x 1 |
| 588 | _ | _ | |a Dataset connected to CrossRef, Journals: bib-pubdb1.desy.de |
| 693 | _ | _ | |a PETRA III |f PETRA Beamline P11 |1 EXP:(DE-H253)PETRAIII-20150101 |0 EXP:(DE-H253)P-P11-20150101 |6 EXP:(DE-H253)P-P11-20150101 |x 0 |
| 700 | 1 | _ | |a Tolstikova, A. |0 P:(DE-H253)PIP1020246 |b 1 |
| 700 | 1 | _ | |a Oberthuer, D. |0 P:(DE-H253)PIP1012087 |b 2 |
| 700 | 1 | _ | |a Sprenger, J. |0 P:(DE-H253)PIP1015903 |b 3 |
| 700 | 1 | _ | |a Brehm, Wolfgang |0 P:(DE-H253)PIP1033390 |b 4 |
| 700 | 1 | _ | |a White, T. A. |0 P:(DE-H253)PIP1010779 |b 5 |
| 700 | 1 | _ | |a Barty, Anton |0 P:(DE-H253)PIP1008245 |b 6 |
| 700 | 1 | _ | |a Chapman, H. N. |0 P:(DE-H253)PIP1006324 |b 7 |
| 700 | 1 | _ | |a Yefanov, Oleksandr |0 P:(DE-H253)PIP1006155 |b 8 |e Corresponding author |u desy |
| 773 | _ | _ | |a 10.1107/S2053273323095244 |0 PERI:(DE-600)2020844-3 |y 2023 |g Vol. 79, no. a2, p. C85 - C85 |x 2053-2733 |
| 856 | 4 | _ | |u https://bib-pubdb1.desy.de/record/632810/files/a62355.pdf |y Restricted |
| 856 | 4 | _ | |u https://bib-pubdb1.desy.de/record/632810/files/a62355.pdf?subformat=pdfa |x pdfa |y Restricted |
| 909 | C | O | |o oai:bib-pubdb1.desy.de:632810 |p VDB |
| 910 | 1 | _ | |a Deutsches Elektronen-Synchrotron |0 I:(DE-588b)2008985-5 |k DESY |b 0 |6 P:(DE-H253)PIP1081165 |
| 910 | 1 | _ | |a Centre for Free-Electron Laser Science |0 I:(DE-H253)_CFEL-20120731 |k CFEL |b 0 |6 P:(DE-H253)PIP1081165 |
| 910 | 1 | _ | |a European XFEL |0 I:(DE-588)1043621512 |k XFEL.EU |b 0 |6 P:(DE-H253)PIP1081165 |
| 910 | 1 | _ | |a Deutsches Elektronen-Synchrotron |0 I:(DE-588b)2008985-5 |k DESY |b 1 |6 P:(DE-H253)PIP1020246 |
| 910 | 1 | _ | |a European XFEL |0 I:(DE-588)1043621512 |k XFEL.EU |b 1 |6 P:(DE-H253)PIP1020246 |
| 910 | 1 | _ | |a Deutsches Elektronen-Synchrotron |0 I:(DE-588b)2008985-5 |k DESY |b 2 |6 P:(DE-H253)PIP1012087 |
| 910 | 1 | _ | |a Centre for Free-Electron Laser Science |0 I:(DE-H253)_CFEL-20120731 |k CFEL |b 2 |6 P:(DE-H253)PIP1012087 |
| 910 | 1 | _ | |a European XFEL |0 I:(DE-588)1043621512 |k XFEL.EU |b 2 |6 P:(DE-H253)PIP1012087 |
| 910 | 1 | _ | |a Deutsches Elektronen-Synchrotron |0 I:(DE-588b)2008985-5 |k DESY |b 3 |6 P:(DE-H253)PIP1015903 |
| 910 | 1 | _ | |a Centre for Free-Electron Laser Science |0 I:(DE-H253)_CFEL-20120731 |k CFEL |b 3 |6 P:(DE-H253)PIP1015903 |
| 910 | 1 | _ | |a Deutsches Elektronen-Synchrotron |0 I:(DE-588b)2008985-5 |k DESY |b 4 |6 P:(DE-H253)PIP1033390 |
| 910 | 1 | _ | |a Centre for Free-Electron Laser Science |0 I:(DE-H253)_CFEL-20120731 |k CFEL |b 4 |6 P:(DE-H253)PIP1033390 |
| 910 | 1 | _ | |a Deutsches Elektronen-Synchrotron |0 I:(DE-588b)2008985-5 |k DESY |b 5 |6 P:(DE-H253)PIP1010779 |
| 910 | 1 | _ | |a Centre for Free-Electron Laser Science |0 I:(DE-H253)_CFEL-20120731 |k CFEL |b 5 |6 P:(DE-H253)PIP1010779 |
| 910 | 1 | _ | |a European XFEL |0 I:(DE-588)1043621512 |k XFEL.EU |b 5 |6 P:(DE-H253)PIP1010779 |
| 910 | 1 | _ | |a Deutsches Elektronen-Synchrotron |0 I:(DE-588b)2008985-5 |k DESY |b 6 |6 P:(DE-H253)PIP1008245 |
| 910 | 1 | _ | |a European XFEL |0 I:(DE-588)1043621512 |k XFEL.EU |b 6 |6 P:(DE-H253)PIP1008245 |
| 910 | 1 | _ | |a Deutsches Elektronen-Synchrotron |0 I:(DE-588b)2008985-5 |k DESY |b 7 |6 P:(DE-H253)PIP1006324 |
| 910 | 1 | _ | |a Centre for Free-Electron Laser Science |0 I:(DE-H253)_CFEL-20120731 |k CFEL |b 7 |6 P:(DE-H253)PIP1006324 |
| 910 | 1 | _ | |a European XFEL |0 I:(DE-588)1043621512 |k XFEL.EU |b 7 |6 P:(DE-H253)PIP1006324 |
| 910 | 1 | _ | |a Deutsches Elektronen-Synchrotron |0 I:(DE-588b)2008985-5 |k DESY |b 8 |6 P:(DE-H253)PIP1006155 |
| 910 | 1 | _ | |a Centre for Free-Electron Laser Science |0 I:(DE-H253)_CFEL-20120731 |k CFEL |b 8 |6 P:(DE-H253)PIP1006155 |
| 910 | 1 | _ | |a European XFEL |0 I:(DE-588)1043621512 |k XFEL.EU |b 8 |6 P:(DE-H253)PIP1006155 |
| 913 | 1 | _ | |a DE-HGF |b Forschungsbereich Materie |l Von Materie zu Materialien und Leben |1 G:(DE-HGF)POF4-630 |0 G:(DE-HGF)POF4-633 |3 G:(DE-HGF)POF4 |2 G:(DE-HGF)POF4-600 |4 G:(DE-HGF)POF |v Life Sciences – Building Blocks of Life: Structure and Function |x 0 |
| 915 | _ | _ | |a Nationallizenz |0 StatID:(DE-HGF)0420 |2 StatID |d 2024-12-21 |w ger |
| 915 | _ | _ | |a DEAL Wiley |0 StatID:(DE-HGF)3001 |2 StatID |d 2024-12-21 |w ger |
| 915 | _ | _ | |a DBCoverage |0 StatID:(DE-HGF)0200 |2 StatID |b SCOPUS |d 2024-12-21 |
| 915 | _ | _ | |a DBCoverage |0 StatID:(DE-HGF)0300 |2 StatID |b Medline |d 2024-12-21 |
| 915 | _ | _ | |a DBCoverage |0 StatID:(DE-HGF)0600 |2 StatID |b Ebsco Academic Search |d 2024-12-21 |
| 915 | _ | _ | |a Peer Review |0 StatID:(DE-HGF)0030 |2 StatID |b ASC |d 2024-12-21 |
| 915 | _ | _ | |a DBCoverage |0 StatID:(DE-HGF)0199 |2 StatID |b Clarivate Analytics Master Journal List |d 2024-12-21 |
| 915 | _ | _ | |a DBCoverage |0 StatID:(DE-HGF)1150 |2 StatID |b Current Contents - Physical, Chemical and Earth Sciences |d 2024-12-21 |
| 915 | _ | _ | |a DBCoverage |0 StatID:(DE-HGF)0160 |2 StatID |b Essential Science Indicators |d 2024-12-21 |
| 915 | _ | _ | |a WoS |0 StatID:(DE-HGF)0113 |2 StatID |b Science Citation Index Expanded |d 2024-12-21 |
| 915 | _ | _ | |a DBCoverage |0 StatID:(DE-HGF)0150 |2 StatID |b Web of Science Core Collection |d 2024-12-21 |
| 920 | 1 | _ | |0 I:(DE-H253)FS-CFEL-1-BMX-20210408 |k FS-CFEL-1-BMX |l FS-CFEL-1 Fachgruppe BMX |x 0 |
| 920 | 1 | _ | |0 I:(DE-H253)CFEL-I-20161114 |k CFEL-I |l FS-CFEL-1 (Group Leader: Henry Chapman) |x 1 |
| 920 | 1 | _ | |0 I:(DE-H253)FS-SC-20210408 |k FS-SC |l Scientific computing |x 2 |
| 980 | _ | _ | |a abstract |
| 980 | _ | _ | |a VDB |
| 980 | _ | _ | |a I:(DE-H253)FS-CFEL-1-BMX-20210408 |
| 980 | _ | _ | |a I:(DE-H253)CFEL-I-20161114 |
| 980 | _ | _ | |a I:(DE-H253)FS-SC-20210408 |
| 980 | _ | _ | |a UNRESTRICTED |
| Library | Collection | CLSMajor | CLSMinor | Language | Author |
|---|