Computing infrastructure, software optimization, and real time analysis for high data-rate MX

Macromolecular Crystallography (MX) is becoming a big data science straining the capabilities of computers and networks. New techniques of serial crystallography are allowing new science to be done but they are increasing the heterogeneity of the data that must be handled. Two new beamlines at the National Synchrotron Light Source-II, for Frontier Macromolecular Crystallography (FMX) and for highly Automated Macromolecular Crystallography (AMX), are beginning user operation in 2016, and are dealing with these big data issues. This work is contributing to a worldwide High Data-Rate Macromolecular Crystallography (HDRMX) collaboration among crystallographic software developers, beamline scientists and controls people to resolve these issues as new high-brightness beamlines and new fast X-ray detectors come into increasing use.