A subscription to JoVE is required to view this content. Sign in or start your free trial.

Method Article

Designing and Operating an In-House Cryogenic Electron Microscopy Facility with IT Infrastructure and On-the-Fly Data Processing Pipelines

154 views

⸱

DOI:

10.3791/71837

⸱

September 1st, 2026

 , 

In This Article

Summary

This protocol provides a practical framework for designing and operating the IT infrastructure of an in-house Cryogenic electron microscopy (cryo-EM) facility. It covers facility planning, network architecture, storage, GPU computing, remote access, and real-time data processing, enabling efficient management of multi-terabyte datasets while ensuring scalable, sustainable, and high-performance cryo-EM operations.

Abstract

Cryo-EM has become a dominant method for high-resolution structural determination of biological macromolecules. As the number of institutional cryo-EM facilities grows worldwide, a persistent challenge has emerged: the data infrastructure required to support these facilities is routinely underplanned. Modern cryo-EM instruments paired with direct electron detectors (DEDs) generate between 2 and 5 TB of raw data per day, and a 20-user facility can accumulate approximately 2 PB of data within a single operational year. Processing this data demands dedicated GPU computing nodes, high-speed internal networking, and robust long-term archival strategies—all of which must be in place before data collection begins. This protocol presents an integrated framework for the IT and computational design of an in-house cryo-EM facility. We cover physical facility requirements (room design, power, cooling, and vibration isolation), equipment selection (microscopes, DEDs, and supporting instruments), and the full computational stack: network switch configuration, storage server selection and sizing, GPU compute node provisioning, and remote access architecture. We then provide a detailed protocol for implementing on-the-fly data processing pipelines—covering motion correction, contrast transfer function (CTF) estimation, particle picking, and 2D classification in real time during data collection—using industry-standard tools. Data transfer strategies for external users are also addressed. This guide fills a critical gap in the literature and will enable researchers and administrators to build cryo-EM facilities that are computationally ready from day one.

Introduction

The cryo-EM resolution revolution has transformed structural biology, enabling atomic-resolution visualization of proteins, nucleic acids, and macromolecular complexes without the need for crystallization1,2. Three technical advances drove this transformation: the development of DEDs with high frame rates, improvements in electron optics and microscope mechanics, and the optimization of GPU-accelerated image processing software3,4,5,6. Together, these advances have made cryo-EM the m....

Access restricted. Please log in or start a trial to view this content.

Protocol

Details of the equipment, software, and materials used throughout this protocol are provided in the Table of Materials.

1. Physical facility design, personnel, and infrastructure planning

  1. Conduct a location assessment. Select a building site that provides: a vibration-isolated floor (ambient vibration levels, ideally < 1 µm/s RMS at 1–100 Hz); magnetic field stability (< 1 mG/m spatial gradient and < 0.1 mG/m temporal variation for 300 kV instruments); stable room temperature (18–22 °C with < 0.5 °C fluctuation); humidity control (40–60% RH); and ....

Access restricted. Please log in or start a trial to view this content.

Results

A successfully implemented facility IT infrastructure and on-the-fly data processing pipeline will produce the following verifiable outcomes at each stage:

Network and storage
Internal data transfer between the camera controller and storage server should sustain ≥800 MB/s (approaching theoretical 10 Gbps throughput) when measured with tools such as iperf3 or fio. This throughput is sufficient to transfer a 10–12 GB movie stack from the detector in under 15 seconds, ensurin.......

Access restricted. Please log in or start a trial to view this content.

Discussion

The IT infrastructure of a cryo-EM facility is not a supporting afterthought—it is an operational prerequisite. Facilities that begin data collection without adequate storage, networking, and processing capacity invariably face a choice between discarding raw data, halting data collection, or accepting months-long delays in structure determination. The protocols described here are designed to prevent these outcomes by ensuring that the computational backbone is designed, tested, and validated before the first user .......

Access restricted. Please log in or start a trial to view this content.

Disclosures

The authors declare no conflicts of interest.

Acknowledgements

The authors acknowledge the Biomolecular Cryo-Electron Microscopy Facility at the Department of Chemistry and Biochemistry of the University of California–Santa Cruz (RRID: SCR_021755) for scientific and technical support (NIH High-End Instrumentation program, S10OD02509).

....

Access restricted. Please log in or start a trial to view this content.

Materials

List of materials used in this article
NameCompanyCatalog NumberComments
Krios 5ThermoFisher Scientifichttps://www.thermofisher.com/us/en/home/electron-microscopy/products/transmission-electron-microscopes/krios-5-cryo-tem.htmlTransmission Electron Microscope
Krios G4ThermoFisher Scientifichttps://www.thermofisher.com/us/en/home/electron-microscopy/products/transmission-electron-microscopes/krios-g4-cryo-tem.htmlTransmission Electron Microscope
GlaciosThermoFisher Scientifichttps://www.thermofisher.com/us/en/home/electron-microscopy/products/transmission-electron-microscopes/glacios-cryo-tem.htmlTransmission Electron Microscope
Glacios 2ThermoFisher Scientifichttps://www.thermofisher.com/us/en/home/electron-microscopy/products/transmission-electron-microscopes/glacios-2-cryo-tem.htmlTransmission Electron Microscope
Glacios 3ThermoFisher Scientifichttps://www.thermofisher.com/ (newest generation; product page may vary by region)Transmission Electron Microscope
Talos ArcticaThermoFisher Scientifichttps://www.thermofisher.com/us/en/home/electron-microscopy/products/transmission-electron-microscopes/talos-arctica.htmlTransmission Electron Microscope
Talos L120CThermoFisher Scientifichttps://www.thermofisher.com/us/en/home/electron-microscopy/products/transmission-electron-microscopes/talos-l120c.htmlTransmission Electron Microscope
CRYO ARM 300 II (JEM-Z300FSC)JEOLhttps://www.jeol.com/products/scientific/tem/cryoarm300ii.phpTransmission Electron Microscope
CRYO ARM 200JEOLhttps://www.jeol.com/products/scientific/tem/cryoarm200.phpTransmission Electron Microscope
JEM-3200FSCJEOLhttps://www.jeol.com/products/scientific/tem/jem3200fsc.phpTransmission Electron Microscope
HF8300Hitachihttps://www.hitachi-hightech.com/global/en/products/microscopes/tem/hf8300.htmlTransmission Electron Microscope
HT7800Hitachihttps://www.hitachi-hightech.com/global/en/products/microscopes/tem/ht7800.htmlTransmission Electron Microscope
SU9000 (TEM/STEM)Hitachihttps://www.hitachi-hightech.com/global/en/products/microscopes/sem-tem/su9000.htmlTransmission Electron Microscope
Falcon 4iThermo Fisher Scientifichttps://www.thermofisher.com/us/en/home/electron-microscopy/products/direct-electron-detectors/falcon-4i.htmlDirect Electron Detector
Gatan K3Gatan (AMETEK)https://gatan.com/products/tem-cameras/k3-is-cameraDirect Electron Detector
Gatan K2Gatanhttps://gatan.com/products/tem-cameras/k2-cameraDirect Electron Detector
ApolloDirect Electronhttps://directelectron.com/apollo/Direct Electron Detector
DE64Direct Electronhttps://directelectron.com/de-64/Direct Electron Detector
RELIONMRC Laboratory of Molecular Biology (MRC-LMB), University of Cambridgehttps://relion.readthedocs.ioSPA software package
cryoSPARCStructura Biotechnologyhttps://cryosparc.comSPA software package
EMAN2Baylor College of Medicine (Developed by Steven Ludtke Lab)https://blake.bcm.edu/emanwiki/EMAN2SPA software package
cisTEMNational Research Council Canada (Developed by Tim Grant and colleagues)https://cistem.orgSPA software package
SPHIREMax Planck Institute of Molecular Physiology and Baylor College of Medicinehttps://sphire.mpg.deSPA software package
cryoDRGNPrinceton University (Developed by Ellen Zhong Lab)https://cryodrgn.cs.princeton.eduSPA software package
TopazHarvard Medical School (Developed by Travis Bepler Lab)https://github.com/tbepler/topazSPA software package
crYOLOMax Planck Institute of Biophysicshttps://cryolo.readthedocs.ioSPA software package
WarpMRC Laboratory of Molecular Biology (Developed by Dmitry Tegunov)http://www.warpem.comcryo-ET and STA software package
ModelAngeloMRC Laboratory of Molecular Biologyhttps://www.modelangelo.orgcryo-ET and STA software package
IMODUniversity of Colorado Boulderhttps://bio3d.colorado.edu/imodcryo-ET and STA software package
DynamoCentro Nacional de Biotecnología (CNB-CSIC)https://www.dynamo-em.orgcryo-ET and STA software package
emClarityUniversity of California, San Franciscohttps://github.com/StochasticAnalytics/emClaritycryo-ET and STA software package
RELION (ET module)MRC Laboratory of Molecular Biology (MRC-LMB), University of Cambridgehttps://relion.readthedocs.iocryo-ET and STA software package
EMAN2 (SPT)Baylor College of Medicinehttps://blake.bcm.edu/emanwiki/EMAN2cryo-ET and STA software package
Warp/MMRC Laboratory of Molecular Biologyhttps://warpem.github.iocryo-ET and STA software package
AreTomoStanford University (Developed by Fei Sun and Wah Chiu groups)https://github.com/czimaginginstitute/AreTomo2cryo-ET and STA software package
PEETUniversity of Colorado Boulderhttps://bio3d.colorado.edu/PEETcryo-ET and STA software package
PyTomMax Planck Institute of Biochemistryhttps://pytom.orgcryo-ET and STA software package
Tomo3DSpanish National Centre for Biotechnology (CNB-CSIC)https://sites.google.com/site/3demimageprocessing/tomo3dcryo-ET and STA software package
crYOLO (3D)Max Planck Institute of Biophysicshttps://cryolo.readthedocs.iocryo-ET and STA software package
AITomCarnegie Mellon Universityhttps://github.com/xulabs/aitomcryo-ET and STA software package
DIALSDiamond Light Source and collaboratorshttps://dials.github.iomicroED software package
XDSMax Planck Institute for Medical Research (Developed by Wolfgang Kabsch)https://xds.mr.mpg.demicroED software package
MOSFLMMRC Laboratory of Molecular Biology (MRC-LMB), University of Cambridgehttps://www.mrc-lmb.cam.ac.uk/mosflmmicroED software package
SHELXUniversity of Göttingen (Developed by George M. Sheldrick)https://shelx.uni-goettingen.demicroED software package
PhenixLawrence Berkeley National Laboratory (PHENIX Consortium)https://phenix-online.orgmicroED software package
CootMRC Laboratory of Molecular Biology (MRC-LMB), University of Cambridgehttps://www2.mrc-lmb.cam.ac.uk/personal/pemsley/cootmicroED software package
Linux (Ubuntu, CentOS/Rocky)Ubuntu: Canonical Ltd.; CentOS: CentOS Project; Rocky Linux: Rocky Enterprise Software Foundation (RESF)https://ubuntu.com / https://www.centos.org (legacy) /  https://rockylinux.orgOperational System
WindowsMicrosofthttps://www.microsoft.com/windowsOperational System
ZFSOracle Corporation (originally Sun Microsystems); OpenZFS maintained by the OpenZFS communityhttps://openzfs.orgFile System
NFSSun Microsystems (now maintained as an IETF standard)https://www.rfc-editor.org/rfc/rfc8881Protocol
SMB (CIFS)Microsofthttps://learn.microsoft.com/windows-server/storage/file-server/file-server-smb-overviewProtocol
Microsoft Remote Desktop (RDP)Microsofthttps://learn.microsoft.com/windows-server/remote/remote-desktop-servicesRemote Access
NoMachineNoMachinehttps://www.nomachine.comRemote Access
TeamViewerTeamViewer SEhttps://www.teamviewer.comRemote Access
VirtualGL + TurboVNCVirtualGL: The VirtualGL Project; TurboVNC: The TurboVNC Projecthttps://virtualgl.org and https://turbovnc.orgRemote Access
CUDANVIDIAhttps://developer.nvidia.com/cuda-toolkitComputer Framework

References

  1. Cheng Y, Grigorieff N, Penczek PA, Walz T. A primer to single-particle cryo-electron microscopy. Cell. 2015;161(3):438-449.
  2. Kühlbrandt W. Cryo-EM enters a new era. eLife. 2014;3:e03678.
  3. Alewijnse B, et al. Best practices for managing large CryoEM facilities. J Struct Biol. 2017;199(3):225-236.
  4. Walsh RM, et al. Practices for running a research-oriented shared cryo-EM facility. Front Mol Biosci. 2022;9:960940.
  5. Zimanyi CM, et al. Broadening access to cryoEM through centralized facilities. Trends Biochem Sci. 2022;47(2):106-116.
  6. Shell E, Minari K, Serrão VHB. From Icy Specimens to Digital Insights: Integrating Sample Preparati....

Access restricted. Please log in or start a trial to view this content.

Reprints and Permissions

Explore More Articles

Cryo-EM FacilityData InfrastructureGPU ComputingOn-The-Fly ProcessingMotion CorrectionCTF EstimationParticle Picking2D ClassificationData Archival

This article has been published

Video Coming Soon