多模态自适应光学显微镜:从分子到生物体的活体成像
Multimodal adaptive optical microscope: in vivo imaging, molecules to organisms

原始链接: https://www.nature.com/articles/s41592-026-03066-1

MOSAIC(用于精确成像和校正的多模态光学系统)显微镜是一个为高级生物成像设计的多功能高性能平台。它将多种成像模式集成于一台高度可配置的仪器中,包括晶格光片显微镜(LLSM)、结构光照明显微镜(SIM)、双光子显微镜(TPM)和线扫描图像扫描显微镜(ISM)。 其核心硬件特征包括:定制的七色激光合束器、用于灵活激发图案化的样品共轭空间光调制器(SLM),以及用于同步多色光片投射的复杂二向色镜组。该系统利用电动载物台和振镜-共振扫描仪进行精确的三维样本操控和快速扫描。 为确保成像质量,MOSAIC 在激发和检测路径中均采用了先进的自适应光学(AO)技术,利用导星法和夏克-哈特曼波前传感技术来校正系统和样本引起的像差。一套定制的 LabVIEW 软件用于管理硬件控制、多位置采集和系统校准。 该平台包含全面的图像处理流程,集成了反卷积、去噪、运动稳定和多模态配准功能,以处理复杂数据集。详细的 CAD 模型和操作指南可通过霍华德·休斯医学研究所(HHMI)的免费研究许可获取。

Hacker News 最新 | 过往 | 评论 | 提问 | 展示 | 招聘 | 投稿 登录 多模态自适应光学显微镜:从分子到生物体的活体成像 (nature.com) 5 分,由 bookofjoe 在 2 小时前发布 | 隐藏 | 过往 | 收藏 | 讨论 帮助 指南 | 常见问题 | 列表 | API | 安全 | 法律 | 申请 YC | 联系 搜索:
相关文章

原文

Microscope hardware

A complete MOSAIC CAD model, bill of materials, and nearly 1,000 pages of installation, maintenance and operation instructions are available through a no-cost research license agreement with Howard Hughes Medical Institute (HHMI).

Excitation sources

Visible lasers 405 nm, 100 mW (TOPTICA, IBEAM-SMART-405-S-BZ), 445 nm, 100 mW (IBEAM-SMART-445-S-BZ), 488 nm, 500 mW (MPB, 2RU-VFL-P-500-488-B1R), 514 nm, 1,000 mW (MPB, 2RU-VFL-P-1000-514-B1R), 560 nm, 1,000 mW (MPB, 2RU-VFL-P-1000-560-B1R), 607 nm, 1,000 mW (MPB, 2RU-VFL-P-1000-607-B1R) and 642 nm, 2,000 mW (MPB, 2RU-VFL-P-2000-6224-B1R) were coaligned in a custom laser combiner and passed through an Acousto-Optic Tunable Filter (AOTF; AA Optoelectronic, AOTFnC-400.650-CPCh-TN) driven via a four-channel Multi-Purpose Digital Synthesizer (AA, MPDS4C-B66-22-52.111) which allowed rapid, independent control of their laser amplitudes. The output beam from the AOTF was then sent free-space to the downstream optics.

The femtosecond laser used for TPM (Coherent Chameleon LS II, tunable from 680 nm to 1,080 nm, peak power >3.5 W) was first corrected for group velocity dispersion (GVD) via a prism compressor (Thorlabs) before passing through an infrared Acousto-Optic Modulator System (AOM; AA, MT110-B50A1.5-IR-Hk driven via MPDS1C-B6-34-85.135) to control the output power delivered to the downstream optics.

Spatial light modulator

A sample-conjugate SLM (Meadowlark P1920-0635-HDMI, 1,920 × 1,152 pixels) served multiple roles in MOSAIC: generation of LLS and 3D-SIM excitation patterns, five-axis alignment of the LLS to the detection focal plane, laser blanking, excitation AO correction, 3D phase modulation, light-sheet collimation and chromatic correction, and patterned photoactivation.

Mask

A motorized custom glass wheel with a circumferential series of different photolithographically produced patterned metallic masks (Thorlabs) specific to different light sheets or SIM patterns was used to pass only the desired first-order diffracted light while blocking the unwanted zeroth and higher orders.

Dichroic stack

To create a multicolor LLS, the collinear Gaussian beam from the laser combiner was transformed by a Powell lens/cylindrical lens combination (Supplementary Fig. 2a) into a collinear multicolor Gaussian light sheet, which was then spatially separated by a ‘dichroic stack’ (Supplementary Fig. 5a) into seven parallel light sheets that each impinge at separate locations on the SLM. The phase-only SLM imparted individually addressed phase delay patterns for each color and the resulting patterned LLSs reflected from the SLM back to the dichroic stack where the spatial offset was reversed, recombining into a collinear, multicolor set of up to seven overlapping LLSs that were ultimately relayed to the sample. The stack was a custom product (AVR Optics) constructed by sandwiching an ordered parallel set of laser dichroic filters (405, 442, 488, 532, 561 and 635 nm) and a mirror (to reflect any unfiltered light) using fused silica spacers (250 ± 50 µm) between layers.

Beam scanning

A pupil-conjugate X-scan galvo (Cambridge Technology, 6SD11587) with a 60° optical range had two duties: it both selected the beam path (and therefore the objective) to illuminate, and translated the excitation (LLS, 3D phase, SIM, ISM or TPM) at the sample plane of the chosen objective. A pupil-conjugate z-scan galvo (Cambridge Technology, 6215H series, 6SD11226) moved the excitation orthogonal to x. A sample-conjugate 4-kHz resonant scanner (Cambridge Technology, CRS series, 6SC04KA040-01Y) wobbled the illumination (light sheet or 3D phase) to reduce shadowing artifacts from absorption or scattering within the specimen upstream of the viewed area, and a pupil-conjugate 4-kHz resonant scanner (Cambridge Technology, CRS series, 6SC08KA040-02Y) rapidly scanned a TPM-generated guide star (GS) in x across a desired FOV for measurement of sample-induced aberrations, or during TPM point scanning and TPM Bessel beam imaging.

Detectors

For all imaging modes except TPM, two-color channels could be simultaneously recorded with a pair of sCMOS cameras (a pair of Hamamatsu ORCA-Fusion via CoaXPress or a pair of ORCA-Flash4.0 V3 via CameraLink). One camera also served as a Shack–Hartmann (SH) wavefront sensor for any of the four objectives when the path to this camera was appropriately switched to include a pupil-plane-conjugate microlens array (Edmund Optics, no. 64-479, focal length (FL) = 13.8 mm, pitch = 0.5 mm).

For TPM, fluorescence in two-color channels was measured simultaneously with two Multi-Pixel Photon Counters (MPPCs; Hamamatsu C13366-3050GA and C14455-3050GA). USB inspection cameras (Basler, puA2500-14u) were used during microscope alignment to monitor the excitation at pupil- and sample-conjugate planes before the excitation objective, while a triggerable USB camera (Basler, daA2500-14μm-CS) was used during autofocus to image the two-photon GS through the excitation objective when the GS was generated through the detection objective. Finally, a waterproof USB endoscope (Depstech USB-C & Micro USB Endoscope) was used to broadly image the inside of the sample chamber to assist with positioning the sample between the objectives.

Specimen positioning and scanning

At the primary (three-objective) imaging station, the sample chamber assembly (including the bath, sample stages and the sample chamber) was raised or lowered using a 1-inch motorized stage (Thorlabs, ZFM2030) and then manually slid on rails out and away from the objectives toward the operator for safe and easy sample exchange. The sample was translated to the desired FOV by three orthogonal piezo stick-slip stages (SmarAct, SLC-2445-S, CLS-5252-S and CLS-5252-S), which formed the xyz stage assembly. For experiments requiring long-range, long-duration, continuous (as opposed to step-and-settle) scanning on the centimeter scale (for example, ExLLSM), an electromagnetic direct-drive stage (SmarAct, MLS-3252-S) could replace the x stick-slip stage. The lack of friction in the direct drive allowed highly consistent sweep performance, which was needed for experiments that would benefit from thousands of identically repeated sweeps. At the upright station, the objective was positioned in z with a brushless linear servo objective scanner (Dover, DOF-5). The specimen was mounted on a manual z stage (Thorlabs, VAP4) and a motorized xy stage (Thorlabs, PLS-XY), with customization available as needed.

Sample chamber

The sample chamber for the primary imaging station was environmentally sealed to prevent evaporation and allowed for closed-loop (TE Technology, TC-720) temperature control from ambient to 37 °C via silicone heaters (Tempco and Birk Manufacturing) and featured both peristaltic perfusion (Warner Instruments, 890688) and control of CO2 concentration.

Frame

The mainframes of the microscope were machined from 1-inch aluminum (ALCOA MIC-6 tooling plate). Placement of holes for screws, dowel pins and locator pins was with ±0.0005-inch tolerances.

Optical paths and shared components

The exact optical paths for each mode are illustrated in Supplementary Figs. 27 and Supplementary Video 1, and described as follows:

Lattice light-sheet microscopy path

Coaligned Gaussian beams emerged from the laser combiner/AOTF and passed through a Powell lens (Supplementary Fig. 2a; 20° fan angle, Laserline Optics, LOCP-8.9R20-2.0) that expanded the beam in the x direction, followed by a conventional achromatic lens (FL = 50 mm) that collimated the beam in x and focuses it in z, creating a narrow line of illumination. A pair of cylindrical lenses (FL = 50 mm and FL = 300 mm) then relayed and demagnified this line of illumination, creating (through the dichroic stack) seven parallel lines of different wavelengths at the SLM. The patterned light sheets reflected from the sample-conjugate SLM were first recombined by the dichroic stack and then transformed by a lens (FL = 400 mm) en route to the pupil-conjugate mask wheel. Another transform lens (FL = 150 mm) relayed the transmitted light to the sample-conjugate resonant galvo used to wobble the light sheet angle within the specimen. Another transform lens (FL = 80 mm) relayed the light to the sample-conjugate z galvo before a 4f pair of lenses (both FL = 150 mm) relayed further to the x galvo. A final transform lens (FL = 400 mm) relayed the light to the pupil of the excitation objective (Thorlabs, ×20, 0.6 NA), which then formed the LLS within the specimen.

Fluorescence generated by the LLS within the specimen was captured by the detection objective (Supplementary Fig. 2b; Zeiss 421452-9800-000, ×20, 1.0 NA) and then relayed by a tube lens (Zeiss 423731-8246-000, 165-mm FL) and a 50-mm effective focal length (EFL) lens doublet to a pupil-conjugate DM (ALPAO DM-69). A dichroic mirror (Semrock, DI03-R561-T3-32 × 40) split the fluorescence by color, and a 300-mm FL lens in each path created an image on an sCMOS camera for simultaneous two-color imaging.

Line-scan image scanning microscopy path

In our implementation of line-scan ISM, the multicolor Gaussian beam from the laser combiner was converted by a Powell lens (Supplementary Fig. 3a; Laserline Optics LOCP-8.9R20-2.0) and a conventional achromatic lens (75-mm FL) into a focused line of illumination at a sample-conjugate slit mask (Thorlabs, MPH-16). A 100-mm FL lens transformed the excitation to a pupil-conjugate plane, which was then relayed to the pupil-conjugate z galvo by a 25-mm EFL lens doublet/40-mm EFL lens doublet pair. Two 75-mm EFL lens doublets then formed a 4f system to relay to the x galvo. A 75-mm EFL doublet pair and a 350-mm FL lens relayed from the x galvo to a DM for AO correction (ALPAO, DM-69). The excitation was then relayed to the pupil of any of the detection, upright (Zeiss 421452-9880-000) or inverted (Zeiss) objectives (depending on the nature of the specimen), in the first case with a 50-mm EFL doublet/165-mm FL tube lens (Zeiss 423731-8246-000) relay pair, and in the other two cases with an additional pair of 62.5-mm EFL lens doublets inserted in between the 50-mm EFL and 200-mm FL lenses. For all three objectives, the resulting line illumination was ~1 Airy unit (AU) wide at the specimen.

The fluorescence generated by the line illumination retraced the optical path back through the microscope, until passing through a multiband dichroic mirror (Semrock, Di01-R405/488/561/635/800-1050-t3-25 × 36) just after the 40-mm EFL lens doublet. In sequence, 100-mm, 90-mm and 50-mm FL lenses then transferred the fluorescence to the dichroic that split and directed it to the two cameras. Because it was retraced across the x and z galvos, the ISM line fluorescence was descanned and hence stationary with respect to the imaging cameras, where it was aligned with the fast-readout direction of each camera to maximize readout speed.

To generate an ISM image, the line excitation was scanned in x across the desired FOV, and the fluorescence in the rectangular region defined by the FOV in y and the 1-AU-wide stripe in x was recorded as an image. This image was then reconstructed as a single-pixel column of extended resolution in x by the ISM algorithm50.

Widefield structured illumination microscopy path

The multicolor Gaussian beam from the laser combiner was magnified by a 25-mm FL/300-mm FL lens pair to fully illuminate the entire SLM (Supplementary Fig. 2d). A grating pattern in one of three different orientations applied to the SLM created a diffraction pattern consisting of three coplanar beams. After a 400-mm FL transform lens, these three beams became collinear and passed through the pupil-conjugate mask, while other diffraction orders were blocked. Two Zaber rotators (RSB060AD-E01T3-MC03) enforced linear polarization of the beams orthogonal to their common plane, as previously described51. A 150-mm FL lens then focused the beams to create an image of the desired SIM grating pattern at the sample-conjugate 4-kHz resonant wobble galvo, which rapidly modulated the angle at which the beams converged within the specimen to reduce striping artifacts from absorption or scattering. An 80-mm EFL lens doublet transformed this pattern to the pupil-conjugate z galvo, and a 4f lens pair consisting of two 150-mm EFL doublets relayed this to the x galvo. Together these galvos translated the grating pattern within the specimen and provided the phase stepping necessary for 3D-SIM. A 300/350-mm FL lens pair then relayed the excitation to the pupil-conjugate DM for AO correction. From there, it was transmitted through a 100-mm FL lens doublet to the pupil plane of any one of the three objectives: to the detection objective via the 165-mm FL Zeiss tube lens, and to either the inverted or upright objective via a 125-mm FL/125-mm FL relay pair plus the tube lens.

Fluorescence generated in the specimen retraced the excitation path until passing the multiband dichroic mirror, after which it followed the widefield detection path (Supplementary Fig. 2b) where it was split into two-color channels and transformed by parallel 300-mm FL lenses for simultaneous two-color detection on the cameras.

Oblique illumination path

Illumination at the SLM was either full-chip (same optics as widefield SIM; Supplementary Fig. 2d) or line-like (same optics as LLSM; Supplementary Fig. 2a). Thereafter, the oblique excitation followed the same path (Supplementary Fig. 2c) to the excitation objective as in LLSM. Full chip yielded point illumination at the excitation pupil, while line-like yielded line illumination at the pupil along the z axis perpendicular to the plane of the light sheet it produces at the sample. In either case, applying a phase ramp to the SLM changed the position in z of the illumination at the pupil plane, and thus the angle of the illumination at the sample. In this manner, the OI could be varied anywhere from dark field to differential interference contrast-like to bright field (C4 to C1; Supplementary Fig. 10) with respect to the inverted objective. Laser speckle due to the coherent illumination was reduced by rapidly dithering the illumination in x and z at the specimen with the galvos, while keeping the position of the illumination in the pupil (and thus its angle at the sample) fixed.

From the inverted objective, the collected light progressed through the 165-mm FL tube lens, a pair of 125-mm EFL doublets and a 100-mm EFL doublet to the DM, and a 300-mm FL transform lens from there to an sCMOS camera (Supplementary Fig. 2c).

Point-scanning two-photon microscopy path

Femtosecond pulses from the laser/GVD compensator (Prism Compression kit, Thorlabs AO-LLS-002)/AOM subsystem (Supplementary Fig. 24e) were beam-expanded by two relay lens pairs (25-mm FL/40-mm FL and 25-mm FL /60-mm FL) to the pupil-conjugate 8-kHz resonant scanner for rapid point-scan imaging. From there, a 100-mm FL/160-mm FL lens pair relayed the excitation to the z galvo. The remainder of the excitation path to the focus of the upright objective was the same as for ISM (Supplementary Fig. 3a).

Fluorescence generated in the specimen was collected by the upright objective and separated from the excitation with a dichroic mirror (Supplementary Fig. 4a; Semrock, FF757-DI01-32 × 40). A 150-mm FL lens with its front focal plane at the rear pupil of the upright objective served as the first lens of a relay pair, followed by a dichroic mirror (Semrock, Di03-R561-t1-25 × 36) to split the emission into two-color channels. The 25-mm FL lenses completed the relay pair in each color path, resulting in the fluorescence at the rear pupil being imaged onto a pair of MPPC detectors for simultaneous two-color imaging.

A multi-function, high-speed digitizer (Thorlabs) measured the MPPC voltages and produced a 2D image that was returned to the acquisition software.

Upright two-photon Bessel beam microscopy path

MOSAIC included the option of using a two-photon Bessel beam with extended depth of focus at the upright station, resulting in an image at each z scan plane which was effectively a MIP in z of the signal over the extended focal range52.

For this mode, after the femtosecond beam emerges from the AOM, it was expanded by a 25-mm FL/150-mm FL lens pair and delivered to the apex of an axicon (Thorlabs AX252-B, 2° cone angle; Supplementary Fig. 4c). The resulting diverging ring of illumination was converted to a collimated ring by one of three different lenses (125-mm, 175-mm or 250-mm FL), resulting in one of three different ring diameters, and thus ultimately one of three different combinations of 50-, 100- or 200-µm Bessel beam lengths. A pair of 100-mm FL lenses relayed the ring excitation to a pupil-conjugate annular mask, where each diameter had its own circular ring in the mask to reject zeroth-order (DC) and other extraneous light. A 150-mm FL/100-mm FL lens pair relayed the beam transmitted through the mask to the same pupil-conjugate 8-kHz resonant scanner used for point-scanning TPM. Thereafter, the rest of the excitation path, and all of the detection path, was identical to that for point-scanning TPM.

In practice, femtosecond power losses through MOSAIC and the loss of energy in the Bessel beam side lobes rendered this mode undesirable compared to the simpler point-scanning TPM.

Two-photon scanned Bessel beam light-sheet illumination path

The optical path in this case (Supplementary Fig. 3c) was initially identical to that of the upright Bessel path up to the rotating mask, which again had three transmissive annuli for Bessel beams of different NAs and lengths, but of different diameters to accommodate the different pupil diameters of the light-sheet excitation objective compared with the upright one. Thereafter, the light path to the excitation objective was identical to that in the LLS mode (Supplementary Fig. 2a). Likewise, the detection path was identical to widefield detection (Supplementary Fig. 2b).

Adaptive optical two-photon guide star path

Femtosecond pulses from the laser/GVD compensator/AOM subsystem were beam-expanded by two relay lens pairs (25-mm FL/40-mm FL and 25-mm FL/60 mm FL) to the pupil-conjugate 8-kHz resonant scanner (Supplementary Fig. 3b), which was left stationary during wavefront measurement. From there, a 25-mm EFL/40-mm EFL doublet lens pair relayed the excitation to the z galvo, and a 75-mm EFL/75-mm EFL doublet lens pair relayed it to the x galvo. This galvo then switched the remaining path depending on which objective the aberration was being measured for. A 75-mm EFL doublet/40-mm FL lens pair was used to relay from the x galvo to the pupil plane of the excitation objective. The path to the other three objectives started with a 75-mm EFL doublet/350-mm FL relay pair to the DM. From there, a 50-mm EFL doublet / 165-mm FL tube lens pair relayed the excitation to the pupil of the detection objective, whereas for the inverted or upright objective, a 62.5-mm EFL/62.5-mm EFL doublet pair relay was added between the 50-mm EFL/200-mm FL elements to extend the excitation to their rear pupils.

For all four objectives, the fluorescent GS generated in the specimen retraced that objective’s excitation path until it reaches the dichroic mirror (Semrock, DI01-R405_488_561_635_800-1050-T3_25 × 36) between the 25-mm EFL and 40-mm EFL doublets used to relay from the 8-kHz resonant scanner to the z galvo. This ensured that the fluorescence was stationary (‘descanned’) before it reached the pupil-conjugate microlens array (Edmund, 64-479) used for SH wavefront measurement. Finally, the array of foci was relayed to a camera (Hamamatsu ORCA Flash or Fusion), where deviations in their positions from their initial system-corrected locations encoded the specimen-induced aberration for the objective under investigation.

Patterned photostimulation path

Patterned photostimulation could be achieved via the SIM excitation pathway by applying the desired stimulation pattern as a DC value on the SLM, with a high-frequency grating pattern elsewhere to deflect light outside the aperture of the mask or the objective rear pupil.

Point scanning of either the linear or TPM excitation was also an option for photostimulation when higher peak intensity was needed. In the TPM case, the excitation followed the TPM GS path with the 8-kHz resonant scanner disabled and held fixed. The x and z galvos were used to raster the spot over the desired photostimulation pattern. Alternatively, photostimulation excitation could originate from the laser combiner. The beam was first expanded by a lens pair (FL = 25 mm and FL = 60 mm) before the 8-kHz resonant scanner, after which it joined and followed the TPM path just described. Supplementary Fig. 26 provides a decision tree to guide MOSAIC modality selection.

Adaptive optics

Correction of system aberrations in the detection path (phase retrieval)

Using widefield illumination, the 3D PSF of an isolated, subdiffractive fluorescent bead was recorded using the objective lens of interest. A phase-retrieval algorithm53 then calculated the wavefront shape. This was decomposed into Zernike polynomials, which were then applied to the pupil-conjugate DM using the vendor-supplied mode-by-mode calibration. The process was then repeated until the residual aberration was less than λ/4 peak-to-peak (essentially diffraction-limited). Recalibration was necessary whenever the detection path was realigned, optics were replaced, or a different imaging buffer was used.

Correction of system aberrations in the excitation path (pupil segmentation)

By definition, system aberrations in the excitation path from the sample-conjugate SLM to the sample-conjugate focal plane of the excitation objective are null when the wavevectors from all points in the objective rear pupil constructively interfere at the excitation focus. The pupil-conjugate wavefront correction needed to achieve this was determined by pupil segmentation54. In brief, the pupil wavefront was computationally represented as a large grid of small patches, each having its own independent yet constant phase. Treating one patch as a fixed reference, the appropriate corrective phase for each of the others was determined sequentially by calculating and applying to the SLM the grating pattern that would appeared if light from the two patches coherently interfered there. When the SLM was illuminated, this pattern created three beams at the excitation pupil – one each at the current and reference patches, and one between them. This beam was blocked by the rotating mask, so a standing wave of illumination was created at the excitation focal plane, where a fixed subdiffractive fluorescent bead has been placed. The phase of the current patch needed to maximize bead brightness determined its corrective phase relative to the reference patch. The process was repeated for all other patches, at which point the complete excitation-pupil phase required for system aberration correction was known. During imaging, this corrective phase was added to that required for sample-induced aberration to achieve complete excitation correction.

Correction of sample-induced aberrations in the detection path

The procedure used here was as previously described9. Focused two-photon excitation created a fluorescent GS at a desired imaging plane within the specimen for one of the three 1.0-NA objectives (detection, upright or inverted). x and z galvos swept the GS across an assumed isoplanatic patch (region of near-constant aberration), and the collected descanned light was sent to the SH camera for wavefront measurement, discarding those spots that did not contain at least 1,000 photons or whose localization precision exceeded 0.5 pixels. The displacements of the spots from their locations after correction of system aberration (see above) encoded the gradient of the sample-induced aberration. Wavefront reconstruction55 then recovered the wavefront itself, which was then decomposed into its Zernike coefficients. The inverse of these was then applied to the DM to provide the necessary AO correction. As the two-photon focus was itself aberrated at the start of correction, limited SNR and imperfect calibration often led to only partial correction after one iteration. The process was thus iterated in a closed loop until diffraction-limited performance was achieved. Starting de novo in a new specimen, typically five iterations were needed; however, when moving from one isoplanatic patch to an adjacent one, or when updating an existing correction at a later time point, one to two iterations were usually sufficient.

More recently, rather than stepping from patch to patch to perform correction, the specimen was translated continuously while multiple SH measurements were performed at a desired density. After the AO corrections were calculated from these measurements, the sample was thereafter continuously translated during imaging with continuous corrective updates applied to the DM.

Correction of sample-induced aberrations in the excitation path

Measurement of the sample-induced aberration in the excitation path proceeded with a two-photon-induced GS and SH sensor exactly as above; however, because the SLM that created and corrected the excitation pattern was sample-conjugate, AO correction was achieved by subtracting the system- and sample-induced aberrations \({\varphi }_{\mathrm{system}}\) and \({\varphi }_{\mathrm{sample}}\) from the complex phase of the Fourier transform of the ideal SLM pattern, transforming back to the sample plane, and applying the real part as the new corrected SLM pattern:

$${\mathrm{SLM}}_{\mathrm{corrected}}=\mathrm{Re}\{{\mathrm{FT}}^{-1}[\mathrm{FT}\left({SLM}_{\mathrm{ideal}}\right) \exp (-i ({\varphi }_{\mathrm{system}}+{\varphi }_{\mathrm{sample}}\,))]\}$$

Because this correction did not affect subsequent GS measurements of the residual aberration, the process was open-loop and only one iteration could be performed.

Continuous autofocus via relative LLSM and guide star axial position measurement

During LLSM imaging, sample-induced refraction of the light sheet and/or sample-induced defocus of the detection objective focal plane could occur, causing these two entities to lose their precise overlap necessary for high-resolution imaging. To compensate, the two-photon GS used for AO correction in the detection path could be simultaneously viewed through the excitation objective with a sample-conjugate camera, along with a side-on view of the light sheet (Supplementary Fig. 25). After correction for the static focal offset of the TPM excitation, the z galvo could be adjusted continuously during imaging to maintain the proper axial alignment of the light sheet and detection focal planes9.

Microscope control software

Custom microscope control software was developed using National Instruments LabVIEW 2018 SP1-2022 (64 bit) to manage all MOSAIC operations. The software provided a graphical user interface that enabled users to switch among MOSAIC modalities, control the hardware, acquire data and calibrate the system (for example, autofocus and system aberration correction). The software supported multi-position acquisition and user scripting, allowing sequential multimodal imaging across multiple specimens in a single experiment. Switching between modalities was achieved by opening and closing the motorized flip mirror (Supplementary Fig. 5c) to direct light to different paths. Multiple specimens could be loaded together in the same experiment, provided that they could fit on one 25 × 25-mm coverslip and required the same imaging environment (such as medium, temperature and CO2).

Real-time data compression was offloaded to a PCIe accelerator (Intel QuickAssist Adapter 8970) when saving data files. Raw data could be saved either in Tiff or Zarr format. A GPU (NVIDIA, GTX Titan or RTX A6000) drove MOSAIC control workstation monitors and delivered patterns to the SLM. Digital and analog voltage control input and output signals were handled using an FPGA (NI, USB-7845R OEM).

Sample preparation

Standard cell culture conditions

Unless otherwise specified, mammalian cell lines were cultured at 37 °C in a humidified atmosphere containing 5% CO2. Cells were regularly tested for mycoplasma contamination. For live imaging, cells were typically plated on no. 1.5 thickness glass coverslips (Thorlabs, CG15XH; Bellco, 2291-74000; Warner Instruments, CS-25R15).

U2OS cells

In Fig. 1d, for OI imaging, unlabeled U2OS cells were cultured in Dulbecco’s modified Eagle’s medium (DMEM) with GlutaMAX (Gibco, 10566016) supplemented with 10% fetal bovine serum (FBS; Seradigm) at 37 °C, 5% CO2 and 100% humidity. U2OS cells were grown on coverslips. When cultures reached 50–60% confluency, cells were transferred to an imaging chamber containing Leibovitz’s L-15 Medium without phenol red (Gibco, 21-083-027) supplemented with 5% FBS (ATCC SCRR-30-2020).

In Fig. 3a, for imaging mitochondria and nuclear lamins via DNA-PAINT, U2OS cells with an integrated TOMM20–HaloTag fusion protein were used56. U2OS cells were plated 1 day before imaging on no. 1.5 thickness, 15-mm-diameter coverslips containing nanodiamond fiducials as described earlier57 at a cell density of 1 × 105 cells per ml. Cells were fixed 24 h after plating using 4% PFA in 1× phosphate-buffered saline (PBS) for 20 min. After fixation, cells were washed with 1× PBS three times and then incubated in fresh 1× PBS for 5 min. Cells were then permeabilized in 0.2% Triton X-100 in 1× PBS for 20 min. After permeabilization, cells were washed with 1× PBS and then blocked with 10% normal goat serum (Thermo) overnight at 4 °C. After blocking, cells were labeled with mouse primary antibody against Lamin A/C (Santa Cruz, sc-376248) at a concentration of 1:200 and a DNA-conjugated anti-GFP nanobody (Massive Photonics, MASSIVE-TAG-X2 anti-GFP) at a concentration of 1:200 to label the TOMM20–HaloTag fusion protein in 10% normal goat serum overnight. After primary labeling, the cells were washed with Massive Photonics washing buffer for 1 h and then labeled with DNA-conjugated secondary antibodies against the mouse anti-Lamin A/C primary antibody (MASSIVE-sdAB 1-PLEX) at a concentration of 1:200 for 1 h in washing buffer. After secondary labeling, cells were washed in 1× washing buffer three times for 5 min. For imaging, the complementary imaging strands were diluted in Massive Photonics imaging buffer at a concentration of 0.75 nM (imager 2, complementary to anti-GFP) and 0.2 nM (imager 1, complementary to anti-mouse secondary).

HeLa cells

For Fig. 1c, wild-type HeLa cells were cultured in DMEM with GlutaMAX (Gibco, 10566016) supplemented with 10% FBS (Seradigm) at 37 °C, 5% CO2 and 100% humidity. When HeLa cells grown on coverslips (Thorlabs, CG15XH) reached 30–50% confluency, they were transferred to an imaging chamber containing Leibovitz’s L-15 Medium without phenol red (Gibco, 21-083-027) supplemented with 5% FBS (ATCC SCRR-30-2020).

LLC-PK1 cells

For Fig. 1a,b, pig kidney epithelial cells (LLC-PK1, a gift from M. Davidson at Florida State University) were cultured in DMEM with GlutaMAX (Gibco, 10566016) supplemented with 10% FBS (Seradigm) at 37 °C, 5% CO2 and 100% humidity. LLC-PK1 cells stably expressing the ER marker mEmerald–Calnexin and the chromosome marker mCherry–H2B were grown on coverslips (Thorlabs, CG15XH) coated with 200-nm fluorescent beads (Invitrogen FluoSpheres Carboxylate-Modified Microspheres, 505/515 nm, F8811). When cultures reached 30–80% confluency, cells were transferred to an imaging chamber containing Leibovitz’s L-15 Medium without phenol red (Gibco, 21-083-027) supplemented with 5% FBS (ATCC SCRR-30-2020) and an antibiotic cocktail (0.1% ampicillin, 0.1% kanamycin and 0.1% penicillin–streptomycin; Thermo Fisher).

hTERT-RPE1 cells

For Fig. 2b–f and Supplementary Figs. 11, 12 and 1417, hTERT-RPE1 cell lines were generated as described previously58. In brief, to produce the ER-StayGold/Golgi-HaloTag-tagged and Mitochondria-StayGold/Golgi-HaloTag-tagged hTERT-RPE1 cell lines, we transduced the parental ER-StayGold and Mitochondria-StayGold cells with lentiviral particles encoding HaloTag-tagged β4Gal (a Golgi-resident enzyme), respectively. Approximately 300 µl of β4Gal-HaloTag9 lentivirus was added to cells seeded in six-well plates; 2 days post-infection, the top 5% of HaloTag fluorescence (detected in APC-A) was sorted using a BD FACSAria Fusion Sorter and BD FACSDiva Software. For sorting, cells were incubated at 37 °C for 15 min in DMEM/F12 (Thermo Fisher Scientific, 11320033) containing Janelia Fluor HaloTag Ligand 646 (diluted 1:20,000 from a 1 mM stock), washed three times with PBS, then trypsinized and expanded for imaging. Lentiviral vectors were constructed by amplifying the β4Gal-HaloTag9 sequence from pcDNA5/FRT/TO_b4g-HaloTag9 (Addgene #175546), each cloned into a lentiviral vector with an EF1α promoter (a derivative of Addgene #60955 with the sgRNA sequence removed). Lentiviral particles were produced by transfecting HEK293T cells (ATCC CRL-3216) with these plasmids and standard packaging vectors using TransIT-LT1 Transfection Reagent (Mirus, MIR2306); the medium was replaced 24 h post-transfection and the viral supernatant was collected approximately 50 h post-transfection and filtered through a 0.45-µm PVDF syringe filter. Cells were cultured in DMEM/F12 supplemented with 10% FBS (VWR Life Science 100% Mexico Origin 156B19), 10 µg ml−1 hygromycin (Invitrogen, 10687010), 2 mM L-glutamine, 100 U ml−1 penicillin and 100 μg ml−1 streptomycin (Fisher Scientific, 10378016), and passaged using 0.25% trypsin–EDTA with phenol red (Fisher Scientific, 25200114). For the Supplementary Fig. 11 experiment, cells were transfected approximately 24 h before imaging with a total of 1 µg DNA, consisting of 0.3 µg of pCSII-EF/mt-(n1)StayGold (Addgene plasmid #185823)59 plasmid and 0.7 µg of carrier DNA, using Lipofectamine 3000 (Thermo Fisher Scientific). Upon reaching 30–80% confluency, cells were incubated with the cell-permeable fluorescent ligand JFX549 to label the Golgi apparatus for 15 min, then washed with Leibovitz’s L-15 Medium without phenol red (Gibco, 21-083-027). The coverslips were subsequently transferred to L-15 Medium at 37 °C, supplemented with 5% FBS (ATCC SCRR-30-2020) and antimicrobial reagent (Primocin, 100 μg ml−1, InvivoGen), for imaging.

For Supplementary Fig. 13, for the photoactivation experiments, hTERT-RPE1 cells were cultured in DMEM supplemented with 10% FBS (Avantor Seradigm) and 10 µg ml−1 hygromycin. Cells were transfected approximately 24 h before imaging with a total of 1 µg DNA, consisting of 0.3 µg of plasmid of interest and 0.7 µg of carrier DNA, using Lipofectamine 3000 (Thermo Fisher Scientific). The plasmids used were pTriEx–mCherry–PA-Rac1 (Addgene plasmid #22027)19. Imaging of hTERT-RPE1 cells was performed at 37 °C at a confluency of 30–50%, using Leibovitz’s L-15 Medium without phenol red (Gibco, 21083027) supplemented with 10% FBS, 0.1% ampicillin, 0.1% kanamycin and 0.1% penicillin–streptomycin.

COS-7 cells

African green monkey kidney fibroblast-like cell line (COS-7, ATCC, CRL-1651) was cultured in DMEM supplemented with GlutaMAX (Gibco, 10566016) and 10% FBS, in a 5% CO2 incubator at 37 °C. COS-7 cells transiently expressing EGFP–Tub1A and the actin marker mCherry–LifeAct were plated onto 25-mm round coverslips (Thorlabs, CG15XH). When cultures reached 30–80% confluency, cells were transferred to an imaging chamber containing Leibovitz’s L-15 Medium without phenol red (Gibco, 21-083-027) supplemented with 10% FBS (Life Technologies).

mES cells

For Fig. 2a, mouse embryonic stem (mES) cells expressing HaloTag-Sox2 were a gift from J. Liu at the Janelia Research Campus60. The mES cells were cultured in KnockOut DMEM (Thermo Fisher Scientific, 10829018) supplemented with 10% FBS, ES Cell Qualified (ATCC, SCRR-30-2020), 1× GlutaMAX Supplement (Thermo Fisher Scientific, 35050061), 1× MEM Non-Essential Amino Acids Solution (Thermo Fisher Scientific, 11140050), 0.1 mM 2-mercaptoethanol (Sigma-Aldrich, 444203), 1× Antibiotic-Antimycotic (Thermo Fisher Scientific, 15240062) and 1,000 U ml−1 of Leukemia Inhibitory Factor (StemCell Technologies 78055), 1 μM PD0325901 (Sigma-Aldrich PZ0162) and 3 μM CHIR99021 (Sigma-Aldrich SML1046). Two days before imaging, 25-mm no. 2 coverslips were precoated with Biolaminin 511 (Biolamina, LN511) according to the manufacturer’s protocol. Recombinant laminins were thawed slowly at 4 °C and diluted in 1× DPBS containing Ca2+ and Mg2+ (Sigma-Aldrich 59300C) to a final coating concentration of 0.5 µg cm−2. The diluted solution was applied to coverslips and incubated overnight at 4 °C. One day before imaging, 0.5 × 106 cells were plated onto coated coverslips. Immediately before imaging, cells were incubated in fresh growth medium supplemented with 10 nM HaloTag ligand PA-JF647 and a 1:500 dilution of SPY 505 (cytoskeleton CY-SC101) for 1 h. Cells were washed once with growth medium and incubated for an additional 20 min in growth medium containing no dye.

Mouse brain slice

For Supplementary Fig. 23, 300-μm thick acute brain slices were prepared from 3-month-old Thy1 GFP-M mice using the N-methyl-D-glucamine (NMDG) protective recovery method61. Mice were anesthetized with ketamine/xylazine (200 mg kg−1 ketamine and 20 mg kg−1 xylazine) via intraperitoneal injection and perfused with oxygen-bubbled, ice-chilled NMDG–HEPES artificial cerebrospinal fluid (aCSF) (92 mM NMDG, 2.5 mM KCl, 1.25 mM NaH2PO4, 30 mM NaHCO3, 20 mM HEPES, 25 mM glucose, 2 mM thiourea, 5 mM Na-ascorbate, 3 mM Na-pyruvate, 0.5 mM CaCl2·2H2O and 10 mM MgSO4·7H2O, titrated to pH 7.3). The brain samples were dissected and cut into 300-μm-thick slices using a Leica VT1200S vibratome under oxygen-bubbled, ice-chilled NMDG–HEPES aCSF. The slices were then transferred into a 34 ºC, oxygen-bubbled NMDG–HEPES aCSF recovery chamber. Following Na+ spike-in, the slices were transferred to a slice holding chamber with oxygen-bubbled HEPES aCSF (92 mM NaCl, 2.5 mM KCl, 1.25 mM NaH2PO4, 30 mM NaHCO3, 20 mM HEPES, 25 mM glucose, 2 mM thiourea, 5 mM Na-ascorbate, 3 mM Na-pyruvate, 2 mM CaCl2·2H2O, and 2 mM MgSO4·7H2O, titrated to pH 7.3). The slices were then placed onto a poly-D-lysine-coated no. 1.5 coverslip with a slice anchor (Warner Instruments) for imaging.

4×-expanded hippocampal tissue from patients with Alzheimer’s disease

For Fig. 3b–f, postmortem human hippocampal specimens were obtained from the University of Washington BioRepository and Integrated Neuropathology (BRaIN) laboratory and the University of Washington Alzheimer’s Disease Research Center Precision Neuropathology Core. In brief, a fresh piece of posterior hippocampus was dissected at rapid autopsy (postmortem interval <12 h) and immediately fixed in 4% (w/v) paraformaldehyde (PFA) in 1× PBS at room temperature for 48 h. The fixed tissue block was sectioned to ~100-μm-thick slices using a vibratome (VT1200S, Leica) and stored in 1× PBS with 0.03% (w/v) sodium azide at 4 °C.

The brain slices were permeabilized with 0.1% (w/v) Triton X-100 in 1× PBS for 15 min and incubated in blocking buffer (5% (v/v) normal goat serum and 0.1% (w/v) Triton X-100 in 1× PBS) at room temperature for at least 6 h before immunostaining. The ~100-μm-thick brain slices were immunostained with primary antibodies of rabbit anti-NF-200 (1:300 dilution, N4142-.2ML, Millipore Sigma) and chicken anti-MBP (1:300 dilution, PA1-10008, Thermo Fisher) and secondary antibodies goat Atto 647N-conjugated anti-rabbit (1:200 dilution, 40839-1ML-F, Millipore Sigma) and goat Alexa Fluor 568-conjugated anti-chicken (1:200 dilution, A11011, Thermo Fisher Scientific). After staining, samples were prepared following the protein-retention expansion microscopy protocol with minor modifications62,63.

Postmortem human specimens were collected with informed consent from the patients in consultation and compliance with the University of Washington School of Medicine Compliance Office and Health Insurance Portability and Accountability Act.

Zebrafish

All zebrafish experiments were performed in accordance with standard protocols and approved by the Institutional Animal Care and Use Committees of Stony Brook University, the Janelia Research Campus and the University of California, Berkeley. Specific UC Berkeley Animal Use Protocols included AUP-2019-09-12560-1 (Upadhyayula Laboratory), AUP-2020-10-13737-1 (Swinburne Laboratory), and AUP-2021-05-14347-1 (Zebrafish Facility Core Protocol). All zebrafish used were embryos younger than 7 dpf, and sex was not a factor in these studies.

The zebrafish lines used in this study were (Tg(eef1a1l1:mem-2x-mchilada)hm801) (Fig. 5a–e and Supplementary Figs. 1921), Tg(kdrl:GFP)s843Tg (ref. 64) (Fig. 4a,b), Tg(ubb:lck-mNeonGreen)sbu107Tg (Figs. 4c–e and 5f–i) and Tg(hsp70l:DHB.mScarlet-p2a-H2B.miRFP670)sbu109Tg (ref. 32) (Fig. 4c, d).

For xenograft experiments, embryos from the Tg(kdrl:GFP)s843Tg line were collected and kept at 28.5 °C until 48 hpf. To inhibit melanocyte pigment production for imaging purposes, embryos were treated with 200 μM N-phenylthiourea (PTU) (Alfa Aesar) in embryo medium beginning at 6 hpf and exchanged with fresh PTU solution every 24 h. At 48 hpf, embryos were manually dechorionated and anesthetized with 0.003% tricaine (Pentair, TRS1). MDA-MB-231 human breast cancer cells labeled with LifeAct–mRuby were loaded in a glass capillary and injected into the circulatory system by targeting the duct of Cuvier using a CellTram 4r Oil microinjector (50–100 cells per fish)43. After the injection, the embryos were maintained in embryo medium with 200 μM PTU at 33 °C until imaging. Embryos with MDA-MB-231 cells in the caudal vascular plexus were selected for imaging. Sample mounting was performed in 0.8% low-melting temperature agarose containing 0.006% tricaine.

For wound-healing studies and tail fin imaging, Tg(ubb:lck-mNeonGreen)sbu107Tg and Tg(hsp70l:DHB.mScarlet-p2a-H2B.miRFP670)sbu109Tg transgenic lines were crossed with each other and grown at 28.5 °C. Embryos were heat shocked at approximately the 8–12-somite stage (~12–14 hpf) by shifting embryos from 28.5 °C to 40 °C for 30 min. Following heat-shock, embryos containing both transgenes were sorted under a fluorescence dissecting microscope. For wound healing, at approximately 48 hpf, forceps (Dumont Dumoxel #5) were used to amputate the posterior fin tissue at the tip of the tail, just posterior to the end of the notochord. Sample mounting was conducted in 0.8% low-melting temperature agarose containing 0.006% tricaine and 22% OptiPrep (Sigma-Aldrich).

Plasmids encoding 4x-cox8-stayGold-ev-linker-stayGold were assembled through synthesis of the gene (Twist) and then cloned using isothermal assembly strategies into a pMTB backbone containing a SP6 promoter upstream of the 4x-cox8-2x-stayGold complementary DNA65. Messenger RNAs were synthesized from linearized plasmid using an mMessage mMachine SP6 Transcription kit (Thermo Fisher Scientific) and purified before injection into the zebrafish embryos using an RNeasy Mini kit (QIAGEN). Then, 30–60 pg of 4x-cox8-2x-stayGold mRNA was injected into each embryo for imaging (Tg(eef1a1l1:mem-2x-mchilada)hm801).

These studies were performed using a transgenic ubiquitously expressing membrane targeted red fluorescent protein, mChilada, (Tg(eef1a1l1:mem-2x-mchilada)hm801). A plasmid with eef1a1l1 driving expression of 2x-membrane-2x-mchilada was assembled through synthesis of the gene (Twist) and then cloning using isothermal assembly strategies into a tol2 backbone containing the eef1a1l1 promoter65. The transgenic was made by co-injecting 40 pg of plasmid and 40 pg of tol2 mRNA. See the Supplementary Information for the DNA sequences of the zebrafish constructs used to label intracellular and membrane markers.

Mouse

For Fig. 6 and Supplementary Fig. 24, all mouse experiments were conducted at Janelia Research Campus, HHMI in accordance with the US National Institutes of Health (NIH) Guide for the Care and Use of Laboratory Animals. Procedures and protocols were approved by the Institutional Animal Care and Use Committee of the Janelia Research Campus, HHMI. Male or female mice (Jackson Laboratory, C57BL/6J, stock no. 000664; Thy1-GFP line M, stock no. 007788) aged 2–4 months were used in this study. Mice were housed in specific-pathogen-free conditions on individually ventilated racks with 100% outside filtered air in the holding room. They were maintained on a 12-h light–dark cycle at 20–22 °C with 30–70% relative humidity.

All stereotaxic surgeries were carried out under anesthesia (1–2% isoflurane in O2) following established procedures. In brief, using a stereotaxic apparatus (Model 1900, David Kopf Instruments) and aseptic technique, mice were anesthetized with isoflurane (1–2% by volume in O2). A craniotomy of 3.5 mm in diameter was made over the left dorsal hemisphere of mice with dura left intact. For mice that required virus injection, a glass pipette (Drummond Scientific Company) beveled at 45° with a 15–20-μm opening was back-filled with mineral oil. A fitted plunger controlled by a hydraulic manipulator (Narishige, MO10) was inserted into the pipette and used to load and slowly inject 10–20 nl viral solution into the brain at ~200–400 μm below pia. The following injection coordinates were chosen to label brain regions in one or both hemispheres: site 1 (Bregma −4.6 mm, midline 2.1 mm), site 2 (Bregma −4.6 mm, midline 2.8 mm), site 3 (Bregma −4.1 mm, midline 2.1 mm) and site 4 (Bregma −4.1 mm, midline 2.8 mm). For sparse labeling of neurons in one hemisphere, AAV2/1.syn.FLEX.GCaMP7s (1 × 1013 GC ml−1) was mixed with AAV2/1.syn.Cre (1 × 1013 GC ml−1 diluted 10,000 times) at 1:1 for injection into wild-type mice. At the completion of viral injections or craniotomy without viral injections, a cranial window made of a single glass coverslip (Thermo Fisher Scientific, no. 1.5) with a diameter of 3.5 mm was embedded in the craniotomy and sealed in place with Vetbond tissue adhesive (3M). A titanium headpost was then attached to the skull with cyanoacrylate glue and then dental acrylic. Mice were given the analgesic buprenorphine (subcutaneously, 0.3 mg kg−1 of body weight). In vivo imaging was carried out after 4 weeks of expression for AAV injected animals and immediately for Thy1–GFP mice. For blood vessel imaging, 50 μl 5% dextran conjugated Texas Red (70 kDa) was injected retro-orbitally in the animal and anesthetized with isoflurane (maintained at 1–2% by volume in air).

Drosophila

For Supplementary Fig. 18a, to generate the UAS–Halo7–EB1 construct, the EB1 coding sequence was PCR amplified from the genomic DNA of a UAS–EB1–GFP fly66 and subsequently cloned into UAS–Halo7::CAAX (Addgene #87645) through XhoI and XbaI. The UAS–Halo7–EB1 plasmid was then used to generate transgenic flies. Flies were raised on standard cornmeal medium with a 12-h light cycle at 25 °C. The pebbled–GAL4, FRT19A/tubP–GAL80, hsFLP, FRT19A; UAS–mCD8–GFP/UAS–Halo7–EB1 flies were heat shocked 2 days before puparium formation at 37 °C for 35 min to induce sparse clones using the mosaic analysis with a repressible cell marker (MARCM) strategy67.

C. elegans

For Supplementary Fig. 18b, animals were reared under standard conditions at 25 °C (ref. 68). Animals were synchronized for experiments through alkaline hypochlorite treatment of gravid adults to isolate eggs69. In the text and figures, we designate linkage to a promoter through the use of the (p) symbol and fusion of proteins via a (::) annotation. The following transgene was used in this study: LG I bmdSi86[LoxN::rps-27:DHB::GFP::P2A::H2B::mKate2]. L3 stage larvae were anesthetized using 5 mM levamisole in M9 buffer32 and mounted in a drop of 1.0% low-melt agarose supplemented with 5 mM levamisole for live imaging.

Human brain organoids

For Supplementary Fig. 18c, all human stem cell experiments were carried out in compliance with the Human Stem Cell Research Oversight (hSCRO) Committee of the University of California, Irvine. Cytoplasmic-mGFP-expressing WTC-11 induced pluripotent stem cells (iPSCs) (Coriell, AICS-0036-006) and WTC-11 iPSCs (Coriell, GM25256) were cultured on Vitronectin XF (Stem Cell Tech, 07180) in NutriStem hPSC XF Medium (Sartorius, 05-100-1A). Brain organoids were generated following the protocol by Lancaster and Knoblich70 with a few modifications. In brief, GFP-expressing iPSCs were mixed with unmodified WTC-11 iPSCs at a ratio of 1:5, and embryoid bodies (EBs) were generated from 9,000 cells per well in EB formation medium in 96-well, non-treated, V-bottom plates (Corning, 3896), pretreated with anti-adherence rinsing solution (STEMCELL Technologies, 07010) at 37 °C. The EBs that formed after 5 days were transferred to Neural Induction Medium (see below for compositions of all media used) and cultured for 4 more days. The 9-day-old EBs were embedded in Matrigel (Corning, CB-40234A) and grown in Neural Differentiation Medium for 4 more days. On day 13, the EBs were transferred to Neural Maturation Medium in 50-ml conical culture tubes. The conical tube caps were kept loose in a CO2, 37 °C incubator until the medium color indicated equilibration with CO2, and then the caps were tightened. The tubes were then placed in a rotator (Fisherbrand Mini Tube Rotator, 88-861-051) set at 20 rpm at 37 °C with weekly medium changes. The tubes remained horizontal while being rotated. Organoids were imaged on day 27 after iPSCs were switched to EB formation medium. EB formation medium consisted of NutriStem hPSC XF GF-free (Sartorius, 06-5100-01-1A), 4 ng ml−1 bFGF (Peprotech, 100-18b) and 10 µM Y-27632 (Biological Industries, SM-0013-0010). Neural Induction Medium consisted of DMEM/F12 (Gibco, 11330-032) with 1% (vol/vol) N2 supplement (Gibco, 17502048), 1% GlutaMAX supplement (Gibco, 35050038), 1% MEM–NEAA (Gibco, 11140076) and 1 μg ml−1 heparin (Sigma, H3149). Neural Differentiation Medium consisted of 50% DMEM/F12 and 50% Neurobasal Medium (Gibco, 21103049) supplemented with 0.5% N2 Supplement, 0.5% B27 without vitamin A (Gibco, 12587010), 2.5 µg ml−1 insulin (Sigma, I9278), 50 µM 2-mercaptoethanol (Sigma, M3148), 1% GlutaMAX supplement, 0.5% MEM–NEAA and 1× penicillin–streptomycin (Gibco, 15140122). Neural Maturation Medium is the same as Neural Differentiation Medium, except that B27 supplement (without vitamin A) is replaced with B27 supplement (with vitamin A) (Gibco, 17504044).

Imaging conditions

Detailed imaging conditions for each experiment can be found in Supplementary Table 1. All abbreviations used in this paper are defined in Supplementary Table 2.

Image processing

Image preprocessing

Image preprocessing including flat-field correction, deconvolution, deskewing and rotation, and stitching was performed with PetaKit5D, which has been extensively documented and demonstrated13.

Nuclei segmentation

To expedite segmentation, we initially downsampled the data threefold in x and y. We performed a first pass at nucleus detection using Cellpose71. For each detected nucleus, we cropped a local region, defined by its bounding box extended with a 20-voxel buffer in x, y and z. Otsu’s thresholding was then applied to this local region to refine the segmentation. We utilized the ER channel to exclude cytosolic regions. Segmentations were further refined by smoothing, hole filling and taking the union with an extended Cellpose mask; for this extension, the top and bottom z-slices were extrapolated by replicating the first and last available slices, respectively.

Subsequently, we merged duplicate masks that corresponded to the same nucleus. To recover mitotic nuclei missed by Cellpose, we applied a high-intensity threshold (95th percentile of a Gaussian-smoothed image, σ = 0.5) and incorporated the resulting masks into the final segmentation. All masks were then resampled to the original data resolution. Finally, to address incomplete segmentation near the coverslip, we identified slices containing open holes and filled these using information from the immediately preceding slice.

Denoising

Content-aware image restoration (CARE)21 was used to denoise raw images acquired by AO-LLS-SIM and fast, extended-duration 3D-SIM. To train the denoising models, phase-stepped raw images were collected over the same region of interest both at the experimental illumination settings and at ‘ground-truth’ illumination settings (~10× higher SNR). Separate models were trained and applied to each channel. Denoising was performed on raw phase-stepped images before SIM reconstruction.

SIM reconstruction

We used GPU-accelerated SIM reconstruction software (https://github.com/scopetools/cudasirecon)72 with an OTF calculated from an experimentally measured PSF to reconstruct data collected in the LLS-SIM and 3D-SIM mode. We adapted this code to use cosine apodization during reconstruction. To minimize reconstruction artifacts, we split the data into 128-pixel chunks (with a 32-pixel overlap at each border) in image xy73.

Multimodal registration

To enable multimodal analysis, we calibrated the instrument to achieve near-pixel-level registration between datasets acquired via different objective paths (for example, inverted versus light-sheet objectives). Initial coarse alignment between the objective paths utilized cellular structures that could be correlated across different objective views, followed by fine refinement using diffraction-limited beads. When needed, final adjustments to correct minor residual misalignments between modalities were performed by manually measuring the offsets and using PetaKit5D.

Membrane enhancement

Where noted, the plasma membrane structures in zebrafish data were enhanced using a ridge detection model trained with CARE. The training data were generated using both the raw image and its corresponding tensor voting (TV) filter image calculated as described in ACME74. Each image was first smoothed (3D Gaussian, σ = 0.8 for raw, σ = 0.5 for TV) and then masked using the morphologically closed (cubic kernel size 3) nonzero voxels from the TV image. Within these masked regions, ridge likelihood was estimated by computing the eigenvalues of the Hessian matrix for four iterations. If the largest absolute eigenvalue was negative, its absolute value was used to update the corresponding voxel in the eigenvalue image before the next iteration. The resulting ridge likelihood maps were binarized using a threshold (minimum of 0.01 and the fifth percentile of nonzero values) and small holes (<20 voxels) were filled. The binary ridge masks from the raw and TV paths were combined using a union operation. Finally, this combined mask was smoothed (3D Gaussian, σ = 1) and multiplied element-wise with the original raw image to enhance membrane features. The CARE model was trained to predict the enhanced membrane features with the original raw image as input.

ISM reconstruction

The ISM dataset was reconstructed into either a 2D confocal image or a 2D ISM image. The confocal image was generated by summing within a virtual slit, followed by deconvolution. The full ISM image was produced by deconvolving each row individually with its corresponding PSF and then combining the results.

Preprocessing

All raw camera images underwent background subtraction by removing a recently acquired dark image. Next, any bad pixels (identified via extended exposures that reveal abnormally noisy pixels) were excluded from downstream analysis. To locate and align the slit, a MIP was computed from the sample dataset and the brightest points in each image column (above 30 counts) were peak-detected. A linear fit then yielded the slit’s angle and position. Finally, the images were digitally rotated (via bilinear interpolation) so that the slit aligned with the pixel rows.

3D confocal reconstruction

To measure the 3D confocal PSF, isolated bead data were acquired across x, y and z while applying the same preprocessing steps. In each camera image, the center column (defined by the slit’s location) was masked with a 6.4-pixel-wide (1 AU) rectangular window, and its intensities were summed; if the mask subtended a fraction of a pixel, that fraction was added proportionally. Plotting these sums at their corresponding x, y and z positions generated a volumetric dataset whose center was determined by 3D Gaussian fitting. For confocal imaging of a sample, line-scan illumination was performed along x while stepping the y galvo and z stage. The same slit-centered rectangular mask was applied, each column was summed, and these sums formed voxels in the final 3D volume. Optionally, the volume was deconvolved in MATLAB using the measured PSF and ‘deconvlucy’, yielding a refined 3D confocal result.

3D ISM reconstruction

In 3D ISM, the excitation PSF (ePSF) was measured by acquiring bead images at multiple x, y and z positions, summing each camera frame, and plotting those totals as a 3D volume. The bead’s position was localized in subvoxel space by examining neighboring camera images and centering the bead via 2D Gaussian fits. The detection PSF (dPSF) was measured separately under widefield illumination, and its center was found by 3D Gaussian fitting of the top third of pixel values. A total PSF was then computed for each of the seven pixel rows closest to the slit center by convolving a row-specific, laterally shifted ePSF with the row-centered dPSF. Sample data were collected similarly to the confocal case, and each of the seven rows formed its own 3D volume. Each volume was deconvolved independently with the corresponding total PSF (again using ‘deconvlucy’) and the seven resulting volumes were summed to yield the final 3D ISM reconstruction. While intermediate iterative fusion was possible, in practice the final summation generally provided comparable results with substantially less computation time.

Single-molecule fitting for PAINT

SR PAINT imaging and reconstruction was conducted as described previously57.

Single-particle tracking

Individual nuclei were manually cropped using a custom Python (v.3.8.8) script. Single molecules were detected and tracked using TrackMate (v.7.12.2)75 and localizations were identified with a Laplacian-of-Gaussian detector.

Diffusion analysis

Diffusion analysis was performed using custom Python (v.3.8.8) scripts. Single-molecule trajectories with fewer than four consecutive localizations were excluded from further analysis. For each linked particle within a trajectory, the mean squared displacement was calculated for time intervals ranging from 20 ms to 200 ms. Linear regression was applied to this relationship. A histogram of the resulting values was then fit using a two-component Gaussian mixture model via the scikit-learn function GaussianMixture76.

3D spine intensity estimation

We automatically detected and tracked dendritic spines in 2D functional imaging datasets using custom MATLAB scripts, modeling spines as 2D Gaussians77. Spine candidates were first identified using a Laplacian-of-Gaussian filter, and then were fitted with a 2D Gaussian with a fixed sigma of 3 pixels. The detected spines were then tracked with a frame-to-frame linking search radius of 3–6 pixels. These parameters were identical for both AO-corrected and uncorrected data. For comparison, calcium events were quantified based on the maximum fitted intensity per tracked spine activity, including only tracks persisting for at least 2 s.

Cell cycle quantification

First, we corrected raw DHB (CDK sensor) and nuclear intensity stacks for camera background offset. We then generated 3D cell masks using previously described methods involving segmentation74 and manual curation. For each resulting cell mask, we extracted a corresponding cubic region from the intensity data. Both the mask and intensity subvolumes were resampled to isotropic voxels using nearest-neighbor (mask) and linear (intensity) interpolation, respectively.

From these resampled masks, we calculated cell volume (total mask voxels multiplied by the voxel volume) and estimated surface area (from 3D perimeter). Within each cell mask, we segmented nuclei using 3D Gaussian smoothing (σ = 1 pixel), followed by Otsu thresholding and connected-component analysis (26-connectivity). To ensure data quality, we excluded cells truncated at imaging boundaries or those falling below minimum volume/area thresholds (potentially indicating incomplete cells or low expression). We calculated cytoplasmic-to-nuclear DHB ratios for each cell by summing the DHB intensity within the segmented nucleus and the remaining cytoplasmic region (defined by the cell mask excluding the nucleus). Filtered segmentation masks, and DHB ratio maps were saved as single-precision 3D TIFF volumes and visualized using Amira (Thermo Fisher Scientific). All image processing and analysis steps were performed using custom scripts in MATLAB R2022a.

Mitochondria quantification

After cells were segmented, MitoGraph was used to analyze the 3D morphology of mitochondria within each isolated cell, including both segmentation and skeletonization for total mitochondria length calculation78.

Removal of digitization artifacts in two-photon imaging

Ratio frequency noise introduced during two-photon detection with the MPPC detectors manifested itself as discrete frequencies in the Fourier transform of the time-ordered one-dimensional data as originally measured. Unfortunately, the acquisition hardware did not return a time trace, but rather a 2D image, where the time of acquisition determined the values of the pixels in a rectilinear grid. The noise was then distributed across the image. Furthermore, because the TPM data were acquired with a resonant galvo, the physical location between adjacent measurements was further at the center of the image than at the edges. To correct these issues, the 2D pixels were converted back to a one-dimensional temporal waveform but interpolated to their known time of acquisition on an axis with 38-ns spacing. The Fourier transform of this waveform then revealed the noise as sharp peaks that could be removed with notch filters. Finally, the waveform was converted back to an interpolated 2D image where the datum for each time point was mapped back onto the physical location of where the excitation focus was located at that time.

Motion stabilization during two-photon imaging in mice

Even for a head-fixed live mouse, residual motion (for example, respiration) could still appear in the data both within and between individual images; however, as the data were acquired in y with a fast resonant scanner, over any sufficiently small band of columns (typically 32–128) the motion would seem negligible. This was cross-correlated to the same band of columns in another image in the time series where the motion in the column of interest was negligible (for example, <6 pixels), yielding the mean displacement of the column in the moving case. The displacements of all such column groups across the image were fitted to a spline curve, and each individual column in the moving image was shifted according to the interpolated displacement from this curve. Finally, these corrected images were cross-correlated over time to determine their relative global displacements, and these were corrected at the subpixel level by bilinear interpolation.

Visualization and software

Videos and figures were made with Imaris (Oxford Instruments), Fiji79, Agave (Allen Institute, https://github.com/allen-cell-animated/agave), Amira (Thermo Fisher Scientific), IndeX (NVIDIA) and MATLAB R2019a-R2024a (MathWorks) software. Only for visualization, gamma adjustment was applied in addition to the image-processing steps noted above.

Reporting summary

Further information on research design is available in the Nature Portfolio Reporting Summary linked to this article.

联系我们 contact @ memedata.com