Single-molecule data analysis using Deep-LASI is carried out in a fully automatic way. However, for new experimental systems, e.g., when studying a new protein system with unknown folding behavior, it is highly advisable to not go for an automatic analysis directly but to analyze the data manually and inspect the recorded traces by eye.

Hence, the following section gives an overview of how to use Deep-LASI manually to sort, categorize and prepare single-molecule data via the sub-GUI Traces (Fig. 20) for later evaluation, e.g., by Hidden-Markov analysis, etc. Automatic data evaluation is described in a separate section on Automatic smFRET Analysis.

Trace Deep-LASI

The sub-GUI Traces of Deep-LASI serves for data processing and pre-analysis and serves as starting point for automatic data analysis.

Loading

Starting point of any data evaluation is the loading process from ‘freshly’ extracted traces or traces that shall be re-evaluated. Please load traces via > File > Load Traces. When you recorded multiple datasets with deviating starting frames during alternating laser excitation, please first extract traces for every single movie and then load the extracted traces file-wise via reading the traces of the first file via > File > Load Traces. and adding traces from the other files afterward via > File > Add Traces.

Traces GUI

After data loading, traces will open/show up on the sub-GUI called Traces as shown in Fig. 21 for example for two- or three-color FRET measurements with alternating laser excitation. The GUI is split into two sections: the left part displays the single-molecule data, and the right part is dedicated to trace classification, preparation, sorting, data correction, and automated data analysis, as described later in this Chapter.

trace

Exemplary single-molecule traces for a (top) two-color and (bottom) three-color FRET measurement.

Trace representation
Depending on the measurement type and amount of detection channels, up to three sub-panels will open up on the left side of the Traces GUI showing the intensity trajectories of a multi-labeled molecule in the upper panels. Their corresponding intensity projections are shown on the right side next to the trajectories. The panel on the bottom left shows the potential FRET signature for different dye pairs. Additionally, Deep-LASI shows small snippets in the column right next to the intensity traces showing the average movie projection in which multi-labeled molecules were found in the different detection channels including their corresponding area chosen for the background determination.

For a two-color FRET experiment (Fig. 21; top), the upper left panel shows the time trace of both, the emission of the donor and acceptor after direct excitation (DD and AA), as well as the sensitized emission (DA), while the corresponding FRET trace is shown on the lower panel on the left. For a single-color experiment, the upper left panel in Fig. 21 will show only one channel , while the corresponding panel for FRET traces will remain empty. Furthermore, Deep-LASI presents the total intensity given as the sum between the DD and DA channel as an additional dark grey/black trajectory. It should be a straight line after correcting against leakage, direct excitation, and detection sensitivity as described in the section Correction factors determination.

Depending on the selected laser excitation scheme during the extraction process, e.g., by choosing BG instead of GR, Deep-LASI will present dual- or triple-color FRET data in different color schemes but with (of course) identical intensity values. The chosen color schemes are summarized in the table below. The detection channel XY refers to the emission in the channel Y after excitation with color X, i.e., the acceptor emission in the red channel after blue excitation is abbreviated with BR:

Color representation

Detection Channel

Color

BB

dark blue

BG

cyan

BR

magenta

BI

GG

dark green

GR

orange

GI

black

RR

dark red

RI

black

II

black

Tip

@Pooyeh/Simon: Please add missing colors

For a three-color measurement, an additional panel displays the trajectories of the detected emitters after excitation with the third laser. As shown in Fig. 21 on the bottom for 3c FRET with BGR laser alternation, the top panel shows three intensities trajectories for the three detection channels after blue excitation, i.e., the emission of the blue dye after blue excitation (BB) in dark blue, the emission of green dye after the blue excitation (BG) in cyan, and the emission of red dye after blue excitation (BR) in magenta. The lower panel shows the emission after green and red excitation. Similar to the two-color case, the color of the different channels will vary depending on which detection channels have been chosen during data extraction. Deep-LASI chooses the above-mentioned color schemes.

You can choose which intensity trace shall be displayed by checking or unchecking channels in the Plot Layout tab in the right lower corner of the GUI. This holds also true for the FRET efficiency signature (which is displayed in the lower panel) or when selecting different regions in the traces, as described in Trace selection. Deselecting FRET channels can become especially handy in the case of having more than one FRET pair per molecule. The Reset Layout button restores the default trace representation.

Trace analysis
The right part of the Traces GUI serves for data handling.
In the Navigation tab, you can switch between traces via the slider. It displays the currently shown trajectory and the total number of extracted traces. For the 2c-ALEX example, 6100 traces were retrieved from the loaded data set (Fig. 21; top).

The Classification tab serves for the manual categorization of traces. All traces are ‘by default’ in the Uncategorized group. By clicking on the plus sign, you can add more categories. You can rename the new group according to your analysis procedure and further assign keyboard letters via the dropdown menu. The assignment of letters allows for transferring/assigning single traces to the corresponding category by simply pressing the chosen letter on the keyboard when using the keyboard during the manual sorting procedure. An example of possible sorting categories based on our analysis needs is given in Fig. 22. The Create Boolean Category button creates an additional group to the Navigation Tab according to your selection criteria and adds the corresponding traces, which fulfill the condition to the group. You can also delete an unwanted category by clicking on the trash-can icon. Unchecking the filter box hides traces that are already sorted, for example, when clicking through extracted trajectories. It is especially helpful for the trash category, for example. When you assign a trace to a specific category, it will be automatically removed from the first Uncategorized one and added to at least one other group.

categorization options

Navigation and categorization box

Note

You can not assign the letters A, D, or E to your categories. These are the keys for going to the previous trace (A) or the following trace (D). Pressing (E), triggers Deep-LASI to automatically find bleaching steps in traces, assign them to the corresponding bleaching group, and select the analysis region, as laid out in the section about Correction factors determination.

The next frame on the GUI comprises two sub-tabs beside the Plot Layout tab, the Deep Learning and Trace tools tabs. The first one allows for hiding or displaying specific emission channels for selected excitation sources, as well as their corresponding FRET signatures, as described above. The Deep Learning tab serves for carrying out automated trace sorting, classification, and analysis, which will be described in Automatic smFRET Analysis. The Trace Tools tab provides you with options regarding to implement correction factors on a current trace or the whole traces Fig. 23. Apart from correcting traces, by clicking on Reset Trace, you can reset all the corresponding correction factors, meaning that the trace will be left in the uncorrected format. Set Median button, will set all the correction factors as the global median values calculated by Deep-LASI. It is especially helpful in case of traces that yield no correction factors themselves.

Trace tools

The tab Trace Tools provides options about implementing correction factors.

Using the boxes Plot X-Limit and Plot Y-Limit, one can set a maximum threshold for visualizing the traces. For example, if traces are 100 seconds long on X axis, and you are interested in the first 50 seconds of it, you can type 50 in the Plot X-Limit box, and by pressing enter, the trace will be shown until the X value of 50. The same procedure works for the Y axis.

The FRET Controls tab displays and controls the FRET correction factors for direct excitation, leakage, and detection sensitivity. Its functionality will be described in the section about Correction factors determination.

Trace categorization

The categorization of traces depends on the actual single-molecule experiment. In the following, we describe important steps for the analysis of a dual-color FRET experiment with alternating laser excitation as an example. Experienced users can certainly carry out different steps of the categorization and selection process in parallel, i.e., on a single-trace basis.

  1. To fast categorize a large number of molecules, we advise first sorting out all unwanted molecules. Create two groups, for example, called Trash and Further analysis first. Depending on whether you want to go through the list of traces using a mouse or the keyboard, assign two separate letters on the keyboard to the two groups. Now go through all traces and sort out unwanted and useful traces. You can switch forward to the consecutive trace by typing D and go backward to the former trace, which is not categorized yet, by typing A. Once a trace is added to a group, it will not appear any longer in the Uncategorized group.

  2. We additionally advise ensuring that you only keep the single-molecule events. For this, please inspect the middle column on the GUI showing the detected particle in each channel. Make sure that only one molecule is shown inside the detection mask in each channel while no emitter is detected inside the ‘background mask’. Otherwise, exclude the trajectory since the false background calculation will lead to miscalculated FRET correction factors and hence, FRET efficiencies.

  3. Sort between Static and Dynamic molecules. Create categories for dynamic or static traces and add each trajectory to one of the two groups. By this step, you can select afterward which traces shall be analyzed by HMM, for example.

  4. Select regions of the trajectories (as described in the following paragraph Trace selection), which will be evaluated later by kinetics or histogram analysis. Traces with manually selected regions will be automatically added to the Manual Selection category.

  5. Mark regions of the trajectories (as described in the following paragraph Trace selection) in which fluorophores bleach. Deep-LASI will add the traces automatically to the following groups: G Bleach, R Bleach, GR Alpha, GR Beta, and GR Gamma.

Trace selection

For selecting regions in traces, either for further analysis or correction factor determination, Deep-LASI uses the mouse as the active tool for marking different areas. Deep-LASI has two different types of selectors: firstly, it allows for choosing specific time windows according to the detection channel (Fig. 24; left), which is required to derive trace-wise correction factors, and secondly, it provides one selector mode (Fig. 24; right), which marks the starting and stopping time points, in between which the kinetics and FRET states shall be evaluated.

Selector types

Activated selector types to manually mark areas in traces

When clicking with the mouse on the trace, first the mouse turns into an active cursor for a general selection of time windows, in which the FRET states and kinetics will be evaluated (Fig. 24; right), e.g., by HMM later on. Once the general selector is active, detection channel-specific selection is accessible by pressing the key 1, 2, or 3 on the keyboard, depending on how many detection channels are available. By pressing the same key again, the cursor will turn into a general selector again. Clicking into the Traces sub-GUI aside the trajectory will deactivate the selector tool.

To select specific areas in traces, one needs to click into a trace with the left button of the mouse, and drag the mouse to make the selected region shadowed, for example, from the beginning of a trace until a bleaching step. Correction or deselection of marked areas is achieved by clicking with the right button into the trace and deselecting the desired time window. Pressing the empty space key on the keyboard will reset all selections and permit restarting of the selection process all over.

The selection process depends on the bleaching behavior of fluorophores and the trace-inherent SNR and photochemical behavior, etc. Detection channel selection is required to determine trace-depending correction factors automatically. If a correction factor can be calculated for a trace, its value will be shown in the FRET control box in the lower right corner. We advise employing as many recorded traces for either of the analysis purposes (FRET evaluation or background correction factors analysis) to obtain significant statistics later on for determining absolute distances after full data correction. We advise marking the time windows with active fluorophores with channel-specific selectors first. A possible FRET evaluation should be selected lastly, as it is not always possible.

Tip

@Simon is the Selection process correctly described?

cursor example for a two color trace

Activated cursors for (A-B) channel-specific selection in the green channel (A), in the red channel (B), and for (C) choosing the time window by start and stop value in which the FRET states and kinetics shall be evaluated.

Fig. 25 provides an example of the three selector types available to evaluate a 2c ALEX trace and the outcome of such an analysis. Using the green selector (Fig. 25; A), the time window was marked in which the green dye was active. The middle panel shows the time window in which the red fluorophore was active (Fig. 25; B). The general selector marks the time window for FRET evaluation. This time window is not extra visualized (Fig. 25; C). The FRET efficiency trace gets the selection until the first bleaching step, and this region will be added to the FRET histogram in the end.

Correction factors determination

In real-world single-molecule FRET experiments, the intensity of the acceptor is biased by various sources. It needs to be corrected for direct excitation \(\alpha_{XY;DL}\) of the acceptor dye Y during donor excitation X and spectral crosstalk \(\beta_{XY;DL}\) from the donor molecule X into the acceptor channel Y. Furthermore, we need to correct for the differences in detection sensitivity \(\gamma_{XY;DL}\) between the two fluorophores. We are aware that the nomenclature by Deep-LASI, at this stage, is not in line yet with the nomenclature recently introduced by a multi-laboratory benchmark study published by Hellekamp et al., Nat. Meth (2018). It will be adopted on the various sub-GUIs of Deep-LASI and throughout the software during the next release rounds. Deep-LASI denotes the correction factors currently as

Correction factors employed by

Deep-LASI

Hellekamp et al.

Description

\(\alpha_{XY;DL}\)

\(\delta_{XY}\)

Direct excitation of the acceptor fluorophore Y during excitation with X

\(\beta_{XY;DL}\)

\(\alpha_{XY}\)

Spectral crosstalk from the fluorophore X in the detector channel Y

\(\gamma_{XY;DL}\)

\(\gamma_{XY}\)

Compensation for difference in detection sensitivities between Channels X

We denote the background-corrected intensities as \(I_{XY}\) and the corrected intensity as \(I_{XY;corr}\), where X stands for the excitation source and Y for the detection channel.

Trace-wise and global correction factors
Depending on when individual fluorophores photo-bleach, correction factors can be derived on a trace-to-trace basis. For most of the traces, however, only a subset of correction factors can be obtained for the individual trajectories. In these cases, Deep-LASI derives global correction factors, which are the median value of all trace-wise derived correction factors. The distribution of all three correction factors can be visualized on the Histograms GUI, and is described in the section Histogram Analysis and below, respectively.

Deep-LASI uses bleaching steps in single-intensity trajectories to calculate trace-wise correction factors. These can be derived for traces containing bleaching steps, which were presorted and categorized as B Bleach, G Bleach, R Bleach, or I Bleach, respectively, depending on which fluorophore pairs were investigated. The correction factor for direct excitation of the acceptor during donor excitation can be derived for traces in which the donor bleached first or acceptor-only traces, via

\[\alpha_{XY;DL} = \left. \frac{\langle I_{XY}\rangle}{\langle I_{YY} \rangle} \right\vert_{\text{no donor}}\]

where \(\langle I_{XY}\rangle\) and \(\langle I_{YY}\rangle\) describes the mean acceptor intensity after donor or acceptor excitation, respectively. Following the definition of leakage of the donor fluorescence into the acceptor channel according to

\[\beta_{XY;DL} = \left. \frac{\langle I_{XY}\rangle}{\langle I_{XX} \rangle} \right\vert_{\text{no acceptor}}\]

Deep-LASI determines \(\beta_{XY;DL}\) from donor-only traces or at acceptor bleaching steps from the static intensity in the donor channel and acceptor channel after the bleaching. Here, \(\langle I_{XX}\rangle\) refers to the mean donor intensity, and \(\langle I_{XY}\rangle\) to the mean acceptor intensity after acceptor bleaching.

Lastly, the detection correction factor \(\gamma_{XY;DL}\) is derived from traces categorized as XY Gamma, in which the acceptor Y is bleaching before the donor molecule X. Before determining \(\gamma_{XY;DL}\), the acceptor intensity \(I_{XY;corr}\) is first corrected against direct excitation and spectral crosstalk. Afterward, Deep-LASI derives the detection correction factor from the ratio of changes in the donor and acceptor emission before and after the photo-bleaching of the acceptor. The correction factor is calculated via

\[\gamma_{XY;DL} = \left. \frac{\langle \Delta I_{XY;corr}\rangle}{\langle \Delta I_{XX;corr} \rangle} \right\vert_{\text{A bleaches}}\]

with \(\langle \Delta I_{XX;corr}\rangle\) and \(\langle \Delta I_{XY;corr}\rangle\) being the intensity difference for the mean donor and acceptor emission after donor excitation before and after the acceptor photo-bleaches.

The correction factors calculated for each trace are shown in the FRET control box in the lower right corner of the GUI (Fig. 26; left). For each correction factor a pair value 1 | value 2 is shown, which present the locally derived correction factors and the global correction factor respectively. If a trace is not suitable for calculating any of the correction factors, or if the derived value is totally off, Deep-LASI permits to set a global correction factor. Clicking on the ‘def.’ box in the FRET control panel opens a sub-window (Fig. 26; right). It provides an overview over the mean and mode value of all derived local correction factors including the number of traces, which underlies the statistics. By clicking on the ‘use mean’ or ‘use mode’ box, you can set the global correction factor for the trace. Otherwise, you can also set the correction factor value, by typing in its value in the FRET control panel.

correction factor box

(Left) Trace-wise correction factors. (Right) After clicking on ‘def.’ in the FRET control panel, a sub-window opens showing the average global correction factors determined from other traces. By clicking on ‘use mean’ or ‘use mode’ the global correction factor values will be employed instead of the locally derived ones.

As shown in the right panel of Fig. 26, in this data set predominantly correction factors against leakage and detection sensitivity were obtained. This is mostly the case, when only the trajectories of co-localizing molecules have been extracted, as described in the Trace extraction section. To obtain a higher statistics for the correction factor against direct excitation in this case, it is advisable to also extract acceptor-only traces.

Once all correction factors are determined, every trace is corrected using the local, trace-wise correction factors, when available and suitable. Otherwise, the global correction factor is used. In three-color experiments, the corrected FRET efficiency for \(E_{YR}\) is calculated first since it is required for subsequent corrections. Upon yellow excitation, the same approach is used as for two-color FRET experiments

\[\begin{split}\begin{eqnarray} I_{YY;corr} & = & I_{YY} \\ I_{YR;corr} & = & I_{YR} - \alpha_{YR} I_{YY} - \delta_{YR} I_{RR} \end{eqnarray}\end{split}\]

The corrected FRET efficiency is then given by the ratio of both corrected intensities

\[E_{YR} = \frac{I_{YR;corr}}{\gamma_{YR}I_{YY;corr} + I_{YR;corr}}\]

For the BY FRET pair, the fully corrected intensities after blue excitation read as

\[\begin{split}\begin{eqnarray} I_{BB;corr} & = & I_{BB} \\ I_{BY;corr} & = & I_{BY} - \alpha_{BY} I_{BB} - \delta_{BY} I_{YY} \end{eqnarray}\end{split}\]

The accurate BY FRET efficiency follows equation 5.5 with an additional term which takes into account the reduction in brightness of the yellow dye due to the FRET process between the YR pair

\[E_{BY} = \frac{I_{BY;corr}}{\gamma_{BY}I_{BB;corr}(1-E_{YR}) + I_{BY;corr}}\]

The intensity of the red fluorophore after blue excitation needs to be corrected against direct excitation, contributions of both the blue and yellow dye due to crosstalk into the red channel and due to cascading of FRET from the blue dye over the yellow dye into the red channel

\[I_{BR,corr} = I_{BR} - \delta_{BR} I_{RR} - \alpha_{BR} I_{BB} - \alpha_{YR}(I_{BY} - \alpha_{BY} I_{BB}) - \delta_{BY} E_{YR} (1-E_{YR})^{-1} I_{YY}\]

The accurate FRET efficiency of the BR FRET pair is then given by

\[E_{BR} = \frac{I_{BR;corr} - E_{YR}(\gamma_{YR}I_{BY,corr} + I_{BR,corr})}{\gamma_{BR}I_{BB;corr} + I_{BR;corr} - E_{YR}(\gamma_{BR}I_{BB,corr} + \gamma_{YR}I_{BY,corr} + I_{BR,corr})}\]

Kinetics analysis by HMM

Once all traces are categorized and time windows for the trace-wise data evaluation are selected, Deep-LASI provides two different ways to evaluate traces. For 2c FRET traces, state-of-the-art Hidden-Markov-Modeling can be used for manual analysis of the underlying states and kinetics, as laid out in detail in the chapter on Hidden-Markov Modeling. Additionally, HMM-AI can be automatically used on the preselected traces. This strategy is in particular required for 3cFRET traces, which cannot be evaluated with the current MATLAB and Python packages.

For a 2c HMM analysis, we first need to set the input parameters in the HMM Input parameters tab on the top row of the HMM-Gui (Fig. 27). The procedure starts by specifying the HMM software package (as marked in blue in the very left list at the bottom) by clicking on (1) the MATLAB-based HMM package by Kevin Murphy (which works without Python-libraries) or (2) the Python-library Pomegranate. Next, the number of iterations per trace, and the analysis mode: (1) local or (2) global HMM analysis need to be set. The Default Convergence Threshold is 1e-4. Consecutively, specify the number of observations per hidden state and the number of hidden states. Depending on the number of hidden states, the number of input fields in the tabs on the right will change. The initial emission parameters and transition probabilities can be set (1) randomly, (2) evenly distributed or (3) manually. Depending on the selection, the values in the two tabs aside the Settings list will update. In the case of a manual input, please type in your envisioned values in both input windows. Lastly, choose the group of selected molecules that you wish to analyse and start the HMM analysis.

HMM input parameters

HMM Input parameters serve (1) for choosing the correct HMM package for global or local analysis, (2) for setting the initiation parameters, and (3) specifying the number of states and transition probabilities to analyse smFRET traces.

While Deep-LASI is running the HMM analysis, a green progress bar is shown on the bottom right of the GUI and the number of evaluated traces are displayed on the bottom left. Depending on the chosen input parameter, this process can last hours, in particular if a global HMM evaluation has been selected. Once Deep-LASI finished the process, the result tabs are updated (Fig. 28).

Local HMM results

HMM Results for a local analysis are summarized by showing (1) the FRET distribution, (2) the observed transitions via TDP and (3) the dwell-time per states via a dwell-time decay analysis. Local fitting results per single-molecule trace are shown on the bottom of the GUI.

Local HMM
Deep-LASI summarizes the outcome of the analysis in the upper row of the HMM Results tab by 3 plots. It shows the state-wise histogram of all evaluated traces (Fig. 28). Next to it, the transition-density plot (TDP) is plotted summarizing all transitions being found in the evaluated traces. After selecting specific populations in the TDP with the mouse by dragging and positioning a white ellipse around it, Deep-LASI updates the dwell-time plot on the right and shows the distribution of residence times of single molecule being found in one state before transiting conformational into another one. If no selection was made, it shows the dwell-time distribution over all states together. The dwell-time, FRET values and selected events are summarized on average on the lower half of the dwell-time graph.

Results for individual single-molecule traces are shown on the bottom of the HMM-GUI. On the left side of Fig. 28, the overlay between single FRET traces and obtained Viterbi paths is depicted. The trace-wise values for the transition probability matrix and the emission parameters are specified next to it on the right.

Global HMM
Deep-LASI further allows for a global analysis of the selected traces (Fig. 29). In this case, the number of iterations is not set per trace, but total rounds of training steps. Similar to Local HMM, Deep-LASI updates the results tables, however, it displays the transition probability matrix and emission parameters globally - and shows them on the top left corner of the HMM results tab, the results per single trace (on the bottom right corner) are not provided.

Global HMM results

For global analysis approaches, HMM Results are summarized by specifying the global transition probability matrix and emission properties besides the (1) FRET distribution, (2) TDP and (3) dwell-time analysis. Local fitting results per single-molecule trace are not provided.

Histogram Analysis

Once all traces are analysed by Deep-LASI you can summarize the results by plotting the distributions of the different parameters. Deep-LASI provides distributions including fitting results on a trace-wise and frame-wise basis for

  • apparent FRET

  • accurate FRET (+/- denoising)

  • Distances

  • Stoichiometry

  • the Correction factors \(\alpha_{XY;DL}\), \(\beta_{XY;DL}\) and \(\gamma_{XY;DL}\)

  • Donor intensity

  • Bleaching times.