Difference between revisions of "Walkthrough on GUI based tilt series alignment"

From Dynamo
Jump to navigation Jump to search
Line 142: Line 142:
  
 
=== Selection of stable trails===
 
=== Selection of stable trails===
 
+
We select the longest trails, which will then be used to generate a 3d model of the markers:
 
[[ File:alignGUI_trailsWithFewMarkersAreThenRejected.png |thumb|center| 600px|trails with few markers are then rejected]]
 
[[ File:alignGUI_trailsWithFewMarkersAreThenRejected.png |thumb|center| 600px|trails with few markers are then rejected]]
 +
Note that from this step onwards, the toolbox of each step offers the possibility to revert the current markers to the output generated at that state. Thus, if further processing of the markers in a later step leads you to loose a good marker set, you can always come back to this point.
 
[[ File:alignGUI_noteWorkingMarkersCanBeRestoredToTheResultOfAPreviousStep.png |thumb|center| 600px|note working markers can be restored to the result of a previous step]]
 
[[ File:alignGUI_noteWorkingMarkersCanBeRestoredToTheResultOfAPreviousStep.png |thumb|center| 600px|note working markers can be restored to the result of a previous step]]
  
 
=== Iterative reindexing ===
 
=== Iterative reindexing ===
 +
The 3d model is projected on each micrograph. Observations that are closest (and below a distance threshold) to each reprojection are assigned to the corresponding 3d marker. This refines the 3d model, and the process is iterated till no further improvement occurs (or till a maximum of ten iterations is reached).
 
[[ File:alignGUI_parametersForIterativeReindexing.png |thumb|center| 600px|parameters for iterative reindexing]]
 
[[ File:alignGUI_parametersForIterativeReindexing.png |thumb|center| 600px|parameters for iterative reindexing]]
 
[[ File:alignGUI_resultOfIterativeReindexing.png |thumb|center| 600px|result of iterative reindexing]]
 
[[ File:alignGUI_resultOfIterativeReindexing.png |thumb|center| 600px|result of iterative reindexing]]
  
 
===Tilt gap filling ===
 
===Tilt gap filling ===
 +
''Dynamo'' can be directed to try and analyse those  tilts that wind up not having any marker. (and that have not been explicitly rejected by the user) can be reintegra
 
[[ File:alignGUI_parametersForTiltGapFiller.png |thumb|center| 600px|parameters for tilt gap filler]]
 
[[ File:alignGUI_parametersForTiltGapFiller.png |thumb|center| 600px|parameters for tilt gap filler]]
 
[[ File:alignGUI_occupancyAfterTiltGapFiller.png |thumb|center| 600px|occupancy after tilt gap filler]]
 
[[ File:alignGUI_occupancyAfterTiltGapFiller.png |thumb|center| 600px|occupancy after tilt gap filler]]

Revision as of 18:42, 27 August 2019

Dynamo includes a package for automated aligned and reconstruction of tilt series. This walkthrough guides you through the steps on how to use it with a GUI. A different page in this wiki shows how to operate this procedure through the command line.

Data

We have prepared a version of a tilt series from the EMPIAR entry [XXXX], containing a set of virus like particles of VLP.

< tt> wget https://wiki.dynamo.biozentrum.unibas.ch/html/w/doc/data/hiv/align/b001ts001.mrc

In a Mac:

curl -O https://wiki.dynamo.biozentrum.unibas.ch/html/w/doc/data/hiv/align/b001ts001.mrc

In the workshop, a copy should be already available on your local data folder:

~/data/b001ts001.mrc

In this binned version, the pixel size is 2'7 Angstrom (original was 1.35, this is bin level 1 in Dynamo)

Creating an alignment workflow

The basic function for invoking the GUI is dtsa (short form of dynamo_tilt_series_alignment;

 u = dtsa();

Here, u is an object that will reside in memory during the session and allows to interoperate with the workflow through the command line. It is not necessary when proceeding through the GUI.

creating a workflow

The data for the workflow (tilt series, angles) could have been introduced directly when creating the workflow, we however will introduce each item explicitly in this walkthrough.

The minimal data to initiate a workflow is

  • tilt series matrix (use the file indicated above)
  • tilt angles.
  • discarded tilt angles (leave empty)
input workflow parameters

Discarded tilt angles

If you are unsure on the tilts to be discarded, you can do it in a later stage while you inspect the images in the dmarkers GUI, using the x and shift + x buttons.


GUI description

The GUI guides of the process of creating and editing a set of "working markers" (in the areas of detection, reindexing and refinement), and then using them to create aligned stacks (alignment tab), analyse and correct their CTF (through wrappers to ctfffind4 and imod) and then create reconstructions.

alignment GUI before completion of any step

Settings

Acquisition settings

Here you can enter pixel size (2.7 Angstroms), Cs (2.2), nominal defocus (-4.0 microns, used if the CTF area is connected).

Controls

markers GUI

The icon of the markers GUI allows you to check the position of the working markers in the micrograph. If you want to make editions of the GUI permanent, you need to save the current markers.

Occupancy plot

Shows a scheme of which markers are present in which tilt numbers.

Gold bead gallery

Crops the gold beads currently contained in the working markers and shows them as a gallery.

Execution Areas

The GUI is divided in five areas. Each are comprises sets of steps that can be executed sequentially. Sequential execution is the natural way of proceeding; but steps can be visited in any order, i.e., a step can be reexecuted in a later moment after updating its information.

passing the cursor on the GUI elements shows a help element

Steps

Steps needs to be open (letters in black, not grey) in order to be executed. They become open when the input they require gets computed and stored by a previous step during execution of the workflow. When a step is under execution, its pushbutton becomes green.

Step Toolbox

The tool icon can be secondary clicked and will provide a popup menu with specific tools for each steps and some common one. The common ones are handles to inspect and list the items that are needed (input items) or generated (output items) by the step. The View provides tools specific for visualisation of results of the step.

The areas in the alignment task

Detection

The goal of this task is to find the positions of the gold bead projections in the tilt series. We will cross correlate each micrograph against a model of the gold bead and then locate the cross correlation peaks, which provide putative positions for actual projections of gold beads. Further analysis (feature extraction and "selection") of these peaks will determine which ones correspond to actual gold bead projection.

Visualization matrix

This step just creates a binned version of the tilt series stack to accelerate visualizations that will be invoked in a later point.

Detection of gold beads

This area is the one that needed some design decision on the size of the gold bead. We will use dtmshow

completed steps become bold font size
the plus icon at corner shows the values of the parameters of a given step
open tomoshow on the full sized matrix to check the size of a gold bead
the ruler tool allows to measure in pixels the diameter of a gold bead

Right click on the view area of the step to access the different visualisation options.

secondary click in the view panel opens a menu to access the different results of a step
marker sets can be viewed as cloud of points

This view shows the x,y coordinates of all cross correlation peaks on all the micrographs in the tilt series.

cloud of unindexed cc peaks

We can also check the positions of all the detected spots on each micrograph:

shows the detected spots on the video GUI

This GUI does not allow for edition of the markers.

static video annotations cannot be edited

The neighbourhood of cross correlation peaks can be visualised individually:

Each patch will be a putative gold bead
the set of cc peaks is shown as a montage

This visualization is normally a good gauge on how the detection procedure has worked. The example below would be an example of detection procedure carried with wrong search parameters

example of failed gold bead detection

Note that you have the option of testing your parameters against a single image before launching a full detection procedure.

toolbox option for testing the parameters on a central image
results of testing on a central image

Computation of observation features s

At this stage, the observed cross correlation peaks are analysed. In the current Dynamo' version a merit figure is assigned to each peak based on a "rotational merit" that measures its similarity to a circle. The results can be depicted on patches representing individual gold beads:

patch gallery for features
the gallery allows relating appearance of gold bead an value of the features

or extracting properties of the whole data set.

feature plotter allows checking of the feature values on the whole set
different plotting options
scatter 2d option
coloring option for scattered plots
each point represents a cc peak

Selection of best gold beads

The cluster with the best markers is then selected. The individual patches can be inspected

check observation cloud after selection or clustering

or, again the cloud of observations

observation cloud has been thinned

and the location of the observations in the micrographs:

check marker positions after clustering
marker positions after clustering


Indexing

The goal of this task is to find trails of gold beads, i.e., observations in different micrographs that correspond to the same 3d gold bead.

Rough Alignment

Here all couples of micrographs are compared. For each couple, we look for the relative shifts that generates the most matches of cross-correlation peaks between one micrograph and the next one. This procedure induces trails of matched pairs of observations of variable length along the tilt series. The scheme that depicts which trails have representatives in which tilts is called occupancy graph

occupancy scheme of the results of a step
rough alignment selects many potential trails

Note that these trails are very lacunary and don't conserve the identity of a trail; whenever a trail that represents an actual 3d marker gets interrupted, the same 3d marker might generate a different trail in other tilts.

Selection of stable trails

We select the longest trails, which will then be used to generate a 3d model of the markers:

trails with few markers are then rejected

Note that from this step onwards, the toolbox of each step offers the possibility to revert the current markers to the output generated at that state. Thus, if further processing of the markers in a later step leads you to loose a good marker set, you can always come back to this point.

note working markers can be restored to the result of a previous step

Iterative reindexing

The 3d model is projected on each micrograph. Observations that are closest (and below a distance threshold) to each reprojection are assigned to the corresponding 3d marker. This refines the 3d model, and the process is iterated till no further improvement occurs (or till a maximum of ten iterations is reached).

parameters for iterative reindexing
result of iterative reindexing

Tilt gap filling

Dynamo can be directed to try and analyse those tilts that wind up not having any marker. (and that have not been explicitly rejected by the user) can be reintegra

parameters for tilt gap filler
occupancy after tilt gap filler
we have 66 traces after gap filler
results of tilt gap filler

Trail extension

parameters of tilt extensor
trail extensor adds a few new trails
some of the new trails have empty spaces
result of trail extensor


Refinement

tab for refinement
all steps of refinement area are being computed
better fiiting is attained
trimming of markers can be accessed through the scissor icon
residuals at each observation

Alignment

This area creates the aligned tilt series. It creates two version, a binned one and one with full resolution pixel size. Note that the binning level of this one is independent of the binning level used in the detection step.

Fix the markers

Here we just freeze the working markers and create a marker file that will define all subsequent steps of alignment and reconstruction.

area for creation of an aligned tilt series

Align the tilt series

We then proceed to the alignment task itself.

visualization of aligned tilt stack
binned aligned tilt stack

CTF

In this GUI CTF estimation and correction are delegated to CTFFIND4 and Imod's ctfphaseflip programs respectively. This part will not be used in the workshop.'

Reconstruction

Binned reconstruction

This version of Dynamo fixes the tomogram center at the 3d reconstruction center of the aligned stack.

reconstruction area
choose a visualization
binned weighted back projection reconstruction

Full sized reconstruction

The full sized reconstruction can be created related to a coordinate directly read in the binned tomogram, a feature useful for creating reconstructions localised on an area of interest. In this case, we will focus on one of the VLPS.

Use the pin tool to select a point on the binned reconstruction.

the pin tool is useful for locating isolated points
we put a pin in the center of an object of interest

We also check the size of a structure of interest. We measure it in the binned tomogram.

we check the distance of the object of interest
we use the option of expressing the center of the full sized tomogram in terms of a position in the binned tomogram
as an specific viewer is not available for this step we can use the toolbox of the steps items
the full size reconstruction includes only the object of interest
You might need to activate the bandpass to see the VLP









]