Difference between revisions of "EMBO workshop 2021"

From Dynamo
Jump to navigation Jump to search
Line 15: Line 15:
 
[[File:embo_2021_1.png|thumb|center|400px|Entering guacamole server.]]
 
[[File:embo_2021_1.png|thumb|center|400px|Entering guacamole server.]]
 
=== Connect to your machine ===
 
=== Connect to your machine ===
Now you need to select a machine. Please then click on +em and then +Servers - Public and select server Zeus-0-14.
+
Now you need to select a machine. Please then click on +em and then +Servers - Public and select your dedicated server (in this example it is Zeus-0-14).
 
[[File:embo_2021_2.png|thumb|center|300px|Select a machine.]]
 
[[File:embo_2021_2.png|thumb|center|300px|Select a machine.]]
 
When you select the machine, you will prompted to use your EMBO21 UserID
 
When you select the machine, you will prompted to use your EMBO21 UserID
Line 57: Line 57:
  
 
[[File:embo_files.png|thumb|center|500px|files]]
 
[[File:embo_files.png|thumb|center|500px|files]]
 +
 +
During the ''Dynamo'' workshop, work only within those two directories.
  
 
= Time schedule =
 
= Time schedule =
The course is divided into different modules, described in the time schedule below. Each module is structured in three stages:
+
The course is divided into short presentations and tutorials, as described in the time schedule below. For the presentations, we all meet in the main room. The tutorials are structured as follows:
 
+
# '''Demonstration:''' All students stay connected to the main room for the first minutes, where the goals of the tutorial are explained.
# '''Demostration:''' All students are connected to the main room. The goals of the tutorial will be explained by an instructor.
 
 
# '''Individual work:''' Students go the assigned breakout rooms to work on the material independently. An instructor will be assigned to each breakout room to help with questions.
 
# '''Individual work:''' Students go the assigned breakout rooms to work on the material independently. An instructor will be assigned to each breakout room to help with questions.
# '''Common discussion:''' In the last 5 minutes of the module, we come back to the general breakout room to wrap up.
+
# '''Closure:''' During the last 5 minutes we come back to the general breakout room to wrap up the tutorial.
  
  
Line 101: Line 102:
 
| [http://{{SERVERNAME}}/w/doc/misc/modelMembrane.pdf Models for vesicles and surfaces]
 
| [http://{{SERVERNAME}}/w/doc/misc/modelMembrane.pdf Models for vesicles and surfaces]
 
|-
 
|-
| Extra:
+
| Optional:
 
| Tutorial
 
| Tutorial
 
| [[Walkthrough for template matching | Template matching]]
 
| [[Walkthrough for template matching | Template matching]]
Line 137: Line 138:
 
| Closing remarks
 
| Closing remarks
 
|-
 
|-
| Extra:
+
| Optional:
 
| Tutorials
 
| Tutorials
 
| [[Getting_a_Structure_from_Multiple_Tomograms_of_HIV_Capsids_(walkthrough) | Virus like particles]] or [[Walkthrough for lattices on vesicles| Spherical geometries]]
 
| [[Getting_a_Structure_from_Multiple_Tomograms_of_HIV_Capsids_(walkthrough) | Virus like particles]] or [[Walkthrough for lattices on vesicles| Spherical geometries]]
 
|}
 
|}
 
= Turorials =
 
 
== Alignment of tilt series==
 
We will align the same tilt series tilt series with two different approaches. We prepared the first tilt series from the EMPIAR entry 10164, depicting a set of virus like particles (VLP). Move to the directory that contains this data using the command:
 
 
<tt>cd prac-5</tt>
 
 
Double-check by typing
 
 
<tt>ls</tt>
 
 
to see all files in the directory. One file should be the following tilt series:
 
 
<tt>b001ts001.mrc</tt>
 
 
This is a binned version (for quicker processing) with the pixel size is 2.7 Angstrom (original deposition is 1.35).
 
 
=== Automated alignment of tilt series through the GUI ===
 
[[Walkthrough on GUI based tilt series alignment ]]
 
 
=== Automated alignment of tilt series through the command line ===
 
[[Walkthrough on command line based tilt series alignment ]]
 
 
== Models ==
 
=== Catalogues ===
 
=== Helical models ===
 
[http://{{SERVERNAME}}/w/doc/misc/modelFilament.pdf tutorial ]
 
=== Vesicle and surface models ===
 
[http://{{SERVERNAME}}/w/doc/misc/modelMembrane.pdf tutorial on] membrane modeling with <tt> dmslice </tt>
 
=== Reusing models ===
 
Reusing model workflows ([[Walkthrough model worfklow reuse| walkthrough]])
 
== Template matching ==
 
[[Walkthrough for template matching | walkthrough]] for automated identification of proteosomes on a real tomogram through template matching. (~1 hour) <br />
 
The data is available at:
 
<tt>/d/embo2021/d/dynamo/t20s.mrc</tt>
 
 
An example of template and its mask are provided as 'average32.em' and 'maskTight32.em'.
 
 
== Subtomogram averaging ==
 
=== Introduction ===
 
Guided presentation:
 
 
* [http://{{SERVERNAME}}/w/doc/misc/conceptsSheet.pdf Basic ''Dynamo'' jargon]
 
* [http://{{SERVERNAME}}/w/doc/misc/introductionTablesAndData.pdf tutorial on] basic elements: help, data and metadata formats.
 
* [http://{{SERVERNAME}}/w/doc/misc/introductionAlignmentProjects.pdf tutorial on] the basic concept in ''Dynamo'' alignment: the ''project''.
 
 
Working on your own:
 
 
Basic [[Starters guide | walkthrough]]: creating a catalogue, picking particles, launching a project.
 
 
=== Advanced starters guide ===
 
Complete the  [[advanced starters guide]] (~2 hours)
 
The data can be found in
 
<tt>/d/embo2021/d/dynamo/crop.rec</tt>
 
To use chimera path you need in the tutorial is
 
<tt> TBI </tt>
 
 
=== Seed oversampling ===
 
 
Tutorial [[Walkthrough for lattices on vesicles| from densely packed spherical geometry]] (~1 hour). The data is available at:
 
<tt>/d/embo2021/d/dynamo/v17.rec</tt>
 
 
Since the final alignment project is run on the standalone version of Dynamo, the 'destination' parameter should be 'standalone' instead of 'matlab_parfor'
 
 
== High resolution pipelines ==
 
 
=== VLPs ===
 
Exercise to train a realistic case including all processing steps from catalogue creation to final structure using a reduced dataset. Start with the [[Getting a Structure from Multiple Tomograms of HIV Capsids | exercise]] and refer to the complete [[Getting_a_Structure_from_Multiple_Tomograms_of_HIV_Capsids_(walkthrough) | walkthrough]] for guidance or the solution.
 
 
=== Interconnectivity tools ===
 
Alister:
 
Not a tutorial per se: this is a presentation on a set of tools to interconnect Dynamo, M and other software.
 
 
A set of tools have been developed which provide a means to use the geometrical tools and alignment projects from Dynamo with data preprocessed in Warp.
 
These tools mean that particle picking and alignment can be performed in Dynamo prior to multi-particle refinement in M.
 

Revision as of 10:16, 10 August 2021

The tutorials listed here take place virtually on the 11th and 13th of September of 2021 (14:00-18:30) as part of the EMBO workshop for Image processing in cryoEM.

Connect to Guacamole and run Dynamo

Credentials

Please refer to your personal course material to access your two sets of credentials:

  1. A set of credentials to enter Guacamole (the platform for connecting via browser). These are common to all participants.
  2. A set of course credentials to enter the actual machines on which the course will be done: the EMBO21 UserID. These are unique to each participant.

Connect to Guacamole

To connect to Guacamole, first go to the following link in your browser:

https://login.cryst.bbk.ac.uk/guacamole/#/ 

At this stage you should maximize your browser window, otherwise you might have visualization problems when opening Dynamo. You should see the following window. Enter your Guacamole credentials.

Entering guacamole server.

Connect to your machine

Now you need to select a machine. Please then click on +em and then +Servers - Public and select your dedicated server (in this example it is Zeus-0-14).

Select a machine.

When you select the machine, you will prompted to use your EMBO21 UserID

Entering your personal course credentials.

This should access your virtual Linux XFCe desktop, which should look like this in your browser

Linux XFCe desktop

If you open a terminal (with the terminal icon) you can test by typing

pwd

that you are in the correct path, which should be:

 /d/embo2021/u/emboXX

where XX stands for your actual workshop participant number.

Load and run Dynamo

First you load the standalone version of Dynamo:

 module load dynamo/v1.1.524

and then it can be run by simply typing:

 dynamo
Dynamo console started.

Dynamo specific commands are then typed into this so called Dynamo console. For example, try to type the Dynamo command

dynamo_version

to see the current version that you are using. Note: Copy paste of commands from your local desktop into the dynamo standalone console on the remote Linux XFCe desktop might not always work. We suggest to additionally open the tutorials that you will be working on in a browser inside the remote Linux XFCe desktop itself, in case you need to copy paste long commands.

Data location

The data used in the tutorials is already available for you. Move to the directory of the corresponding practical using the command:

cd prac-5

or

cd prac-6

respectively. Double-check if the data is present by typing

ls

You should see the following files in both directories:

files

During the Dynamo workshop, work only within those two directories.

Time schedule

The course is divided into short presentations and tutorials, as described in the time schedule below. For the presentations, we all meet in the main room. The tutorials are structured as follows:

  1. Demonstration: All students stay connected to the main room for the first minutes, where the goals of the tutorial are explained.
  2. Individual work: Students go the assigned breakout rooms to work on the material independently. An instructor will be assigned to each breakout room to help with questions.
  3. Closure: During the last 5 minutes we come back to the general breakout room to wrap up the tutorial.


Day 1
Time Activity Topic
14:00 - 14:30 Presentation Introduction
14:30 - 15:30 Tutorial Tilt series alignment with GUI
15:30 - 16:00 Tutorial Tilt series alignment with command line
16:00 - 16:30 Break
16:30 - 17:00 Presentation Catalogues
17:30 - 18:00 Tutorial Models for helical symmetry
18:00 - 18:30 Tutorial Models for vesicles and surfaces
Optional: Tutorial Template matching
Day 2
Time Activity Topic
14:00 - 14:30 Presentation Introduction
14:30 - 15:30 Tutorial Starters guide
15:30 - 16:00 Tutorial Advanced starters guide
16:00 - 16:30 Break
16:30 - 18:15 Tutorial Advanced starters guide (continuation)
18:15 - 18:30 Presentation Closing remarks
Optional: Tutorials Virus like particles or Spherical geometries