User Manual

Create an annotation set


To create a new annotation set:

  1. Open the slide in the slide viewer
  2. Click the Show slide list button in the lower left corner, if the slide list panel is not already visible
  3. Click on the Annotations tab
  4. Click the ⋮  (more options) button
  5. In the pop-up menu click on the Create new... option
  6. In the pop-up dialog, type in a name for the annotation set
  7. Click the Create button
  8. The new set is created and automatically selected in the Annotation set selection menu


Video: Creating a new annotation set

 

Select an annotation set


In order to start annotating, an annotation set needs to be selected first.

Only then, the annotation tools will become visible in the slide viewer control bar.

All annotations will be added to the currently active set.

To select an annotation set and start using the annotation tools:

  1. Open the slide in the slide viewer
  2. Click the Show slide list button in the lower left corner, if the slide list panel is not already visible
  3. Click on the Annotations tab
  4. Select an annotation set from the drop-down
  5. The annotation tools will appear in the slide viewer control bar


Video: Selecting an exsiting annotation set

 

Draw a polygon


To draw a polygon:

  1. Click on the polygon tool
  2. Click on the collapsed class panel
  3. Select an annotation class for drawing
  4. Start drawing


Video: Drawing a polygon annotation


All closed polygon annotation, except for field of view (FOV) class type, can display a total surface area of that annotation upon drawing. Labels are hidden by default. You can toggle label visibility by toggling the Show labels button in the control bar at the bottom of the image viewer, or using the keyboard shortcuts.

Inner area of all closed polygon annotation, except for field of view (FOV) class type, will now be filled in. This helps distinguish areas that belong to an annotation. FOV annotations will still be fully transparent for an easier annotating.

You can turn the fill off, or change it's transparency level using the Display tools panel. The settings are remembered per user per session, so if you close the browser and come back to CP Portal, settings are reset to default.


Image: Closed region annotation's inner area filled in

In the region annotation panel, each region annotation has an index assigned to it and is shown as part of the annotation name. Index is unique per combination of the Annotation Set together with the annotation class.

Index is an auto-incremented, auto-assigned integer, starting from 1. If an annotation is deleted, the index is skipped for all future annotations, and the "counting" continues from the last index. There is no re-using of used indexes per Annotation Set&Class combination. Indexes will be written in the annotation XML, when exporting annotations using PyPortal.

 

Draw a circle or square annotation


To draw a circle or a square polygon:

  1. Click on the square tool. It will turn blue
  2. Select circle or square shape from the panel
  3. Enter a diameter of side length
  4. Select annotation class
  5. Place the shape on the image by pushing the primary mouse button
  6. When you are done drawing, de-activate the square tool by clicking on the tool symbol. It will turn grey


Video: Drawing FOV (field of view) square and circle annotations

 

Draw a line with the polygon tool


To draw a line:

  1. Click on the polygon tool. It will turn blue
  2. Select an annotation class for drawing
  3. On the region where you want to draw the line, push the primary mouse button down
  4. Push the Shift key down and keep it pressed while also keeping the primary mouse button pressed
  5. Draw the line with the mouse
  6. Release the Shift key
  7. Release the primary mouse button
 

Measure distance


To measure the distance between two points on a slide:

  1. Click on the Ruler tool. It will turn blue
  2. Click on the slide where you want to start your measurement (first point)
  3. Click on the slide where you want to end your measurement (second point)

The CP Portal will automatically draw a line connecting the two points and will display the distance between them.


Video: Measuring a distance between two points

 

Correct an annotation


Follow these steps to correct a polygon:

  1. Click on the polygon tool to activate it. It will turn blue
  2. Hover with the mouse over the outline you want to correct
  3. A dot and a circle around it will appear
  4. Press the primary mouse button and redraw the outline
  5. When you are done correcting, de-activate the polygon tool by clicking on the symbol. It will turn grey
 

Errors in annotations


The system automatically looks for errors in annotations when you open an annoation set or create a new annotation. If an error is found, it is highlighted with a red circle.

Following error types can be detected:

  • Double coordinates (having the same coordinate twice)
  • Sticks (line like spikes in the annotation boarder)
  • Self-intersections
  • Line annotations/polygons that are not closed (unless for the class Invasive Margin line annotation are highlighted as errors)

  • Image: Example of annoation errors: Sticks, self-intersection, open polygon (from left to right)

    You can fix errors in annoations manually using the polygon tool, or fix them automatically. To fix errors automatically, open “Set actions” above the Annotation Set selection and choose “Fix Annotations”


    Image: Fix annotation option in annoation set action menu

 

Delete annotations with keyboard


To delete a single annotation:

  1. While all drawing tools are inactive, select the annotation with the mouse
  2. It will get highlighted
  3. Press the Delete key on your keyboard

To delete multiple annotations:

  1. While all drawing tools are inactive, press the Shift key and draw a section rectangle over the annotations your want to multi-select
  2. When you release the mouse button, selected annotations are highlighted
  3. Press the Delete key on your keyboard
 

Change the annotation class


To reclasiffy an annotation class:

  1. On the slide, select an annotation with the mouse
  2. It will get highlighted
  3. You can also change multiple annotations at once
  4. Press the Shift key and draw a selection rectangle over the annotations your want to multi-select
  5. Right click and select another annotation class from the context menu

Alternatively, you can reclassify annotation class:

  1. Check one or multiple annotations you want to change in the annotation table in the side panel
  2. They will get highlighted
  3. Click on the 3 dots (more options) next to the region annotations table
  4. Select Set class from the context menu
  5. Select another annotation class from the context menu

Please note that reclassifying FOV annotations is not allowed and is disabled.

 

Transform a region annotation


When you activate the transform tool, you can click on any annotation to select it. The annotation will get highlighted and surrounded by a rectangle shape. You can also multi-select several annotations with the SHIFT key.

With this rectangle, you can transform the annotations:

  • Rotate
  • Shrink
  • Expand
  • Move

Video: Transforming annotations

 

Undo and Redo annotation actions


With the undo and redo buttons, you can undo/redo up to 150 annotation steps.

 
 

Keyboard shortcuts in image viewer


The following shortcuts are available while working in the Image viewer.

Action PC Mac Comment
Hide all annotations ALT + a Option + a This includes cell marker annotations, region annotations, and distance measurements.
Hide all labels ALT + s Option + s This will hide all labels of the ruler measurements and of the annotation surface areas.
Hide all results ALT + r Option + r This will hide the entire DRC results overlay.
Panning slide while drawing tool is active ALT + mouse move Option + mouse move While you are still in the drawing mode, press Alt to move the slide. Stop pressing Alt and you can continue drawing.
Rotate slide ALT + SHIFT + mouse move Option + SHIFT + mouse move This will rotate the entire slide with all its associated annotations and results.
Draw a line with polygon tool SHIFT + mouse SHIFT + mouse Start drawing and then press Shift. To draw a line, keep Shift pressed until you release the left mouse button.
Select multiple annotations (one by one) CONTROL + mouse click COMMAND + mouse click To keep adding specific polygons to already selected polygons, press the Control or Command key and click on the specific polygon with your left mouse button
Select multiple annotations (selection rectangle) SHIFT + mouse move SHIFT + mouse move While all drawing tools are inactive, press the Shift key and draw a rectangular shape over the annotations you want to multi-select
Delete selected annotation DELETE FN + backspace Select annotations you want to delete and then press the DELETE or FN + backspace keys
Cell marker shortcuts Can be set by user, any key Can be set by user, any key You can set a separate key for each individual class and score in the CMA panel

 

Create a cell marker


To place a cell marker annotation on a slide:

  1. Click on the Cell Marker Annotation tool (the target icon)
  2. Click on the Add class button
  3. Select a cell marker class you wish to place on the slide, from the list of supported classes
  4. Add multiple markers you need, by repeating steps 2 and 3
  5. From the list of selected classes, choose 1 class to place it on the slide
  6. Select the rating mode you want to use: Rating or Intensity score
  7. Select the rating or intensity score you want to apply

    • You can select a positive (+), negative (-), or an ambiguous (?) rating
    • You can select a 0, 1+, 2+, or 3+ intensity score
  8. Start placing cell marker annotations by left-clicking on the desired positions on the slide


Video: Place CMAs on a slide

 

Add multiple cell markers to one cell


To place multiple cell marker annotation on the same cell:

  1. Click on the Cell Marker Annotation tool (the target icon)
  2. Click on the Add class button
  3. Select a cell marker class you wish to place on the slide, from the list of supported classes
  4. Add multiple markers you need, by repeating steps 2 and 3
  5. From the list of selected classes, choose 1 class to place it on the slide
  6. Select the rating mode you want to use: Rating or Intensity score
  7. Select the rating or intensity score you want to apply

    • You can select a positive (+), negative (-), or an ambiguous (?) rating
    • You can select a 0, 1+, 2+, or 3+ intensity score
  8. Place a cell marker annotations by left-clicking on the desired positions on the slide
  9. Select a second marker you want to place on the slide
  10. Select the rating you want to apply
  11. Place a cell marker by clicking on the previously placed cell marker of a different class


Video: Place multiple CMAs on the same cell on a slide

 

Delete a cell marker


To delete a cell marker:

  1. Click on the Cell Marker Annotation tool (the target icon)
  2. Click on the Add class button
  3. Select the class of the cell marker you wish to delete
  4. From the list of selected classes, choose 1 class to place it on the slide
  5. Using the same class, click on the marker you wish to delete

Video: Delete CMAs from a slide


 

Annotation versions


All annotation changes are cpatured as separate version. To open a versions overview:

  1. Open an annotation set in an image viewer
  2. Click on the More menu (three dots above annotation set selection)
  3. Click on the Versions... option

This will open the Versions dialog in the image viewer, where you can select an annotation version.

You can check the version differences visually in the image viewer, and you can choose which version you wish to download. Selecting a version from the version drop-down list, will display that version in the image viewer, in a non-editable (view-only) mode. Selecting a different version from the drop-down list, will change the displayed version in the image viewer.

To download a particular version, select the version from the drop-down list and click on the Download button. This will generate a job in the jobs panel. From the jobs panel you can download the prepared XML, as well as the log of the requested job.

 

Link annotation set


It is possible to share annotation sets across multiple projects if these projects share the slide the annotation set is created on. This functionality is called linked annotation.

If the annotations within a linked annotation set is changed in any project, these changes are available in all other projects as well.

To link an annotation set to another project it is necessary that

  • The slide the annotation set is created on is part of the target project
  • The user has writing rights in the source project and the target project
  • The target project has no annotation set created on the same slide with the same name

To link an annotation set:

  1. Open the slide in the slide viewer
  2. Click the Show slide list button in the lower left corner, if the slide list panel is not already visible
  3. Click on the Annotations tab
  4. Create a new or open an existing annotation set that you want to link
  5. Click the more menu button
  6. In the pop-up menu click on the Link set... option
  7. In the Select project window check the box of all projects you want to link the annotation set to
  8. Click the Next button in the lower right corner of the window
  9. Click the Finish button in the lower right corner of the window
  10. The annotation set is now linked to the selected projects. A small chain icon next to the annotation set name shows that the annotation set is linked to other projects

To unlink an annotation set you can follow the same steps, but uncheck the boxes at the respective projects. Note, that if an annotation set is unlinked from a project, it is deleted from that project.

It is not possible to unlink an annotation set from all projects. It needs to be part of at least one project.

 

Create polygons with Segment Anything


Segment Anything AI model is able to suggest annotations to the user.

The suggestion is based on the currently selected view on the slide and can be manipulated by the user through drawing a bounding box and through adding positive and negative markers.

To create an annotation with the Segment Anything Tool:

  1. Open the slide in the slide viewer
  2. Click the Show slide list button in the lower left corner, if the slide list panel is not already visible
  3. Click on the Annotations tab
  4. Create a new or open an existing annotation set
  5. Click on Toggle SAM panel (stars icon) in the tool bar below the slide
  6. In the SAM panel select one of the three tools and the annotation class
  7. Start placing positive or negative markers and/or a bounding box in the relevant area of the annotation
  8. See the blue overlay on the slide which is the current suggestion of the model
  9. Add additional positive or negative markers until the suggestion is satisfying
  10. Click accept to transfer the suggestion into a polygon annotation
  11. Leave the polygon as is or use the drawing panel to further manipulate the polygon (see Correct an annotation)

Note: Zooming is not possible while the SAM panel is activated, because the currently selected view on the slide is provided to the model as input. If you need to change the view on the slide turn the SAM panel off adjust your zoom and view on the slide and activate the SAM panel again.