A python toolkit for the automatic generation of elog entries of SEM analysis.
It is a hierarchical objects including several dedicated containers for similar objects. All dependent objects are automatically added during the execution of the watchdog and can be customized by the user via the Protocol Editor.
The typical structure of a protocol is the following:
It is recommended to subclass the base ELOGProtocol to cope the specificity of each microscope.
As said above, the basic Protocol is an almost empty class which cannot be used directly. It is meant as a prototype for all possible ways an analysis protocol can be implemented.
It's first daughter class is the ELOGProtocol, that is actually implementing the possibility to transfer its content
to a running eLog server. This is accomplished thanks to the elog package provided
by PSI.
Going down the derivative tree we find the QuattroELOGProtocol. This is a specialization of the ELOGProtocol because it includes the handling of navigation pictures that other microscopes do not have. The VersaELOGProtocol is another specialization of the ELOGProtocol very similar to the QuattroELOGProtocol but for the navigation images that are not present. There are subclasses for the XL40 and Vega microscopes as well.
In a similar way we have an inheritance tree for the MicroscopePicture.
It's first daughter is the FEIPicture where the specific FEI tags are read from the file and some relevant image parameters are then added to the microscope picture and included in the generated protocol.
Subclassed from the FEIPicture, we have the QuattroFEIPicture and the VersaFEIPicture where the ID is retrieved from the file name if it follows a standard naming convention. Moreover, there are two optional image treatments that can be applied on the fly while a FEIPicture is added to the protocol, it is to say the automatic calibration and the automatic databar removal.
A subclass of the MicroscopePicture being used for the Vega Tescan microscope. Differently from the FEI systems, this system is saving two files (a TIFF image and also plain text metadata file). The same metadata are also encoded in the TIFF file and can be parsed. The plain text file is anyhow copied to mirroring folder in case the final user wants to read it. The microscope software can save the images in two formats: TIFF (recommended) and JPEG. For TIFF files, it is possible to perform automatic image calibration, using the metadata information. For JPEG files, since no information can be written in the file, it makes no sense to perform any image pre-treatment.
A subclass of the MicroscopePicture being used for the XL40 Philips microscopes. This is kind of special because the metadata are stored in XMPMETA xml format and, even more, complex is the handling of multi-page tiff files (one page for the SE and one for the BSE). As for other subclass, it is possible to automatic calibrate the TIFF file. No databar crop is possible since the additional information are printed on top of the image itself.
The role of the autologbook package is to build a protocol for the analysis session. The automatic procedure is sorting
all acquired elements (navigation and microscope pictures, videos, sample and subsamples, pdf reports...) in a standard
form, but the microscope operator or the final user may want to customize the protocol comments adding some extra
information. The best way would be to edit the output HTML page directly on the ELOG server, but this is not possible
during the analysis itself, because as soon as a new element is added to the protocol, autologbook will regenerate the
complete HTML content and replace it with the existing one on the server. In other words, all modifications made on the
HTML directly on the ELOG page while the autologbook watchdog is running, will be sooner or later lost.
A possible solution is to wait until the end of the analysis session before starting doing all the customizations, but
this is for sure not really practical.
The solution adopted by the autologbook is to let the user customize his protocol via the ProtocolEditor dialog. It
is activated during the execution of the watchdog by pressing the corresponding push button on the main window.
The protocol editor window is featuring three columns, on the left side a tree view widget where the protocol structure
is shown along with a list view where only elements contained in the selected sample are displayed. These two views are
synchronized, so when an element is selected on one view, it is also selected on the other. By selecting an element on
these two views, all fields in the central and right part of the window are updated. In the central area, there is a
preview frame where images and videos can be displayed along with a tabular view where the selected item metadata are
listed.
Three customization fields are available for the user on the right side: the caption (available only for images and
videos), the description and the extra information. The information inserted into these fields are passed to the
yaml customization file and consequently to the logbook.
All parameters allowing the proper functioning of the tool can be configured either via a configuration file or directly
in the GUI via the ConfigurationEditorDialog.
The configuration file (*.ini) is parsed with the ConfigParser module.
If started on the command line, the user can select which configuration file to use by using the option -c or
--conf-file.
An experiment file (*.exp) is also a configuration file where an additional section 'GUI' is added and that
contains all the values of the various widgets. In this way the same protocol can be regenerated in a few mouse clicks.
Installation of the AUTOLOGBOOK is extremely easy and it is based on pip. The procedure to follow is slightly
different if you intend to just to use the package or if you want to work on its development.
Both approaches are described here below.
If you follow this procedure you won't be able to modify the package source and you will just use it as it is or include it in your package as a library. The best approach is to isolate all your installations in a separate enviroment so not to corrupt any other working tools.
rem Generate a fresh environment
python -m venv autologenv
cd autologenv
rem Activate the enviroment
Scripts\activate.bat
rem Just install latest autologbook version from PIP
pip install autologbook
For running, autologbook needs that a few dependencies to be fulfilled. You don't have to worry about this because pip is taking care of the task, but here below a list of requirements is reported just for you to know.
The autologbook package has been developed with python 3.10.5 In principle, it should be working also with other versions, but it was never tested. Here is a list of the most important packages needed for execution of the autologbook.
The complete list of requirements is included in the requirements.txt file distributed with the package. However, if the user decides to install autologbook via pip link, the installation procedure will take care of installing all needed dependencies.
A minor bug fix has been included in the latest master branch of the py_elog package. This is to avoid double attachment uploads for files with blanks in the filename. This bug fix will be released with the next py_elog release (1.3.16), but until this will be available, just build the source.
Pip allows you to install a package in development mode so that you can have it install in your environment but at the same time you can keep to modify its source. Here is a simplified procedure.
rem Generate a fresh environment
python -m venv autologenv
cd autologenv
Scripts\activate.bat
rem Get the source code from GitHub
git clone https://github.com/abulgher/autologbook.git
rem Install the requirements for development purpose
pip install -r autologbook\requirements-dev.txt
rem Install the package in development mode
pip install -e autologbook
To run the autologbook module you just need to activate your python enviroment and enter the commands as here below.
rem Create a dedicated enviroment if you don't have it already
py -m venv myenv
cd myenv
rem Activate your python enviroment
Scripts\activate.bat
rem Install the autologbook module
pip install autologbook
rem Start the GUI
python -m autologbook
Using python -m autologbook -h, you can get a list of command line options and flags to be used.
Another possibility is to use the executable file that is generated during the building process. This can be found in the Script folder of your python enviroment. Type from a cmd shell autologbook-gui.exe or just double-click on it to get started.
autologbook is posting logbook entries to ELOG and while the connection details (hostname, port, username...) and the microscope specific logbook are parameters that can be adjusted by the user via the configuration file, the logbook structure is hardcoded and cannot be modified without having to recode a large fraction of the code.
The expected logbook structure is shown in this image:
When creating a dedicated logbook for a microscope to be used with autologbook, its structure must reflect this image and can also be copied from this elog configuration file snippet:
Theme = default
Comment = Logbook of Quattro analyses
Time format = %Y-%m-%d %H:%M:%S
Date format = %Y-%m-%d
Display mode = summary
Summary lines = 0
Reverse Sort = 1
;------------- Define here all the attributes -------------------
Attributes = Operator, Creation date, Protocol ID, Project, Customer, Edit Lock
Required attributes = Operator, Protocol ID, Project, Customer
;---------- OPERATOR
Preset Operator = $long_name
Subst Operator = $long_name
;---------- CREATION DATE
Type Creation date = date
Preset Creation date = $date
;---------- Protocol ID
Comment Protocol ID = Please provide the numeric digits of the protocol
;---------- Project
Comment Project = Please provide the project name (usually the second part of the folder name)
;---------- Customer
Comment Customer = Please provide the customer name (usually the third part of the folder name)
;---------- Edit Lock
ROptions Edit Lock = Protected, Unprotected
Preset Edit Lock = Unprotected
Comment Edit Lock = Use this switch to protect the entry against accidental automatic editing.
List display = ID, Creation date, Operator, Protocol ID, Project, Customer
Link display = ID
Quick filter = Protocol ID, Project, Customer
Starting from release v0.0.1.b.1, an Edit Lock flag has been introduced in the eLog structure. This is meant to protect an elog entry from accidental automatic editing. For example, after an elog entry has been generated with the autolog, the user decided to customize its content using the web editor interface instead of the Protocol Editor GUI. If the autologbook watchdog will be started again in the same folder, the standard HTML protocol will be generated and will replace the user customized one. In order to protect against this automatic re-editing, the user can set the Edit Lock to Protected and the autologbook will consider this entry as read-only.
When a read-only entry is found, the user is asked to decide what to do, (s)he may want to override the read-only flag regenerating the HTML content from the original protocol content, or to back up the read-only entry and generate a new one for the current protocol, or, as a last option, to change the protocol identification number for the current experiment.
WARNING. The check of the read-only flag is performed only before the watchdog is started. This means that if the user is protecting the entry while the watchdog is still running, this will be totally ignored.
Creating a new experiment from scratch can be tough and error-prone. In particular, you may not remember what is the right (and unique) protocol number to be used. The easiest way is to start the experiment wizard and let it guide you in the process. You can use this tool for creating a brand-new experiment from scratch or to continue an existing experiment. In both cases, the wizard will exchange information with the microscopy protocols list and either download or prepare the experiment file for the user.
To start the experiment wizard is included in the standard installation. You just need to start it either by
launching experiment-wizard.exe from the Script folder of your python enviroment or simply double-clicking on it.
Along with the main automatic logbook generation, the package comes with a series of useful labtools executables (mainly CLI, but also GUI). Those executables will be available in the Scripts directory of your virtual enviroment.
FAQs
A python toolkit for the automatic generation of elog entries of SEM analysis.
We found that autologbook demonstrated a healthy version release cadence and project activity because the last version was released less than a year ago. It has 1 open source maintainer collaborating on the project.
Did you know?
Socket for GitHub automatically highlights issues in each pull request and monitors the health of all your open source dependencies. Discover the contents of your packages and block harmful activity before you install or update your dependencies.
Security News
PyPI confirms no security flaws were exploited in the Ultralytics supply chain attack and highlights improvements for safer package publishing.
Security News
Research
The Socket Research Team breaks down a malicious wrapper package that uses obfuscation to harvest credentials and exfiltrate sensitive data.
Research
Security News
Attackers used a malicious npm package typosquatting a popular ESLint plugin to steal sensitive data, execute commands, and exploit developer systems.