The increasing complexity of research environments in higher education has prompted a shift toward digital tools that support data stewardship, reproducibility, and collaborative inquiry. Among these, Electronic Lab Notebooks (ELNs) have become central. Open source ELNs, in particular, offer alignment with the academic world's values of code transparency, FAIR data principals, low entry cost, and the possibility of customized connections to other data tools. On the other hand use of open source ELNs also raises important questions related to deployment, hosting, integration with infrastructure, sustainability, security, compliance and institutional capacity.
The digital lab; trends in ELN, LIMS and other research software
Discussions of scientific research data management, bioinformatics, trends in scientific software, 21cfr11 compliance and the role of the Electronic Lab Notebooks (ELN) and Laboratory Information management systems (LIMS) in modern research workflows and collaborations. If you are you a bioinformatics specialist or an ELN / LIMS vendor, user, integrator or developer, and you want to share your experiences with others, please feel contact me via the email link in my profile below.
Wednesday, April 16, 2025
Open Source Electronic Lab Notebooks (ELN) in Academic Research: Balancing Openness, Sustainability, and Institutional Readiness
The increasing complexity of research environments in higher education has prompted a shift toward digital tools that support data stewardship, reproducibility, and collaborative inquiry. Among these, Electronic Lab Notebooks (ELNs) have become central. Open source ELNs, in particular, offer alignment with the academic world's values of code transparency, FAIR data principals, low entry cost, and the possibility of customized connections to other data tools. On the other hand use of open source ELNs also raises important questions related to deployment, hosting, integration with infrastructure, sustainability, security, compliance and institutional capacity.
Tuesday, November 19, 2024
Coming in CERF 6: Improved support for using custom apps to perform mission-critical tasks and analyses on files stored in CERF.
Imagine you are a research organization that works with data files in some specialized format. A genetics lab working with GenBank .GBK or snapgene .DNA sequence files would be a good example. Now imagine your software engineers have written a custom app designed to perform some calculation or processing task on your data files, with the result or summary output to a new file.
Let's further imagine, that as a data manager, you need to have a good record of when any analyses where performed, who performed the analysis and precisely where the results of the analysis are stored. As it happens, this is a workflow that CERF ELN is very well pre-adapted to perform.
In most cases, users typically use CERF in conjunction with the default, industry standard applications on their local computer. An MS Word file, for example, may automatically open in MS Word, whilst your .DNA files may open in, say, snapgene. This workflow illustrates one of the unique advantages of a combined ELN and document management system that uses a desktop application to process your files. CERF carefully logs the interaction between the user and the files stored on the CERF server and displays all activity in the secure audit trail, so that managers are aware of current and past activity and access. In some cases, it may be advantageous to work with highly specialized applications that you've written yourself, designed specifically for performing specialized tasks on data that you stored in CERF. With CERF ELN, users can specify local applications on their computer that they would like to use to check out and edit specific file types. This allows users to optionally checkout files from CERF and open them in a non-default local application.
Lab-Ally has been working with bioinformatics students at the University of Maryland to create a toolbox of small accessory applications that can be used for processing various data files stored in CERF. Each academic term, as part of a capstone bioinformatics class, small groups of students (supervised by Lab-Ally) design, build and test an application of their choice. The application is designed to solve some common bioinformatics problem. An example is described below.
One team of 4 students recently built a GenBank extractor to make parsing genomic data easier and by utilizing this program you get a simplified output from the GenBank files that is readily compatible with CERF and the CERF search feature. The application can be used as a standalone tool or can be used integrated with CERF ELN to allow for superior record keeping, better efficiency and improved organization-wide collaboration. This parser is designed to extract essential information from GenBank files and output a readable .rtf file.
What Does the GenBank Parser Do?
The parser extracts important data from GenBank files, such as:
- Accession
- Organism (Genus species)
- Taxon data
- Gene(s)
- Genetic Sequence
It then organizes this data into an .rtf file, which is easy to read and compatible with most
platforms. Below is an example of what you will find in the output:
How to Use the Parser as a Standalone Application
Install the Application:
- Run the installation file on your computer
- Navigate to the executable file of the program: go to C:\Program Files\GenBankParser and double-click on GenBankParser.exe.
- A window should pop up with an "Open File" button.
- If the window doesn’t show up properly, try resizing the window. Some users have experienced this issue, and resizing the window can often solve it.
- After clicking the Open File button, choose a .gb or .gbff GenBank file from your system.
- The application will process the file and save an .rtf file to your desktop.
How to Use the Parser with CERF
- If you’ve installed the parser, the next step is to configure CERF so it can summon files from the CERF server on demand and utilize the parser tool. Without this step, CERF would simply open GenBank files in whatever the default sequence editing application is on the user's local machine.
- In CERF, navigate to Tools > Options > Applications.
- Add the GenBankParser by pointing to the .exe in C:\Program Files\GenBankParser.
- Set the MIME type to chemical/x-genbank. This helps CERF to understand what types of files you would like to open with the specified applicaiton
This is how Tools > Options > Applications should look once it's set up:
Viewing GenBank Files with CERF:
- Locate any .gb or .gbff file in CERF’s collections.
- Right-click the file, select View-in, and choose GenBankParser from the list.
- The parser will open, allowing you to process the file
- The application will process the file and save an .rtf file containing the results of the parser analysis to a specified local location.
- The file can then be dragged from the desktop into CERF, and specifically onto the associated file to have it pasted as a relation. This has the advantage that once added to CERF, the .rtf file is immediately indexed for searching so that users with the correct access permissions can search for target text that is located in the .rtf, and once they find THAT file, they can also locate the parent file containing the original raw sequence data.
CERF ELN 5.3 is proving to be a workhorse, and CERF 6 is now well underway.
Some of the new features added since CERF 5.0 include:
file viewer
View files and your folder hierarchy immediately in the center panel or in a new CERF window.
View files from notebooks in separate full-size windows to allow efficient comparison, examination and multitasking.
File viewer supports multiple windows to allow users to quickly compare any number of files.
File viewer is integrated with right-click throughout system to allow easy examination of versions, search results or any resource in CERF.
Better support for files of all types and viewing unsupported files using “official print copy” combined with the file viewer throughout the system.
search
More complete and logical columns to display more information about search results.
More useful search parameters with better organization. New parameters include signature status, activity status and edit status.
Export of results as .csv
More features associated with saved searches to make it easier to use them to generate reports.
Easier to reset searches.
Better options for learning more about characteristics and location of items in search results.
usability
Parity of features inside and outside notebooks
Extended list of template files to allow for creating content more easily in any location, including “standalone” text editor files in file cabinets and more.
Increased flexibility for making notebook entries of various types including plain text and RTF.
Menus, buttons, workflows, speed and stability reworked throughout.
New features to monitor, maintain and fix network connectivity and alert user to network problems.
Ability to instantly export .csv summaries from various locations including file info, audit trail.
Improved performance, especially for mature servers storing many thousands of files, documents and collections.
print to PDF
Numerous improvements to print to PDF process.
compliance and security
More complete information in audit trail with new section for access logs showing failed login attempts.
Hashing of resources in flight to prevent man-in-the-middle interception.
Improvements to controlled documents allowing for automated access to new items based on user acceptance of terms.
Exporter application for intuitive processing of exported xml files.
Full release notes for CERF 5.3 (current official release) can be tested by anyone - visit our website for instructions:
https://cerf-notebook.com/resources/getting-started-with-cerf-free-trial/
ongoing projects / CERF 6
Update to latest java, tomcat and mysql versions.
External helper apps for performing various actions on files stored within CERF.
Customizable user interface “themes” to allow users to control look and feel.
CERF 6 has of course turned into a massive project as we have jumped from Java version from 1.8 all the way to java 21. To give our customers maximum flexibility, we plan to support both the server and the client software on windows, mac and ubuntu environments with the server hosted either on-premise or on a private AWS instance managed by Lab-Ally. We also now offer customers TWO purchase options: Customers can choose our standard perpetual license, with an annual support plan, or to reduce up-front costs, customers can opt for an all-inclusive annual subscription model.
Tuesday, December 19, 2017
Market research reports - worth the money?
I have seen a proliferation of advertisements like this in our sector, and I am surprised that this could possibly be a viable business model, since most of the time the report actually consists of a list of vendors who PAID to have a short description of their product included, and then the "report" is sold for an outrageous fee to gullible execs who don't want to pick up the phone and talk to the ELN vendor directly, which they could easily do for free.
In my opinion, the only way to really find out if an enterprise software product does what you need for your organization is to actually try it in situ, and see for yourself if it solves your problem. Relying on the poorly informed advice of others seems like a lazy strategy, and relying on the paid of advice of anyone who has never even seen the product seems even worse.
Update... I see that another (or, possibly, the same) report is now also being advertised on linkedin here:
It's unfortunate that this article uses an uncredited image stolen from our website at:
http://cerf-notebook.com/articles/what-is-an-eln/.
The image clearly shows a mockup of one of our products, CERF ELN on the faux computer screen. The lazy use of this ripped-off image doesn't exactly reassure me that the content of the report is going to be professional, reliable and original. There is an argument that says any publicity is good publicity for our product, and maybe I should be flattered that they used this image, but they could have at least asked first. I feel like I owe it to my colleagues in science and data management to make sure they receive accurate information in any industry reports that they purchase. In this case, it seems unlikely that this report would contain anything that I couldn't also get for free from the vendor's website. In the words of a certain well known TV game show host turned part-time politician, this ELN report kinda seems like it might be "fake news".