Releases: lumicks/pylake
Releases · lumicks/pylake
v1.2.1
Bug fixes
- Fixed
lk.download_from_doi()
to align with new Zenodo REST API. - Fixed a bug where the minimum length field of an exported
KymoTrackGroup
was formatted as an integer resulting in rounding errors when storing the tracks. Note that an incorrect minimum length can lead to biases when performing dwell time analysis. These values are now properly formatted as floating point numbers. The entry in the header was also changed to "minimum observable duration (seconds)" for additional clarity. This bug was introduced in version1.2.0
. - Fixed a bug that prevented resaving a
KymoTrackGroup
loaded from an older version of Pylake. - Fixed a bug that inadvertently made us rely on
cachetools>=5.x
. Older versions ofcachetools
did not pass the instance to the key function resulting in aTypeError: key() missing 1 required positional argument: '_'
error when accessing cached properties or methods. - Fixed a bug that could cause a division by zero while fitting power spectra with
f_diode
. The lower bound off_diode
was changed from 0 to 1.0 Hz. This change should not impact results unless users were getting failed calibrations with this error. - Fixed a layout issue that made the sliders appear so narrow in
jupyterlab
that they were not visible.
v1.2.0
New features
- Added fitting mode
"simultaneous"
tolk.refine_tracks_gaussian()
which enforces optimization bounds between the peak positions. This helps preventlk.refine_tracks_gaussian()
from reassigning points to the wrong track when a track momentarily disappears andoverlap_strategy
is set to"multiple"
andrefine_missing_frames
is set toTrue
. When fitting mode is set to"simultaneous"
, bounds ensure that the individual Gaussians cannot switch position. In addition, this mode uses a better initial guess for the peak amplitudes based on the maximum photon count observed in each range. - Added the option to take into account discretization effects in
DwelltimeModel
by passing adiscretization_timestep
to the model when constructing it. - Added the option to take into account discretization effects when performing dwell time analysis on a
KymoTrackGroup
. Simply passdiscrete_model=True
toKymoTrackGroup.fit_binding_times()
to make use of this new functionality. - Added the optional parameter
loss_function
tofit_power_spectrum()
. Implemented loss functions are"gaussian"
(default) and"lorentzian"
. The default corresponds to regular least-squares fitting, whereas"lorentzian"
invokes a robust fitting method that is less susceptible to spurious peaks in the power spectrum which comes at the cost of a small bias in the estimates for a spectrum without noise peaks. Furthermore, no estimates of the errors in the fitted parameters are provided. This is beta functionality. While usable, this has not yet been tested in a large number of different scenarios. The API can still be subject to change without any prior deprecation notice! - Added
PowerSpectrum.identify_peaks()
method to thePowerSpectrum
class. This method uses probability to identify peaks in the spectrum that are not due to the movement of beads in an optical trap. This is beta functionality. While usable, this has not yet been tested in a large number of different scenarios. The API can still be subject to change without any prior deprecation notice! - Added
KymoTrack.plot_fit()
andKymoTrackGroup.plot_fit()
to show the fitted model obtained from gaussian refinement. - Added the ability to specify a cropping region when exporting to an h5-file using
file.save_as(filename, crop_time_range=(starting_timestamp, ending_timestamp))
. - Added method to create colormaps approximating a color from emission wavelength. See
lk.colormaps.from_wavelength()
for more information. - Added support for accessing
Kymo
,Scan
andPointScan
by path (e.g.file["Kymograph"]["my_kymo"]
orfile["Kymograph/my_kymo"]
). - Added support for slicing
PointScan
.
Bug fixes
- Fixed issue in dwell time analysis that could lead to biased estimates for kymographs with very few events. Before this fix
KymoTrackGroup.fit_binding_times()
relied on the assumption that the shortest observed track is actually the minimum observable dwell time. This assumption is valid for kymographs with many events; however, this becomes problematic when multiple kymographs with few events each are analyzed globally. In this case, binding times will be underestimated. With this fix, the minimum observable dwell time is calculated from the kymograph scan line time and the set minimum track length.- The old (incorrect) behavior is maintained as default until the next major release (
v2.0.0
) to ensure backward compatibility. - To enable the fixed behavior immediately (recommended), specify
observed_minimum=False
when callingKymoTrackGroup.fit_binding_times()
. - To maintain the old legacy behavior use
observed_minimum=True
. - Note that CSVs exported from the kymotracking widget before
v1.2.0
will contain insufficient metadata to make use of the improved analysis. To recover this metadata, uselk.filter_tracks()
on theKymoTrackGroup
with a specifiedmin_length
. This filters short events and stores the new minimum observable duration in the group.
- The old (incorrect) behavior is maintained as default until the next major release (
Other changes
File.save_as()
data now allows passing in a single string for theomit_data
parameter.- Gracefully handle empty
Scan
after slicing. Previously, a slice operation on aScan
that resulted in no frames remaining raised aNotImplementedError
. Now it returns anEmptyScan
. - Improved performance of
Scan.pixel_time_seconds
,Kymo.pixel_time_seconds
andKymo.line_time_seconds
. - Dropped
opencv
dependency which was only used for calculating rotation matrices and performing the affine transformations required for image alignment. Pylake now usesscikit-image
for this purpose. - Marked functions that take file paths as arguments with the
os.PathLike
type hint to idicate thatpathlib.Path
and similar types are also accepted (not juststr
). - Use Unicode characters for µ and ² when plotting rather than TeX strings.
Deprecations
- Deprecated fitting mode
"multiple"
inlk.refine_tracks_gaussian()
as it could lead to spurious track crossings. See the entry for the fitting mode"simultaneous"
underNew Features
for more information.
v1.1.1
- Fixed parameter description for minimum length. It now correctly reads that increasing this parameter reduces tracking noise.
- Rarely used but heavy packages like
opencv
,scikit-image
, andscikit-learn
are no longer loaded eagerly withimport lumicks.pylake
. Rather, they are loaded on-demand the first time that a feature needs them. This makes importingpylake
itself faster and mitigates potential third-party issues (e.g. this makes the first issue from the F.A.Q. less severe as it no longer affects all users).
v1.1.0
New features
- Enabled adding
KymoTrackGroup
instances with tracks from different source kymographs. Note that certain features (e.g.,KymoTrackGroup.ensemble_msd()
andKymoTrackGroup.ensemble_diffusion("ols")
) require that all source kymographs have the same pixel size and scan line times. See the kymotracking tutorial for more information. - Added
DwelltimeModel.profile_likelihood()
for calculating profile likelihoods for dwell time analysis. These can be used to determine confidence intervals and assess whether the model has too many parameters (i.e., if a model with fewer components would be sufficient). See the population dynamics tutorial for more information. - Added functionality to split tracks in the Kymotracking widget.
- Added functionality to provide minimum and maximum observation times per data point to
DwelltimeModel
andDwelltimeBootstrap
.
Bug fixes
- Fixed a bug that would round the center of the window to the incorrect pixel when using
KymoTrack.sample_from_image()
. Pixels are defined with their origin at the center of the pixel, whereas this function incorrectly assumed that the origin was on the edge of the pixel. The effects of this bug are larger for small windows. For backward compatibility this bugfix is not enabled by default. To enable the bugfix specifycorrect_origin=True
as a keyword argument to the method. - Fixed bug that could lead to mutability of
Kymo
andScan
through.get_image()
or.timestamps
. This bug was introduced in0.7.2
. Grabbing a single color image from aScan
orKymo
using.get_image()
returns a reference to an internal image cache. This numpy array was write-able and modifying data in the returned image would result in future calls to.get_image()
returning the modified data rather than the originalKymo
orScan
image. Timestamps obtained from.timestamps
were similarly affected. These arrays are now returned non-writeable. - Fixed a bug where we passed a
SampleFormat
tag while saving totiff
usingtifffile
. However,tifffile
infers theSampleFormat
automatically from the datatype of thenumpy
array it is passed. This produced warnings on the latest version oftifffile
when running the benchmark. - Ensure that the probability density returns zero outside its support for
DwelltimeModel.pdf()
. Prior to this change, non-zero values would be returned outside the observation limits of the dwelltime model. - Fixed a bug where
DwelltimeModel.hist()
produces one less bin than requested withn_bins
. - Fixed a bug where
lk.dsdna_ewlc_odijk_distance()
erroneously returned a model where force is the dependent variable rather than distance. This bug was introduced in0.13.2
. Note thatlk.ewlc_odijk_distance()
was unaffected. It was specifically the convenience function with DNA parameters that was affected.
Improvements
- Improve API description of the channel data in a default
FdCurve
. - Improved fitting performance dwell time analyses by implementing analytic gradient.
- Added lower and upper bounds when fitting dwell time models. This prevents numerical issues that occur when approaching these extremes. Prior to this change, over-parameterized models could encounter numerical issues due to divisions by (near) zero. After this change, amplitudes are constrained to stay between
1e-9
and1.0 - 1e-9
, while lifetimes are constrained to remain between1e-8
and1e8
. - Provided better initial guess for dwell time models with three or more components. Prior to this change, the dwelltime models involving three components or more would get an initial guess with an average lifetime beyond the mean of the observations.
- Silenced false positive warnings about the optimization violating the bound constraints. Prior to this change, dwell time analysis would produce warnings about the optimizer exceeding bounds. These excursions beyond the bound are very small and have no effect on the model.
- Parameters corresponding to Gaussian refinement are now preserved when two refined tracks are concatenated.
- Set the minimum value for the
Min length
slider in the Kymotracking widget to2
.
v1.0.0
New features
- Added links to example data for all tutorials. Try running them in a
jupyter
notebook! - Added API to create a
Kymo
from anImageStack
. SeeImageStack.to_kymo()
for more information. - Added API for accessing notes in a h5 file, i.e.
file.notes
returns a dictionary of notes. - Implemented bias correction for centroid refinement that shrinks the window to reduce estimation bias. This bias correction can be toggled by passing a
bias_correction
argument tolk.track_greedy()
andlk.refine_tracks_centroid()
. Note that this bias correction is enabled by default. - Implemented spatial calibration for
ImageStack
. Images are now plotted in units of microns for TIF files which contain pixel size in the metadata. If the metadata is unavailable, the axes units are provided in pixels. - Added option to show scale bars to image plots using
lk.ScaleBar()
. See plotting and exporting for an example. - Added
KymoTrackGroup.remove()
to remove aKymoTrack
from aKymoTrackGroup
. - Enabled boolean array indexing (e.g.
tracks[[False, False, True]]
) and indexing with arrays of indices (e.g.tracks[[1, 3]]
) forKymoTrackGroup
. See the API documentation for more information. - Improved force calibration documentation. See the new Tutorial and Theory section.
- Added API to look up (pixel)size of an
ImageStack
. SeeImageStack
for more information. - Enabled forwarding plot style arguments to
Slice.range_selector()
. Prior to this change, a plot with markers was always opened which resulted in very poor performance when plotting high frequency data.
Breaking changes
- Pylake now requires Python version
>= v3.9
and matplotlib version>= v3.5
- When performing particle tracking on kymographs, bias correction is now enabled by default; without this correction, kymographs with high background signal will suffer from biased localization estimates. To disable bias correction, specify
bias_correction=False
tolk.track_greedy()
andlk.refine_tracks_centroid()
. - The function
ImageStack.define_tether()
now takes coordinates in calibrated spatial units (microns) rather than pixels. If calibration to microns is not available, units are still in pixels. - Optional arguments for
lk.track_greedy()
andlk.track_lines()
are now enforced as keyword only. - The
vel
argument has been renamed tovelocity
forlk.track_greedy()
. lk.track_lines()
now performs bias-corrected centroid refinement after tracking to improve localization accuracy. Note that the old behaviour can be recovered by passingrefine=False
.- When removing tracks with the kymotracking widget, only tracks that are entirely in the selection rectangle will be removed. Prior to this change, any tracks intersecting with the selection rectangle would be removed.
- Added checks which enforce
KymoTracks
in aKymoTrackGroup
to be unique. Extending aKymoTrackGroup
withKymoTrack
instances that are already part of the group will now result in aValueError
. Similarly, constructing a newKymoTrackGroup
with duplicateKymoTracks
will also produce aValueError
. - Removed all deprecated methods and properties from
Kymo
,Scan
,PointScan
, andImageStack
. - Removed deprecated methods
KymoTrack.estimate_diffusion_ols()
andKymoTrackGroup.remove_lines_in_rect()
- Removed deprecated functions
filter_lines()
,refine_lines_centroid()
andrefine_lines_gaussian()
. - Removed deprecated property
lines
and methodsave_lines
fromKymoWidgetGreedy
. - Removed deprecated argument
exclude
fromKymo.line_timestamp_ranges()
andScan.frame_timestamp_ranges()
. Use the argumentinclude_dead_time
instead. - Removed deprecated argument
line_width
fromlk.track_greedy()
. - Changed several
asserts
toExceptions
.- Attempting to read a
KymoTrackGroup
from aCSV
file that doesn't have the expected file format will result in anIOError
. - Attempting to extend a
KymoTrackGroup
by aKymoTrackGroup
tracked on a differentKymo
now results in aValueError
. - Attempting to connect two tracks with the same start and ending time point now raises a
ValueError
. - FdFitter:
FdFit.fit()
now raises aRuntimeError
when a fit has no data or fittable parameters. - FdFitter:
FdFit.plot()
now raises aKeyError
when trying to plot data that does not exist. - FdFitter:
FdFit.plot()
now raises aRuntimeError
when trying to plot a fit with multiple models without selecting a model using angular brackets[]
first. - FdFitter:
FdFit.profile_likelihood()
now raises aValueError
whenmax_step <= min_step
ormax_chi2_step <= min_chi2_step
. - FdFitter: when inverting a model with
interpolate=True
, Pylake now raises aValueError
if the minimum or maximum is not finite. - FdFitter: a
ValueError
is raised when adding incompatible models. - FdFitter: When adding data to a fit, adding data with an unequal number of points for the dependent and indep...
- Attempting to read a
v0.13.3
New features
- Added
KymoTrackGroup.ensemble_diffusion()
for estimating an average diffusion constant for a collection of tracks. - Added diffusion theory section which details methods used for quantifying diffusive motion. Note that this documentation can be downloaded and run inside a Jupyter notebook.
- Added
KymoTrack.plot()
andKymoTrackGroup.plot()
methods to conveniently plot the coordinates of tracked lines. See the kymotracking documentation for more details. - Added the
lk.GaussianMixtureModel.extract_dwell_times()
method to calculate dwell-times for all states from channel data. - Added
lk.colormaps
with custom colormaps for plotting single-channel images. Note: this is anamedtuple
so you can access the attributes using the dot notation (for examplekymo.plot("blue", cmap=lk.colormaps.cyan)
). The available attributes arered
,green
,blue
,magenta
,yellow
,cyan
. - Added
localization_variance
toDiffusionEstimate
. This quantity is useful for determining the diffusive SNR. - Added
variance_of_localization_variance
toDiffusionEstimate
when calculating an ensemble CVE. This provides an estimate of the variance of the averaged localization uncertainty. - Added option to pass a localization variance and its uncertainty to
KymoTrack.estimate_diffusion()
. - Added option to calculate a diffusion estimate based on the ensemble MSDs using the Ordinary Least Squares (OLS) method.
- Added
DwelltimeBootstrap.extend()
to draw additional samples for the distribution.
Bug fixes
- Fixed a bug that resulted in an incorrect round-off of the window size to pixels when kymotracking. This bug resulted in using one more pixel on each side than intended for specific
track_widths
. Track width is selected by rounding to the next odd window size. Prior to this change, the number of points used would increase on even window sizes. As a result, requesting a track width of2.5
pixels, would result in using a window of size5
. Currently, requested a track width of3
pixels results in a window of size 3, while3.1
rounds up to the next odd window size (5
). This bug affected the kymo tracking widget (tracking, refinement and photon count sampling during saving),lk.track_greedy()
andlk.refine_tracks_centroid()
. - Updated default slider ranges for the Kymotracker widget to reflect minimum track width required for tracking.
- Fixed issue with model description not being available in Jupyter notebooks for some force-distance models.
- Show validity criterion for Marko Siggia WLC models in terms of model parameters. Prior to this change the limit was simply denoted as
10 pN
where in reality it depends on the model parameters. The10 pN
was a reasonable value for most DNA constructs. - Fixed bug which occurred when exporting images to TIFF files of a numerical type with insufficient range for the data with the flag
clip=True
. Prior to this change, values exceeding the range of the numerical type were not clearly defined. After this change values below and above the supported range are clipped to the lowest or highest value of the data type respectively. - Fixed bug in
DwelltimeBootstrap.hist()
(previously namedDwelltimeBootstrap.plot()
, see below). Previously, only up to two components were plotted; now all components are plotted appropriately. DwelltimeBootstrap.hist()
now displays the original parameter estimate rather than the mean of the bootstrap distribution; the bootstrap distribution is used solely to calculate the confidence intervals viaDwelltimeBootstrap.get_interval()
.- Fixed a bug where
Scan.export_video()
andImageStack.export_video()
would show elements from a previous plot. - Fixed a bug that caused a misalignment of half a pixel between the kymograph and its position histogram when using
Kymo.plot_with_position_histogram()
.
Deprecations
- Renamed
CorrelatedStack
toImageStack
. - Deprecated the
DwelltimeModel.bootstrap
attribute; this attribute will be removed in a future release. Instead,DwelltimeModel.calculate_bootstrap()
now returns aDwelltimeBootstrap
instance directly. See the population dynamics documentation for more details. - Deprecated
DwelltimeBootstrap.plot()
and renamed toDwelltimeBootstrap.hist()
to more closely match the figure that is generated. - Deprecated
DwelltimeBootstrap.calculate_stats()
. This method is replaced withDwelltimeBootstrap.get_interval()
which returns the100*(1-alpha)
% confidence interval; unlikeDwelltimeBootstrap.calculate_stats()
, it does not return the mean.
Other changes
DwelltimeBootstrap
is now a frozen dataclass.- Attempting to access
DwelltimeModel.bootstrap
before sampling now raises aRuntimeError
; however, see the deprecation note above for proper API to access bootstrapping distributions. - Suppress legend entry for outline when invoking
KymoTrack.plot()
. - Allow pickling force calibration results (
CalibrationResults
). Prior to this change two functions involved in calculating upper parameter bounds prevented this class from being pickled.
v0.13.2
New features
- Added covariance-based estimator (
cve
) option toKymoTrack.estimate_diffusion()
. See kymotracker documentation for more details. - TIFFs exported from
Scan
andKymo
now contain metadata. TheDateTime
tag indicates the start/stop timestamp of each frame. TheImageDescription
tag contains additional information about the confocal acquisition parameters. - Added the
Kymo.duration
property to provide convenient access to the total scan time in seconds. - Added addition operator to
KymoTrackGroup
.KymoTrackGroups
tracked on the sameKymo
can be concatenated with the+
operator. - Added the optional
min_length
parameter toKymoTrackGroup.estimate_diffusion()
to discard tracks shorter than a specified length from the analysis. - Added the
DwelltimeModel.rate_constants
property along with additional documentation explaining the assumptions that underlie using the exponential model. See the dwell time analysis documentation for more information. - Ensure same call signature for
plot()
methods forScan
,Kymo
,PointScan
andCorrelatedStack
:Scan
,Kymo
andPointScan
: Made argumentchannel
optional.Scan
andPointScan
: Added argumentshow_title
.Kymo
: Added argumentsimage_handle
andshow_title
.CorrelatedStack
: See deprecation changelog entry.
- Introduced lazy loading for
TimeSeries
data. This means that the data corresponding to aTimeSeries
channel is not read from disk until it is used.
Bugfixes
- Added a check which verifies that a
Kymo
is not downsampled prior to estimating a diffusion constant. Computing diffusion constants from temporally downsampled kymographs is now explicitly disallowed. - Fixed a bug in
KymoTrack.estimate_diffusion()
that could lead to biased estimates obtained with the"ols"
estimator. For the diffusion estimate itself to be affected, specific lags have to be missing from the track (for example every second point in a track). This is a regression that was introduced inv0.12.1
. - Added a warning to
KymoTrack.estimate_diffusion()
used with the"ols"
method when points are missing from a track. In this case the uncertainty estimate is biased. See the section on diffusive processes for more details. - Added a warning that estimating the optimal number of points to use when using the
"ols"
method can be biased if many points are missing. - Fixed a bug in
KymoTrack.estimate_diffusion()
that could lead to biased estimates obtained with the"gls"
estimator when gaps occur in the track. Such cases now produce an exception recommending the user to refine the track prior to diffusion estimation. See the section on diffusive processes for more details. - Fixed issue where on Jupyter Lab the kymotracker widget would align the Kymograph and track parameters vertically rather than horizontally.
- Functions that use
KymoTrackGroup
now gracefully handle the cases where no tracks are available. The refinement functionsrefine_tracks_centroid()
andrefine_tracks_gaussian()
return an empty list, whileKymoTrackGroup.fit_binding_times()
andKymoTrackGroup.plot_binding_histogram()
raise an exception. lk.track_greedy()
now returns an emptyKymoTrackGroup
instead of an empty list when no coordinates exceed the threshold.lk.track_greedy()
now returns an emptyKymoTrackGroup
instead of an error when an ROI is selected that results in no lines tracked.- Fixed a bug where the
pixel_threshold
could be set to zero for an empty image. Now the minimumpixel_threshold
is one. - Fixed a bug where single pixel detections in a
KymoTrackGroup
would contribute values with a dwell time of zero. These are now dropped, the correct minimally observable time is set appropriately and a warning is issued. - Fixed slicing of a
Kymo
where slicing from a time point inside the last line to the end (e.g.kymo["5s":]
) resulted in aKymo
which returned errors upon trying to access its contents. - Fixed a minor bug in force calibration. In rare cases it was possible that the procedure to generate an initial guess for the power spectral fit failed. This seemed to occur when the spectrum supplied is a mostly flat plateau. After the fix, an alternative method to compute an initial guess is applied in cases where the regular method fails. Note that successful calibrations were not at risk for being incorrect due to this bug since they would have resulted in an exception rather than an invalid result.
Deprecations
- Deprecated property
CorrelatedStack.src
. In future versions, the contents ofsrc
will be considered an implementation detail that is not directly accessible. Data should be accessed through the public API. - Reordered the keyword arguments of the method
CorrelatedStack.plot()
and enforced all parameters afterchannel
to be keyword arguments. For details see the docstring. - Enforced the argument
axes
of the methodplot()
forScan
,Kymo
andPointScan
to be a keyword argument. - Renamed force distance fitting functions. They are deprecated now and will be removed in the future:
inverted_marko_siggia_simplified
->wlc_marko_siggia_distance
marko_siggia_simplified
->wlc_marko_siggia_force
marko_siggia_ewlc_distance
->ewlc_marko_siggia_distance
marko_siggia_ewlc_force
->ewlc_marko_siggia_force
odijk
->ewlc_odijk_distance
inverted_odijk
->ewlc_odijk_force
freely_jointed_chain
->efjc_distance
inverted_freely_jointed_chain
->efjc_force
twistable_wlc
->twlc_distance
inverted_twistable_wlc
->twlc_force
Other changes
- All
KymoTrack
instances must have the same sourceKymo
and color channel in order to be in the sameKymoTrackGroup
instance. While this behavior was required previously for some downstream analyses on the tracks, it is now explicitly enforced uponKymoTrackGroup
construction. - When calling
KymoTrackGroup.estimate_diffusion()
without specifying themin_length
parameter, tracks which are shorter than the required length for the specified method will be discarded from analysis and a warning emitted. Previously, if any tracks were shorter than required, an error would be raised. - Updated benchmark to not use deprecated functions and arguments. Prior to this change, running the benchmark would produce deprecation warnings.
Kymo.plot()
now returns a handle of the plotted image.PointScan.plot()
now returns a list of handles of the plotted lines.
v0.13.1
v0.13.0
New features
- Added possibility to access property
sample_rate
forTimeSeries
data with constant sample rate. - Allow reading multiple files with
lk.CorrelatedStack
(e.g.lk.CorrelatedStack("image1.tiff", "image2.tiff")
). - Added
CorrelatedStack.export_video()
to export videos to export multi-frame videos to video formats or GIFs. - Added support for steps when slicing frames from
CorrelatedStack
s. - Added function
Kymo.line_timestamp_ranges()
to obtain the start and stop timestamp of each scan line in aKymo
. Please refer to Confocal images for more information. - Added
Kymo.flip()
to flip a Kymograph along its positional axis. - Added
KymoTrackGroup.estimate_diffusion()
to estimate diffusion constants for a group of kymograph traces. - Include unit in
DiffusionEstimate
dataclass. - Added
shape
property toScan
andKymo
. - Allow slicing
CorrelatedStack
s with timestamps and time strings (e.g.stack["5s":"10s"]
orstack[f.force1x.start:f.force1x.stop]
). - Allow slicing
Scan
with timestamps and time strings (e.g.scan["5s":"10s"]
orscan[f.force1x.start:f.force1x.stop]
). - Allow downloading files directly from Zenodo using
lk.download_from_doi()
. See the example on Cas9 binding for an example of its use. - Made piezo tracking functionality public and added piezo tracking tutorial.
- Lazily load
data
andtimestamps
forTimeSeries
data - Propagate
Slice
axis labels when performing arithmetic (when possible). - Added a warning to the Kymotracker widget if the threshold parameter is set too low, which may result in slow tracking and the widget hanging.
- Added header line to exported track coordinate CSV files. The first header line now contains the version of
Pylake
which generated the file and a version number for the CSV file itself (starting withv2
from this release). - It is now possible to pickle
FdFit
objects. Prior to this change, unpickling anFdFit
would fail since model identification relied on a storedid
for each of the models used. Theid
of a variable changes whenever a new variable is created however. After this change, each model is associated with a universally unique identifier (uuid) that is used for identification instead. This uuid is serialized with theModel
and used byFdFit
thereby preserving their relationship when pickled/unpickled.
Bug fixes
- Improved
scan.get_image("rgb")
to handle missing channel data. Missing channels are now handled gracefully. Missing channels are zero filled matching the dimensions of the remaining channels. - Added calls to manually redraw the axes in the kymotracker widget during horizontal pan and line connection callbacks. Without this, the plot did not update correctly when using newer versions of
ipywidgets
andmatplotlib
. - Fixed a bug in the video export that led to one frame less being exported than intended.
- Fixed a bug which prevented the range selector widget from updating when the dataset to be plotted is changed. Previously, on some supported versions of
matplotlib
it would no longer update the figure. This is now fixed. - Force distance models now raise a
ValueError
exception when simulated for invalid parameter values. - Force distance models now have a non-zero lower bound for the contour length (
Lc
), persistence length (Lp
), stretch modulus (St
) and Boltzmann constant times temperature (kT
) instead of a lower bound of zero. - Force distance fits now raise a
RuntimeError
if any of the returned simulation values areNaN
. - Fixed a bug that resulted in profile likelihood automatically failing when an attempted step exceeded the bounds where the model could be simulated.
Breaking changes
- To disable image alignment for
lk.CorrelatedStack
, the alignment argument has to be provided as a keyword argument (e.g.lk.CorrelatedStack("filename.tiff", align=False)
rather thanlk.CorrelatedStack("filename.tiff", False)
). - Removed deprecated argument
roi
fromCorrelatedStack.export_tiff
. UseCorrelatedStack.crop_by_pixels()
to select the ROI before exporting. CorrelatedStack.frame_timestamp_ranges()
is now a method rather than a property. This was done for API consistency with the API forScan
. Please refer to Correlated stacks for more information.- Removed public attributes
CorrelatedStack.start_idx
andCorrelatedStack.stop_idx
and made them protected. - The property
sample_rate
ofContinuous
data now returns afloat
instead of anint
. - Changed the error type when attempting to access undefined per-pixel timestamps in
Kymo
fromAttributeError
toNotImplementedError
. KymoWidgetGreedy
now enforces using keywords for all arguments after the first two (kymo
andchannel
).- The following
KymoWidgetGreedy
attributes/functions have been removed (replaced with private API):adding
,algorithm_parameters
,axis_aspect_ratio
,output_filename
,plotted_lines
,show_lines
,create_algorithm_sliders()
,refine()
,show()
,track_all()
,track_kymo()
andupdate_lines()
. - The
track_width
argument ofrefine_tracks_centroid()
expects values in physical units whereas the deprecatedrefine_lines_centroid()
expected theline_width
argument in pixel units. - Removed default value provided for
driving_frequency_guess
inlk.calibrate_force()
. - It is now mandatory to supply a
sample_rate
when callinglk.calibrate_force()
. - It is now mandatory to supply a
sample_rate
when callinglumicks.pylake.force_calibration.touchdown.touchdown()
.
Deprecations
Scan.save_tiff()
andKymo.save_tiff()
were deprecated and replaced withScan.export_tiff()
andKymo.export_tiff()
to more clearly communicate that the data is exported to a different format.- Deprecated
export_video_red()
,export_video_green()
,export_video_blue()
, andexport_video_rgb()
methods forScan
. These methods have been replaced with a singleexport_video(channel=color)
method. - In the functions
Scan.frame_timestamp_ranges()
andKymo.line_timestamp_ranges()
, the parameterexclude
was deprecated in favor ofinclude_dead_time
for clarity. - Deprecated
KymoTrackGroup.remove_lines_in_rect()
; useKymoTrackGroup.remove_tracks_in_rect()
instead (see below). - Deprecated the
line_width
argument oftrack_greedy()
; usetrack_width
instead. - Deprecated
filter_lines()
; usefilter_tracks()
instead. - Deprecated
refine_lines_centroid()
; userefine_tracks_centroid()
instead. Note: thetrack_width
argument ofrefine_tracks_centroid()
expects values in physical units whereas the previousrefine_lines_centroid()
expected theline_width
argument in pixel units. - Deprecated
refine_lines_gaussian()
; userefine_tracks_gaussian()
instead. - Deprecated
KymoWidget.save_lines()
; useKymoWidget.save_tracks()
instead.
Other changes
- Added default values for the
track_greedy()
argumentstrack_width
andpixel_threshold
. - Renamed classes/methods/functions dealing with tracked particles. This change was made to avoid ambiguity with regard to the term "line". Now, a "line" refers to a single scan pass of the confocal mirror during imaging. A "track" refers to the coordinates of tracked particles from a kymograph. Note: Any breaking changes or deprecations to the public API are noted above. The renamed classes/functions below are considered internal API and subject to change without notice; these classes should not be constructed manually:
KymoLine
was renamed toKymoTrack
KymoLineGroup
was renamed toKymoTrackGroup
export_kymolinegroup_to_csv()
was renamed toexport_kymotrackgroup_to_csv()
import_kymolinegroup_from_csv()
was renamed toimport_kymotrackgroup_from_csv()
- Updated the
KymoWidgetGreedy
UI to reflect changes in terminology. - Made
ipywidgets>=7.0.0
andnotebook>=4.4.1
optional dependencies forpip
. - Made
notebook>=4.4.1
a mandatory dependency forconda
release. Pylake
now depends onh5py>=3.4, <4
. This change is required to support lazy loading forTimeSeries
.
v0.12.1
New features
- Added
Scan.pixel_time_seconds
andKymo.pixel_time_seconds
to obtain the pixel dwell time. See Confocal images for more information. - Allow cropping
CorrelatedStack
using multidimensional indexing, i.e.stack[start_frame : end_frame, start_row : end_row, start_column : end_column]
. See Correlated stacks for more information. - Added
KymoLine.estimate_diffusion()
which provides additional information regarding the diffusion constant estimation. This dataclass can be converted to floating point to get just the estimate, but also contains the number of points used to compute the estimate, and the number of lags used in the analysis. In addition to that, it provides astd_err
field which reports the standard error for the estimate. - Added generalized least squares method as
method
option forKymoLine.estimate_diffusion()
. Please refer to the kymotracker documentation for more information. - Added offline piezo tracking functionality (documentation pending).
- Added
lk.benchmark()
that can be used to estimate the performance of your computer with various pylake tasks.
Bug fixes
- Changed the internal calculation of the
extent
argument inKymo.plot()
such that the spatial limits are now defined at the center of the pixel (same functionality that is used for the temporal axis). Previously the limits were defined at the edge of the pixel resulting in a subtle misalignment between the coordinates of the tracked lines and the actual image. - Fixed an issue where the pixel dwell time stored in TIFFs exported from Pylake could be incorrect. Prior to this fix, Pylake exported the value entered in the Bluelake UI as pixel dwell time. In reality, the true pixel dwell time is a multiple of the acquisition sample rate. After the fix, TIFF files correctly report the achieved pixel dwell time.
- Changed the internal calculation of the hydrodynamically correct force spectrum. Before this change, the computation of the power spectral density relied on the frequencies always being positive. While this change does not affect any results, it allows evaluating the power spectral density for negative frequencies.
- Fixed an issue where evaluating the hydrodynamically correct spectrum up to very high frequencies could lead to precision losses. These precision losses typically occur at frequencies upwards of 30 kHz and manifest themselves as visible discontinuities.
- Perform better input validation on the kymotracking functions
track_greedy
andtrack_lines
. The line width and pixel threshold must be larger than zero. The diffusion parameter must be positive. Previously, failure to provide values respecting these limits would produce cryptic error messages. - Perform better input validation on
refine_lines_centroid
. Line width must now be at least one pixel. Previously, negative values produced a cryptic error message, while a line width smaller than one pixel would silently result in no refinement taking place. - Fixed bug in force calibration convenience function where setting
fixed_alpha
orfixed_diode
to zero resulted in those parameters still being fitted. After this change, settingfixed_alpha
to zero will result in the diode model having a fixedalpha
of zero, whereas settingf_diode
to zero raises an exception. - Include one extra sample when requesting frame timestamp ranges from a scan (
Scan.frame_timestamp_ranges(exclude=True)
). Previously, when slicing using these timestamps, you would omit the last sample of the scan. Now this sample will be included.
Deprecations
KymoLine.estimate_diffusion_ols()
is now deprecated; useKymoLine.estimate_diffusion(method="ols")
instead. This new method returns the same estimate of the diffusion coefficient as before but includes additional information about the fit.