2024-07-04.md

areaDetector collaboration meeting

Collaboration

• Would Github stale bot be interesting? It marks/comments an issue/PR as stale after 60 days of inactivity and closes it after 14 more days of inactivity, will do after this meeting. Investigate if it can be selective about issues.
• Initial profiling of a generic AD pipeline: SimDetector+PROC+ROI+TR
  • Frame rate around 194hz (period set to .005), frame size 1280x960
  • Perf+FlameGraph result: This seems to indicate a lot of time spent memcopying inside the NDArray destructor, I will investigate further. I intend to profile a more realistic pipeline, e.g. 2MB frame at 560hz or something that could saturate a 40Gb/s link I will add enough information in the collaboration repo to reproduce the test (see here) Investigate how to add more debug symbols.
• Improve autogenerated list of issues and PRs, to avoid long lists, we will filter last fetched and include ones modified recently

Issues and PRs (<=30days filtered)

• ADAravis:
  • Issues:
    • Build failure on Ubuntu 22.04
• ffmpegServer:
  • Issues:
    • ffmpeg 5 compatibility

Issues and PRs

• areaDetector:
  • Issues:
    • Type in configure/EXAMPLE_RELEASE.local
    • ADEiger not listed in Supported Detectors
    • WITH_PVA = YES ignored if there is a space after "YES"?
    • Missing BUILD_IOCS conditional in submodule top-level Makefile rules
    • Documentation work needed
    • Addition of ADPluginCentroids to areaDetector
    • tags for R1-x series
  • PRs:
    • Add script for generating release notes automatically
    • Enhance R3-13 release notes
    • Simplify build configuration
    • Added ADPluginCentroids
• ADCore:
  • Issues:
    • Remove documentation directory?
    • Github Actions failing due to asyn
    • PVAttribute with higher or configurable priority
    • Stopping streaming on file plugins discards all arrays in queue
    • Suggestion: New PV for identifying unit of measurement for 'Time' PVs
    • ADBase.template equivalent for 1D detectors
    • Allow HDF5 plugin to append new NDArrays to existing HDF5 archive
    • Risk of memory leak if branch is taken?
    • $(RTS) macro not provided to NDFFT.adl
    • Hardcoded ":" in request file
    • HDF5 Blosc compressor is not documented
    • Support drvInfo for NDArray callbacks
    • Not all example IOCs use P macro value starting with same prefix
    • Remove obsolete edl files
    • Indicate error in OPI if error creating an NDAttribute
    • Add screen shot of new caQtDM viewer screen to areaDetectorDoc.html
    • PVStructure::getSubField() can return NULL
    • support caQtDM caCamera widget with a .ui screen
    • ioc crash due to arithmetic error in HDF5 plugin
    • Add caching on Travis to speed up build
    • NDFileNexus problem
    • Add flag to prevent overwriting files in NDPluginFile
    • Move more functionality into the ADDriver base class
    • Create mixer plugin
    • ASCII file saving plugin
    • New OPI to show pixel data in CSS intensity graph
    • Create unittest for NDPluginDriver
    • option to not write NDAttr* attributes in HDF5 dataset
    • Expand CI services to cover more configurations
    • Find a way to stop misbehaving plugins from slowing down driver
  • PRs:
    • Remove erroneous variable type information.
    • Update URL of legacy pre-built artifacts and NTNDArray specification
    • adding video compression (h264)
    • Switch from pvDatabase to SharedPV
    • Create AWS S3 Interface for TIFF Files
    • Slac edl
    • Applied bitsPerPixel.patch to bring in bitsPerPixel support from pcds…
• ADEiger:
  • Issues:
    • Stream mode with CompressionAlgo=None and Decompress=No gives "unknown encoding <"
    • Data Files Transferred to Wrong Directory
    • IOC Console errors and trouble applying settings with Eiger2 500K
    • Wrong Energy and Wavelength in metadata after initialize
    • Data values in Pump&Probe mode seem wrong
    • Data values in HDR mode seem wrong
    • Pump & Probe mode crashes FileWriter
    • Setting photon_energy on Eiger2 returns null
    • Problem interrupting a scan
    • Setting values that change bit depth image take a long time to return
    • FileWrite stopped working
    • Request - Alarm when local storage running out
• ADAravis:
  • Issues:
    • Build failure on Ubuntu 22.04
    • Best way to automatically re-initialize power cycled cameras?
    • 0 size buffers in processBuffer() when capturing 'Single' or 'Multiple'
    • Incorrect dataTimeStamp
  • PRs:
    • WIP: Try to automatically reconnect when connection is lost
    • Aravis fixes
    • Re-ordered includes in the main configure/RELEASE
• ADGenICam:
  • Issues:
    • Add PVs for minimum and maximum for GenICam int64 and double features
    • Exposure Time is not controllable with a Basler Camera
  • PRs:
    • Acquisition mode fallback
• ADSpinnaker:
  • Issues:
    • ADSpinnaker vs ADAravis
    • MEDM not responsive after acquiring image in "continuous" mode and Mono12Packed Pixel format
    • Linux IOCs is failing after some days when running USB camera at 163 frames/s
• ADVimba:
  • Issues:
    • Simultaneous acquisition from multiple cameras does not work
    • Improve connection management
    • Circular dependency.
• ADAndor3:
  • Issues:
    • EPICS can't find Zyla 5.5 camera
    • Image timestamp EPOCH is different from ADAndor driver
• ADAndor:
  • Issues:
    • TemperatureActual only updates when not acquiring
    • ADAcquireBusy goes to 0 before camera is really done
    • andorCCD:dataTask:, Data thread is running but main thread thinks we are not acquiring.
    • Only call SetVSAmplitude if the camera supports it.
    • No LICENSE information
    • HDF plugin saves frame with fill value in single capture mode with SWMR mode on
    • ADAndor: Document time units
    • Incorrect number of parameters
    • How can achieve <1ms Average Read Out Speed?
  • PRs:
    • Remove obsolete shamrockDummy.cpp to avoid confusion
• ADSimDetector:
  • Issues:
    • Doesn't compile on Debian 10 (x86_64) with GCC 8.3.0 and OpenCV 4.5.2
    • simDetectorNoIOC.cpp incorrectly declares class epicsShareClass simDetectorDemo
• specsAnalyser:
  • Issues:
    • readback in 'Fixed Energy' mode requires cam1:datatype to be float64
    • Fix reply for Ordinate Axis
    • Fix EOT in specsAnalyser
  • PRs:
    • Bug fix NDArrayPool and New make parameter db file
• ADPylon:
  • Issues:
    • IOC receives camera connection failed occasionally
    • IOC stops collecting images from the camera
  • PRs:
    • Fix linker error linux
• pvaDriver:
  • Issues:
    • Poor performance with default request type queue size
  • PRs:
    • In the pvaDriverConfig function, make it possible to use a non-defaul…
    • Typo in README
• ADPvCam:
  • Issues:
    • support for windows-x64
• ADSupport:
  • Issues:
    • Can't build using MingW on Linux.
    • Blosc compression in HDF5 is not designed for multiple threads call blosc library?
    • ADSupport does not generate correct static mingw libs for GraphicsMagick
    • Bug in nexusSrc (or NDFileNexus in ADCore)
    • Cannot define H5_HAVE_THREADSAFE on mingw
    • TIME datatypes won't compile on vxWorks
  • PRs:
    • adding video compression (h264)
    • Build module with MingW (and other compilers) with Ubuntu host on our GitLab server.
• ADUVC:
  • Issues:
    • Improve Handling of IOC startup and operating modes
    • Add iocsh function to set the zoom ratio
• ADLambda:
  • Issues:
    • Error loading config files
    • Infrequent hang of the IOC
  • PRs:
    • base frame timestamp off epicsTS
• ADProsilica:
  • Issues:
    • ADProsilica-R2-4 release: Makefile issue?
    • Driver gets stuck when it receives bad frames
  • PRs:
    • Added driver support for NDBitsPerPixel and NDBytesPerPixel parameters
    • Added new prosilica resend params and rates for packet counts
    • Added redef of Gain in prosilica.template so we can set driver limits
    • prosilica.cpp:
• ADPluginBar:
  • Issues:
    • Add support for maxThreads>1
    • Should not be creating attribute DataType and should not be calling doCallbacksGenericPointer directly
    • Allow for saving images when barcode is detected
  • PRs:
    • Removing doCallbacksGeneric pointer, adding maxThreads support
• ffmpegServer:
  • Issues:
    • ffmpeg 5 compatibility
    • HTTP server
    • Won't build on Linux
    • Can not download Windows ffmpeg shared libs with install.sh
    • Liblzma not linking?
    • install.sh patches FFmpeg sources, but install instructions don't include this
  • PRs:
    • Use microHTTPd instead of nullhttpd
    • fixed some record descriptions
• ADCompVision:
  • Issues:
    • CUDA
    • Include OpenCV build as part of EPICS build?
• ADViewers:
  • Issues:
    • NTNDArray Blosc compression byte order
  • PRs:
    • adding video compression support (h264)
    • Live Fitting Plugin with userCalc functionality
    • Adds log checkbox to GUI
    • Image j macros
• ADQImaging:
  • PRs:
    • Base frame timestamp off epicsTS
• ADPICam:
  • Issues:
    • Acquire time is in milliseconds
    • Camera MTE3 sensor temperature read back value does not update until "Acquire" start.
    • No LICENSE file
    • ADPICam RELEASE.md appears to be out of date
  • PRs:
    • base frame timestamp off epicsTS when not using driver timestamps
    • Add specialization for std::hash for PicamParameter to build on older…
    • WIP: Multitrack and Improvements
    • CCD multi-track capability for Princeton cameras
• ADCSimDetector:
  • PRs:
    • base frame timestamp off epicsTS
    • support for 64-bit data types
• NDDriverStdArrays:
  • Issues:
    • NDPosPlugin.dbd Not Found During Build
  • PRs:
    • base frame timestamp off epicsTS
• ADSBIG:
  • PRs:
    • base frame timestamp off epicsTS
• ADPSL:
  • PRs:
    • base frame timestamp off epicsTS
• ADSBIG:
  • PRs:
    • base frame timestamp off epicsTS
• ADPerkinElmer:
  • Issues:
    • Problem with rapidly stopping, setting AcquireTime, and starting detector
  • PRs:
    • base frame timestamp off epicsTS
    • Gain file loading and saving using consistent with vendor header format
• ADLightField:
  • Issues:
    • Building
  • PRs:
    • base frame timestamp off epicsTS
    • Add setlocal, update PATH with LIGHTFIELD_ROOT
• ADFireWireWin:
  • PRs:
    • base frame timestamp off epicsTS
• ADDexela:
  • Issues:
    • The trigger mode selection should be sent to the device immediately when changed
  • PRs:
    • base frame time stamp on epicsTS
• ADPilatus:
  • Issues:
    • does this IOC support HDF5 file write?
    • Temperature and humidity update for channel 3 updates channel 0
    • Add remaining time PV
  • PRs:
    • Update timestamp from epics inside while(acquire) loop
    • Check for 7 OK message when waiting for an image to actualy end the acquisition
• ADMythen:
  • Issues:
    • documentation
  • PRs:
    • Updates/fixes to the driver, works at NSLS2
    • Diamond changes
• ADURL:
  • PRs:
    • Build ADURL with ci-scripts on Ubuntu using out GitLab server.
• ADmarCCD:
  • Issues:
    • Rotation Axis and Start Angle behaviour is inconsistent
• ADPointGrey:
  • Issues:
    • Automatic way to determine Visual Studio version and hence required library
• ADFastCCD:
  • Issues:
    • Image array size doesn't match image1:ArraySize0 * image1:ArraySize1
    • Discuss how to configure "boot" camera from epics IOC
    • ADFastCCD lacks a RELEASE.md and a documentation directory
• ADPcoWin:
  • Issues:
    • Linux support?
    • Help with this Phoebus display
    • Linking error on Windows Server 2012
    • CSS .opi screens are missing
    • cam1:Gain can not be set, as well as cam1:ReverseX and cam1:ReverseY
• ADPhotron:
  • Issues:
    • Allow use of the 2nd ethernet port of the SA-Z for data transfer
    • MEDM slider behaves badly on some Windows systems
    • report() should use fprintf for displaying all info
    • Use asynPrint instead of printf for debug messages
• ADnED:
  • Issues:
    • ADnED lacks RELEASE.md and documentation directory
• ADPluginEdge:
  • PRs:
    • FIX: call start() after NDEdgePlugin object is created for plugin to work for ADCore >= 2.5, don't process plugin if input NDArray dimension > 2 (i.e. for Color modes)
• ADPCO:
  • Issues:
    • windowsx-64 static build succeeded, but the IOC shows error
    • linker error in windows-x64 build
    • pcoApp/src/pco.cpp typo line 661
    • ADPCO lacks a RELEASE.md file
  • PRs:
    • Remove IOC *.cmd comment about loading envPaths
• ADMMPAD:
  • Issues:
    • Implement plugin callbacks
    • Improve X11 display controls
• ADCameralink:
  • Issues:
    • silicon software microenable IV VD4-CL without serial port
    • What is necessary to run simulated example
    • ADCameralink generates Doxygen errors
    • ADCameralink lacks a RELEASE.md file.
• firewireDCAM:
  • Issues:
    • Operator interface directory should be op, not opi
    • .adl file in edl directory
    • New release of firewireDCAM?
• ADBinaries:
  • Issues:
    • Remove szip?
    • Build version of HDF5 with SWMR support
    • Support for Visual Studio 2015
• ffmpegViewer:
  • Issues:
    • ffmegViewer lacks any tags or a RELEASE.md file
• ADExample:
  • Issues:
    • Question about schema location for XML files in this directory
  • PRs:
    • Add support for detector serial number.
    • adjust text boxes so font is not tiny in autoconverted .ui files