Skip to content

AFRL-Material-State-Awareness/POD4.5

Repository files navigation

Probability of Detection version 4.5 (PODv4.5)

alt text

PODv4.5 (Probability of Detection version 4.5) is the new and improved version of PODv4 which incorporates advanced statistics and an r backend. There have also been bug fixes related to the original PODv4.

License

Unlike PODv4, PODv4.5 is open-source-software licensed under the GNU General Public License version 3 or later (GPLv3+). This means that anyone has the right to change, copy, modify, use, or study all of the code within PODv4.5 under the terms of GPLv3. For full license text, see [https://www.gnu.org/licenses/gpl-3.0.en.html].

Installation Instructions

If you wish to download PODv4.5 for your computer, please click on the tag with the latest release (current latest release is PODv4.5.0 beta as of January 2023). From there, simply download the installer (.msi). Once download, open the installer, and the wizard will guide you through the process. A copy of R-4.1.2 with the necessary libraries is included in the installation, so the application is ready to run upon completing the installation wizard. A shortcut for PODv4.5 will be added to the desktop. If you cannot find the .exe, simply type PODv4.5 in the search bar and the application should appear.

Running the Development version in Visual Studio

PODv4.5 was written in visual studio 2019. In order to clone and run PODv4.5 in visual studio. Clone this github repository and open the 'Winforms POD UI.sln' located in /'POD Source Code'/. Once the solution is open in visual studio, set the startup project to FORMS and run the solution. The configuration should be set to Any CPU. The solution can run in either 32 or 64 bit (prefer 32-bit is set by default). If you wish to run the application in 64 bit, open the FORMS project properties > build > uncheck prefer 32-bit. Do NOT run the program in x86 (some features will cause the program to crash due to bottlenecking the 32-bit RAM allocation).

New Features in PODv4.5.0

PODv4.5.0 is the first release of PODv4.5. It offers a wide range of features not previously included in PODv4. In addition, the backend analysis for PODv4.5 is written in the statistical programming langauge R in order to more easily accomadate the new statistical methods for POD through the use of CRAN libraries. The features specific to PODv4.5.0 are listed below:

Hit/Miss Analysis

There have been many features and drastic improvements in hit/miss analysis for PODv4.5.0:

  • Plotting Confidence Interval Curve: In PODv4, the python algorithms often struggled to plot the confidence a9095 curve even when the logistic regression algorithm converges easily. PODv4.5.0 can correctly generate and plot the wald a9095 curve for the user in the analyis wizard -> full regression analysis.

  • New Regression Technique: Hit/Miss POD has traditionally been calculated using maximum likelihood logistic regression. However, in the cases, this algorithm may fail to converge when the data is separated (i.e. the 0s and 1s don't overlap), or when there are outliers present. To accomodate for this, PODv4.5.0 offers Firth's Bias-Reduced Logistic Regression . This new regression method is capable of producing an a90 curve for tricky datasets.

  • New Confidence Interval Techniques: PODv4.5.0 has three new statistical methods to general both the a9095 value and the a9095 curve. These methods include Modified Wald, Likelihood Ratio confidence interval, and Modified Likelihood Ratio Confidence Interval. More information can be found about these new confidence interval techniques in /'POD Documents'/

  • Alternative Sampling Method: As an alternative to simple random sampling, PODv4.5.0 offers Ranked Set sampling to assist in creating both the POD curve and the a9095 curve. This feature is especially useful when the sample size is relatively small.

A Quick Help message box is present in the Hit Miss wizard in order to aid and explain to the user what each feature dropdown does. In addition, errors are more specfic when they occur (i.e. a9095 is infiniti), and will often give users suggestions in order to improve the quality of the results.

Signal Response Analysis

Signal Response has been rewritten to be calculated in R in addition to:

  • Box-Cox Transformation: In addition to the transformations included in PODv4, PODv4.5.0 can perform a box-cox transform on the signal responses. When clicked, a default lambda value will be generated by R. However, the user has freedom to alter lambda with a numeric up-down box in order to improve the test assumptions (equal variance, test for normality etc).

  • Normality histogram chart : A normality chart featuring a histogram of the frequency of the responses has been added in order to aid the user in determining the normality of the signal responses. A normal curve with the mean and sigma of the response values is overlaid on the histogram to help the user see how 'normalish' are the responses.