Home

1. AI4WRD-OCR WIKI

1. 1. AI4WRD-OCR Features - [Basic OCR Work Flow](#basic-ocr-work-flow) - [Saving and Loading Configurations](#saving-and-loading-configurations) - [Output to CSV and MQTT](#output-to-csv-and-mqtt)

1. 1. Basic OCR Work-Flow  <br />2 Use the navigation drop down menu to navigate between the various sections of the app. The app currently consists of three sections: 1. [Load frame](#1-load-frame) 2. [Crop](#2-crop) 3. [OCR-Livestream](#3-ocr-livestream)

The main workflow consists of the following:

Choosing video stream -> capturing screenshots of specific screens -> cropping specific sections of each of the screens -> starting optical character recognition

1. 1. 1. 1. Load Frame 

• Load Frame Screen*

1. 1. 1. 1. Select Language 

Use the drop down menu to select additional languages to detect. Currently English is the default language, with the option to simultaneously detect either traditional or simplified Chinese too.

1. 1. 1. 1. Select and preview Video Stream 

Use the drop down menu to select the video stream that you want to perform Optical Character Recognition on, then click the run widget to preview the video stream.

1. 1. 1. 1. Capture screenshots 

Capture the necessary screenshots of the various screens that you would like to perform optical character recognition on. Later on, you would get to define crops for each of the screens and the software would automatically detect and crop the relevant video stream to perform optical character recognition.

Screenshots are captured using the Capture screenshot button. The screenshots captured will be displayed bellow the button.

1. 1. 1. 2. Crop 

• Crop Screen*

1. 1. 1. 1. Select Screenshot to Crop 

Drop down menu to select the screenshot to crop. Crops will be automatically saved and associated with the specified screenshots internally.

1. 1. 1. 1. Cropping 

Drag the box to specify sections of the screen to crop. Later the application will perform Optical Character Recognition on the specified crops. A screen below will preview the selected crop.

Once you are satisfied with the crop, click the crop button and the crop will be saved listed below. You can proceed to perform crops as you like.

1. 1. 1. 1. Additional Configurations 

You can additionally specify if you would like to see the crop preview in real time, the color of cropping box, and the zoom level of the crops.

1. 1. 1. 3. OCR Livestream 

• Optical Character Recognition Livestream Screen*

Click on the Done Crop check box to initialize the models.

• Note: If this is your first time running the program, it might take some time as the software will need to download the required models. Please ensure that your internet connection is stable. Check the terminal output if it does not respond after a significant amount of time, if it still does not respond you might need to restart the program.*

1. 1. 1. 1. Select Optical Character Recognition Library 

Drop down menu to select the optical character recognition library to be used. Currently there are two libraries available: Tesseract and Easy-Ocr. We recommend tesseract for printed characters on screens and easy-ocr for streams from video cameras.

1. 1. 1. 1. OCR Confidence Level Cut off 

Specifies the minimum confidence level for optical character recognition. If the confidence level drops bellow the specified level the text will not be displayed.

1. 1. 1. 1. Video Preview and Optical Character Recognition Output
            1. Video Preview 

• preview of the current video stream*

Note that the video stream is the same videos stream as selected from the first page

1. 1. 1. 1. 1. OCR Output 

1. 1. 1. 1. ####

1. 1. Saving and Loading Configurations 

1. 1. Output to CSV and MQTT

1. 1. 1. CSV Output

1. 1. 1. MQTT Output