Allowed for Textract and Comprehend API calls through AWS keys. File preparation function incorporated into main redaction function to avoid needing user to 'check in' during redaction process

Corrected image coordinate translation when the pdf mediabox is not the same size as pdf page rectangle

Fuzzy match implementation for deny list. Added option to merge multiple review files. Review files from redaction step should now include text.

Ensured the text ocr outputs have no line breaks at end. Multi-line custom text searches now possible. Files for review sent from redact button. Fixed image redaction (not review yet). Can get user pool details from headers. Gradio update.

Corrected large image reduction code

Corrected image resizing method for instances where the image is very large.

App should now resize images that are too large before sending to Textract. Textract now more robust to failure. Improved reliability of json conversion to review dataframe

You can now have output redaction boxes in grey according to an environment variable. Review files are now saved every time page is changed.

Uploaded pdfs with review files will now include all pages that don't have redactions. Slightly improved deny list matching.

Fixed redaction of image files

Adapted text join options to review file to be more resilient to changes in image size. Added possibility of using client secret with AWS login

Side review bar is mostly there. A couple of bugs fixed. Can now return identified text in initial review files. Still working on retaining found text throughout review process

Hopefully finally fixed the duplicate image_annotation_object issue

Refactor redaction functionality and enhance UI components: Added support for custom recognizers and whole page redaction options. Updated file handling to include new dropdowns for entity selection and improved dataframes for entity management. Enhanced the annotator with better state management and UI responsiveness. Cleaned up redundant code and improved overall performance in the redaction process.

Enhance file handling and UI features: improved Gradio app layout with fill width option, and integrated new settings for deny, and fully redacted lists (placeholders so far). Updated file conversion functions to handle CSV inputs and added CSV review file generation for redactions. Now retains all original and merged redaction boxes.

Updated packages. Reinstituted multithreading with page load, now with order protected. Smaller spacy model used for speed. Textract calls should now be faster

Started adding in support for custom deny list. Fixed textract call issue. Removed multithreading for now as it mixes up pages

Multithreaded file preparation. Can call Textract without signature detection

Added option for running redact function through CLI (i.e. not going through Gradio UI or API). Test functions for running this through AWS Lambda.

Only shows AWS options when AWS functions enabled. Can now upload previous review files to continue review later. Some review debugging.

Comprehend now uses custom spacy recognisers on top of defaults. Added zoom functionality to annotator. Fixed some pdf mediabox issues and redacted image output issues.

Improved time taken reporting and readme

Allowed for time limits on redact to avoid timeouts. Improved review interface. Now accepts only one file at a time. Upgraded Gradio version

Upgraded packages. Fixed some issues with review process. Better progress reporting for user.

Allowed for PIL to load truncated images to avoid some load errors

Added 'Review redactions' tab to the app. You can now visually inspect suggested redactions and modify/add with a point and click interface.

General improvement in quick image matching and merging

Optimised Textract and Tesseract workings

Improved allow list, handwriting/signature identification, logging

Added AWS Textract support. Allowed for OCR logs export.

Enhanced logging of usage. Small buffer added to redaction rectangles as it seems to miss the tops of text often.

Works correctly with images again

Can now select only specific pages in document to redact. Image based redaction should work correctly now.

Handles multiple runs with multiple files correctly now. Logging and feedback improvements.

Updated decision making output files, log locations

Decision process now saved as log files. Other log files and feedback added

Added logging, anonymising all Excel sheets, simple redaction tags, some Dockerfile optimisation

Can now redaction text or csv/xlsx files. Can redact multiple files. Embeds redactions as image-based file by default

Better redaction output formatting. Custom output folders allowed. Upgraded Gradio version

Fixed some more input bugs

Separated file preparation and file redaction functions. Hopefully sts endpoint access now works on AWS

Added some commentary to file conversion and redaction

Page conversion now page by page calls hopefully to avoid fastapi timeouts on AWS. gunicorn keep_alive parameter extended to 60 seconds just in case that helps too.

Added -y to poppler-utils installation in Dockerfile. Added support for image files in image-based redaction.

Initial commit