Remediating ingest exceptions – DISCO

Exception reports from ingest will list a ProcessingStatus and ProcessingDetails for every file with an exception.

Below are DISCO's recommendations for remediating each exception.

ProcessingDetails	ProcessingStatus	Search string
Password protected	Failure	processingStatus(Failure) & processingDetails("Password protected")
Description: The document was created in DISCO, but no image was created nor was any text extracted because the document could not be opened without the password. The original (native) document can be downloaded from the document viewer.
Recommended user action: Obtain the document password. If the document is not an attachment, delete the loose document and re-ingest the unencrypted document. If the protected document is an attachment, delete the entire document family (the parent document and all attachments to the parent) and re-ingest the document family with the unencrypted document. Alternatively, contact DISCO Support with the password to decrypt the file and update the document in DISCO.

ProcessingDetails	ProcessingStatus	Search string
Encrypted	Failure	processingStatus(Failure) & processingDetails("Encrypted")
Description: The document was created in DISCO, but no image was created nor was any text extracted because the document could not be opened because the document was encrypted. The original (native) document can be downloaded from the document viewer.
Recommended user action: Obtain the document password. If the document is not an attachment, delete the loose document and re-ingest the unencrypted document. If the protected document is an attachment, delete the entire document family (the parent document and all attachments to the parent) and re-ingest the document family with the unencrypted document. Alternatively, contact DISCO Support with the password to decrypt the file and update the document in DISCO.

ProcessingDetails	ProcessingStatus	Search string
Unknown	Failure
Description: The document was created in DISCO, but no image was created nor was any text extracted because DISCO couldn’t read the file header to determine the file type and process it correctly. The original (native) document can be downloaded from the document viewer.
Recommended user action: Test the file for corruption. To test for corruption, download the original (native) file from the document viewer. Attempt to open the document in its native application, and if it successfully opens, re-save the document. If the document does not successfully open, obtain replacement documents. Once replacement documents are saved or obtained, delete the affected documents from DISCO and ingest the replacement documents.

ProcessingDetails	ProcessingStatus	Search string
Unsupported File	Failure	processingDetails("Unsupported File")
Description: The file type of the document is not supported by DISCO.
Recommended user action: Download and review the native documents. If the unsupported files can be converted into a different, supported format (for example, from Lotus 123 to Excel), convert the files and save them as a supported file type. Once the replacement documents are saved, delete the affected documents from DISCO and ingest the replacement documents. If the document cannot be opened or converted, contact DISCO Support for assistance with document conversion and replacement in DISCO.

ProcessingDetails	ProcessingStatus	Search string
Corrupted	Failure	processingStatus(Failure) & processingDetails(Corrupted)
Description: The file has been corrupted and is not accessible.
Recommended user action: To test for a corrupted document, download the original (native) file from the document viewer. Attempt to open the document in its native application, and if it successfully opens, re-save the document. If the document does not successfully open, obtain replacement documents. Once replacement documents are saved or obtained, cull the affected documents from DISCO and ingest the replacement documents.

ProcessingDetails	ProcessingStatus	Search string
Exceeded supported ingest text size	Partial	Filter ingest report for TextLimitExceeded = “Yes”
Description: The document was created in DISCO, but no image was created nor was any text extracted because the text size was too big. To ensure the high performance of the DISCO search indexes, DISCO limits the text size to 100MB. The image will show “Document unsupported” in the document viewer, but the original (native) document can be downloaded and reviewed.
Recommended user action: The document text was not indexed for search. Review the native document outside of DISCO then apply the appropriate work product to the native document in the review database.

ProcessingDetails	ProcessingStatus	Search string
Container extraction failed	Partial	processingStatus(Failure) & processingDetails("Container extraction failed")
Description: DISCO extracted X out of Y documents out of a container, possibly due to corruption or issues with permissions.
Recommended user action: Review the container path in the ingest exception report in Excel to identify the container that failed to extract. Download the container files and try to open them in their native application. If they can be opened, try re-ingesting the documents. If the documents cannot be opened in their native application, then the documents may be corrupted. Obtain replacement documents and ingest them.

ProcessingDetails	ProcessingStatus	Search string
Partial failure	Partial	processingStatus(Failure) & processingDetails("Partial failure")
Description: DISCO couldn’t extract text, images, or metadata from the document. The original (native) document can be downloaded from the document viewer.
Recommended user action: Identify the partially failed document in the Ingest Exception report. Review the Processing Details column to determine whether the text, image, or metadata was not extracted. Contact DISCO Support for assistance with a document overlay to replace the failed portions of the document in DISCO.

ProcessingDetails	ProcessingStatus	Search string
Exceeded near native page count	Partial	Filter ingest report ImagePageLimitExceeded = Yes
Description: This is most common with large Excel files. Near native images have a max of 30,000 pages.
Recommended user action: Review the native document outside of DISCO then apply the appropriate work product to the native document in the review database.

ProcessingDetails	ProcessingStatus	Search string
Instance count exceeded	Partial	No search syntax
Description: DISCO Review has ingested 200 copies of a specific document. For example, to avoid storing excessive copies of the same common email footer image, once DISCO ingests 200 copies, it does not ingest additional copies of that file.
Recommended user action: No action required.

ProcessingDetails	ProcessingStatus	Search string
No text - file type not expected to have text	Success	processingDetails("No text - file type not expected to have text")
Description: The file type was not expected to have text (for example, video or audio files).
Recommended user action: Inspect the documents and determine if text should be available along with the audio or video data. Obtain the accompanying text. Contact DISCO Support for assistance with a document overlay to add the text to the document in the review database.

ProcessingDetails	ProcessingStatus	Search string
DISCO configured exclusion	Partial	No search syntax
Description: DISCO does not ingest known standard system files such as: Files named: "Thumbs.db", ".DS_Store" Folders named: ".AppleDouble", ".DS_Store", "__MACOSX" Files ending in: ".joboptions" ".lnk" ".md5" ".url" DISCO will ingest directories ending in "_files" if there is a parent .html download file accompanying them.
Recommended user action: No action required.

ProcessingDetails	ProcessingStatus	Search string
NIST	Success	No search syntax
Description: DISCO does not ingest NIST standard files. These are files that are known to be standard operating system (Windows, OS X) and application-specific files that do not contain user content. By not ingesting these kinds of files, DISCO reduces the number of files that require review.
Recommended user action: No action required.

Related articles

Articles in this section