Skip to main content
Ediscovery Support Center Case Builder Support Center Hold Support Center
Back to csdisco.com

Remediating ingest exceptions

  • Updated

Exception reports from ingest will list a ProcessingStatus and ProcessingDetails for every file with an exception.

ingest-report-errors-identify.png

Below are DISCO's recommendations for remediating each exception:

ProcessingDetails ProcessingStatus Search string
Password protected Failure processingStatus(Failure) & processingDetails("Password protected")
Description: The document was created in DISCO, but no image was created nor was any text extracted because the document could not be opened without the password. The original (native) document can be downloaded from the document viewer.

Recommended user action:

  1. Obtain the document password.
  2. Open the document in its native application using the password
  3. Print the document to a PDF file.  Make sure to expose hidden content/revisions/sheets/rows/etc during printing.  
  4. Overlay the PDF file as the image of the document.  During image overlay, select the option for “Replace document text with image OCR text” to generate text for the document.  
  5. Optional: Overlay the decrypted native if desired.  Note that this may be considered changing the original source data.  
  6. Alternatively, contact DISCO Support with the password to assist with remediation of files in DISCO.

 

ProcessingDetails ProcessingStatus Search string
Encrypted Failure processingStatus(Failure) & processingDetails("Encrypted")
Description: The document was created in DISCO, but no image was created nor was any text extracted because the document could not be opened because the document was encrypted. The original (native) document can be downloaded from the document viewer.

Recommended user action:

  1. Obtain the document password.
  2. If the document is not an attachment, delete the loose document and re-ingest the unencrypted document.  Make sure to maintain the original metadata. 
  3. If the protected document is an attachment, delete the entire document family (the parent document and all attachments to the parent) and re-ingest the document family with the unencrypted document. Make sure to maintain the original metadata. 
  4. Alternatively, contact DISCO Support with the password to decrypt the file and update the document in DISCO.

 

ProcessingDetails ProcessingStatus Search string
Unknown Failure  
Description: The document was created in DISCO, but no image was created nor was any text extracted because DISCO couldn’t read the file header to determine the file type and process it correctly. The original (native) document can be downloaded from the document viewer.

Recommended user action:

  1. Test the file for corruption. To test for corruption, download the original (native) file from the document viewer. Attempt to open the document in its native application, and if it successfully opens, Print the document to a PDF file.  Make sure to expose hidden content/revisions/sheets/rows/etc during printing.  
  2. Overlay the PDF file as the image of the document.  During image overlay, select the option for “Replace document text with image OCR text” to generate text for the document.  
  3. Optional: Overlay an uncorrupted native if desired.  Note that this may be considered changing the original source data.  
  4. If the document does not successfully open, obtain replacement documents.
  5. Once replacement documents are saved or obtained, delete the affected documents from DISCO and ingest the replacement documents. Make sure to maintain the original metadata.

 

ProcessingDetails ProcessingStatus Search string
Unsupported File Failure processingDetails("Unsupported File")
Description: The file type of the document is not supported by DISCO.

Recommended user action:

  1. Download and review the native documents.
  2. If the unsupported files can be converted into a different, supported format (for example, from Lotus 123 to Excel), convert the files and save them as a supported file type.
  3. Once the replacement documents are saved, delete the affected documents from DISCO and ingest the replacement documents. Make sure to maintain the original metadata.
  4. If the document cannot be opened or converted, contact DISCO Support for assistance with document conversion and replacement in DISCO. Note that not all documents can be converted to different formats and in many cases conversion is not possible.

 

ProcessingDetails ProcessingStatus Search string
Corrupted Failure processingStatus(Failure) & processingDetails(Corrupted)
Description: The file has been corrupted and is not accessible.

Recommended user action:

  1. To test for a corrupted document, download the original (native) file from the document viewer.
  2. Attempt to open the document in its native application, and if it successfully opens, re-save the document. 
  3. Print the document to a PDF file.  Make sure to expose hidden content/revisions/sheets/rows/etc during printing.  
  4. Overlay the PDF file as the image of the document.  During image overlay, select the option for “Replace document text with image OCR text” to generate text for the document.  
  5. If the document does not successfully open, obtain replacement documents.
  6. Once replacement documents are saved or obtained, cull the affected documents from DISCO and ingest the replacement documents.  Make sure to maintain the original metadata.

 

ProcessingDetails ProcessingStatus Search string
Exceeded supported ingest text size Partial Filter ingest report for TextLimitExceeded = “Yes”
Description: The document was created in DISCO, but no image was created nor was any text extracted because the text size was too big. To ensure the high performance of the DISCO search indexes, DISCO limits the text size to 100MB. The image will show “Document unsupported” in the document viewer, but the original (native) document can be downloaded and reviewed.
Recommended user action: The document text was not indexed for search. Review the native document outside of DISCO then apply the appropriate work product to the native document in the review database.

 

ProcessingDetails ProcessingStatus Search string
Container extraction failed Partial processingStatus(Failure) & processingDetails("Container extraction failed")
Description: DISCO extracted X out of Y documents out of a container, possibly due to corruption or issues with permissions.

Recommended user action:

  1. Review the container path in the ingest exception report in Excel to identify the container that failed to extract.
  2. Download the container files and try to open them in their native application. If they can be opened, try re-ingesting the extracted documents. Make sure to maintain the original metadata.
  3. If the documents cannot be opened in their native application, then the documents may be corrupted. Obtain replacement documents and ingest them.

 

ProcessingDetails ProcessingStatus Search string
Partial failure Partial processingStatus(Failure) & processingDetails("Partial failure")
Description: DISCO couldn’t extract text, images, or metadata from the document. The original (native) document can be downloaded from the document viewer.

Recommended user action:

  1. Identify the partially failed document in the Ingest Exception report.
  2. Review the Processing Details column to determine whether the text, image, or metadata was not extracted.
  3. Extract the respective item from the original native file and overlay that.
  4. Alternatively, contact DISCO Support for assistance with overlaying the failed portions of the document in DISCO.

 

ProcessingDetails ProcessingStatus Search string
Exceeded near native page count Partial Filter ingest report ImagePageLimitExceeded = Yes
Description: This is most common with large Excel files. Near native images have a max of 30,000 pages.
Recommended user action: Review the native document outside of DISCO then apply the appropriate work product to the native document in the review database.

 

ProcessingDetails ProcessingStatus Search string
No text - file type not expected to have text Success processingDetails("No text - file type not expected to have text")
Description: The file type was not expected to have text (for example, video or audio files).

Recommended user action:

  1. Inspect the documents and determine if text should be available.
  2. Obtain the accompanying text.
  3. Contact DISCO Support for assistance with a document overlay to add the text to the document in the review database.

 

ProcessingDetails ProcessingStatus Search string
DISCO configured exclusion Partial No search syntax

Description:

DISCO does not ingest known standard system files such as:

Files named:

  • "Thumbs.db", ".DS_Store"

Folders named:

  • ".AppleDouble", ".DS_Store", "__MACOSX"

Files ending in:

  • ".joboptions"
  • ".lnk"
  • ".md5"
  • ".url"

DISCO will ingest directories ending in "_files" if there is a parent .html download file accompanying them.

Recommended user action: No action required.

 

ProcessingDetails ProcessingStatus Search string
NIST Success No search syntax
Description: DISCO does not ingest NIST standard files. These are files that are known to be standard operating system (Windows, OS X) and application-specific files that do not contain user content. By not ingesting these kinds of files, DISCO reduces the number of files that require review.
Recommended user action: No action required.

 

Was this article helpful?
0 out of 0 found this helpful
Return to top

Related articles

Articles in this section

See more