What is native and processed data?

Once documents are successfully uploaded, they will be searchable and viewable in your project. In addition to the videos, you can also read the Upload help articles.

Everlaw has a self-service, cloud-based uploading system that supports both native and processed data. There are a few ways to tell if your data is native or processed. It's important to know these differences to ensure your data gets uploaded correctly.

Native Data

Native data is typically your unprocessed or raw files (i.e. original documents that have come from a custodian's computer or data that is collected by a vendor). Data can be organized in subdirectories named after their custodians. Native documents will be automatically processed and uploaded on the platform. For native data uploads, Everlaw generates images, text, and metadata for documents.

Processed Data

Processed data includes files that have been processed or produced by another system (i.e often times these are documents and productions that users receive from opposing counsel). Processed data can be formatted in two ways:

  • The most common formatting includes a data set of files accompanied by a load file containing the files' metadata. Files should be named after their Begin Bates and the load file at a minimum must include the Begin Bates and either End Bates or Page count.

  • If you do not have a load file, you can still upload PDF only-datasets using the processed data uploader tool on Everlaw.

Processed documents can either be transferred to Everlaw Support for processing or they can be uploaded and processed onto the platform by users.

Uploading Native Data

Everlaw’s uploader is a directly accessible interface that allows users to upload data directly into the Everlaw platform.

Everlaw's cloud-processing system handles 500k documents/hour while simultaneously automating standard processing such as error-handling, deduplication, deNISTing, OCR, imaging, and generating text and metadata.

Uploading data directly into Everlaw from your Microsoft organization requires Database Upload permissions on Everlaw and Global Admin permissions on your Microsoft organization.

Uploading Processed Data

Uploading structured, processed data with a load file into Everlaw can be a complex process with many potential sources of error. Learn how to perform your own uploads of productions and processed data. Please note that uploading processed data only works in the Chrome, Edge, and Firefox web browsers.

Everlaw’s processed data uploader also allows for seamless and convenient uploads for produced PDFs without a load file. Simply drag and drop a folder of PDFs, and Everlaw will upload the documents as processed data.

Many users choose to let the Everlaw Support team handle processed data uploads. These uploads go through three phases: the successful transmission of the data to Support, the completed processing of the data on the backend, and the uploading of the transmitted data into the platform.

If you have Database Admin or Upload permissions, you can retroactively re-configure documents that have already been uploaded. You can reprocess documents from the results table by clicking Batch > Reprocess.

Interactive Training

Live Training

Everlaw offers free live and recorded training sessions on Native Data Loading, which covers uploading native data. You can sign up for a training here.

Topics covered include:

  • Uploading native data

Everlaw offers free live and recorded training sessions on Processed Data Uploads, which you can sign up for here.

Topics covered include:

  • The standard format for processed data

  • How to navigate the steps in the processed uploader, including initializing the upload, defining special fields, metadata parsing, combining fields, normalizing fields, and selecting folders to upload

  • How to QA your upload once it's complete

  • How to upload produced PDFs without a load file

Training Activities Checklist

After you've watched the videos and have a basic understanding of uploads, practice your skills and try performing the following actions:

  • Click "View Report" on a native upload to view information about the documents.

  • Click "View Configuration" on a native upload card to see the settings chosen for that upload.

  • Use the global deduplication setting on an upload and see how many documents get deduped.

  • QA your processed data uploads by:

    • Checking the metadata on documents

    • Making sure everything got uploaded (all expected images, text, and native files)