Create or update a local files repository (location)

Use this API to create a new location to crawl files located on the same server than the OpenSearchServer instance.

Requirement: OpenSearchServer v1.5

The URLs and HTTP methods used by this API are different from other OSS APIs, please give this document a careful read.

Call parameters

URL: /services/rest/crawler/file/repository/inject/localfile/{index_name}/{result_type}?path={path}&ignoreHiddenFile={ignoreHiddenFile}&includeSubDirectory={includeSubDirectory}&enabled={enabled}&delay={delay}

Method: PUT

URL parameters:

  • index_name (required): The name of the index.
  • result_type (required): The type of returned result (json or xml).
  • path: The path to the root folder where the crawler must start.
  • ignoreHiddenFile: whether hidden files should be ignored during crawling (true or false).
  • includeSubDirectory: whether sub-directories should be crawled (true or false).
  • enabled: whether this new location should be eligible for crawling (true or false).
  • delay: delay between each file access in ms (defaults to 0).

Success response

The new location has been created or updated.

HTTP code:
200

Content (json):

{
  "successful":true,
  "info":"Inserted"
}

Error response

The request failed. The reason is provided in the content.

HTTP code:
500

Sample call

Using CURL:
Simple call:

curl -XPUT -H \
     http://localhost:8080/services/rest/crawler/file/repository/inject/localfile/my_index/json?path=E:/_temp&ignoreHiddenFile=true&includeSubDirectory=false&enabled=true&delay=2

Using jQuery:

$.ajax({ 
   type: "PUT",
   dataType: "json",
   url: "http://localhost:8080/services/rest/crawler/file/repository/inject/localfile/my_index/json?path=E:/_temp&ignoreHiddenFile=true&includeSubDirectory=false&enabled=true&delay=2"
}).done(function (data) {
   console.log(data);
});

View/edit on GitHub


comments powered by Disqus