Elasticsearch

Elasticsearch logo

Elasticsearch

Connect your Elasticsearch data to Airweave

Overview

The Elasticsearch connector allows you to sync data from Elasticsearch into Airweave, making it available for search and retrieval by your agents.

Configuration

ElasticsearchSource

Elasticsearch source implementation.

Connects to an Elasticsearch cluster, retrieves index metadata and documents for configured indices using the scroll API.

Authentication

This connector uses a custom authentication configuration class: ElasticsearchAuthConfig.

Authentication Configuration

Elasticsearch authentication credentials schema.

host
strRequired

The full URL to the Elasticsearch server, including http or https

port
intRequired

The port of the elasticsearch database

indices
strDefaults to *

Comma separated list of indices to sync. Use ’*’ for all indices.

fields
strDefaults to *

List of fields to sync from each document. For all fields, use ’*‘

Entities

The following data models are available for this connector:

Schema for Elasticsearch index entities.

FieldTypeDescription
indexstrName of the Elasticsearch index
healthOptional[str]Health status of the index
statusOptional[str]Status of the index
docs_countOptional[int]Number of documents in the index
docs_deletedOptional[int]Number of deleted documents in index
store_sizeOptional[str]Store size of the index

Schema for Elasticsearch document entities.

FieldTypeDescription
indexstrName of the index this document belongs to
doc_idstrDocument ID
sourceDict[str, Any]Source document content