Github

Configuration

GitHub source connector integrates with the GitHub REST API to extract and synchronize data.

Connects to your GitHub repositories.

It supports syncing repository metadata, directory structures, and code files with configurable filtering options for branches and file types.

View Source Code

Explore the Github connector implementation

Authentication

This connector uses a custom authentication configuration.

Authentication Configuration

GitHub authentication credentials schema.

personal_access_token

strRequired

GitHub PAT with read rights (code, contents, metadata) to the repository

repo_name

strRequired

Repository to sync in owner/repo format (e.g., ‘airweave-ai/airweave’)

Configuration Options

The following configuration options are available for this connector:

Configuration Parameters

Github configuration schema.

branch

str

Specific branch to sync (e.g., ‘main’, ‘development’). If empty, uses the default branch.

Data Models

The following data models are available for this connector:

GitHubRepositoryEntity

Schema for GitHub repository entity.

Field	Type	Description
name	str	Repository name
full_name	str	Full repository name including owner
description	Optional[str]	Repository description
default_branch	str	Default branch of the repository
created_at	datetime	Creation timestamp
updated_at	datetime	Last update timestamp
language	Optional[str]	Primary language of the repository
fork	bool	Whether the repository is a fork
size	int	Size of the repository in KB
stars_count	Optional[int]	Number of stars
watchers_count	Optional[int]	Number of watchers
forks_count	Optional[int]	Number of forks
open_issues_count	Optional[int]	Number of open issues

GitHubDirectoryEntity

Schema for GitHub directory entity.

Field	Type	Description
path	str	Path of the directory within the repository
repo_name	str	Name of the repository containing this directory
repo_owner	str	Owner of the repository

GitHubCodeFileEntity

Schema for GitHub code file entity.

Field	Type	Description
sha	str	SHA hash of the file content
path	str	Path of the file within the repository
is_binary	bool	Flag indicating if file is binary

GithubRepoEntity

Schema for a GitHub repository.

References: https://docs.github.com/en/rest/repos/repos?apiVersion=2022-11-28

Field	Type	Description
name	Optional[str]	Name of the repository.
full_name	Optional[str]	Full name (including owner) of the repo.
owner_login	Optional[str]	Login/username of the repository owner.
private	bool	Whether the repository is private.
description	Optional[str]	Short description of the repository.
fork	bool	Whether this repository is a fork.
created_at	Optional[datetime]	When the repository was created.
updated_at	Optional[datetime]	When the repository was last updated.
pushed_at	Optional[datetime]	When the repository was last pushed.
homepage	Optional[str]	Homepage URL for the repository.
size	Optional[int]	Size of the repository (in kilobytes).
stargazers_count	int	Number of stars on this repository.
watchers_count	int	Number of people watching this repository.
language	Optional[str]	Primary language of the repository.
forks_count	int	Number of forks for this repository.
open_issues_count	int	Number of open issues on this repository.
topics	List[str]	Topics/tags applied to this repo.
default_branch	Optional[str]	Default branch name of the repository.
archived	bool	Whether the repository is archived.
disabled	bool	Whether the repository is disabled in GitHub.

GithubContentEntity

Schema for a GitHub repository’s content (file, directory, submodule, etc.).

References: https://docs.github.com/en/rest/repos/contents?apiVersion=2022-11-28

Field	Type	Description
repo_full_name	Optional[str]	Full name of the parent repository.
path	Optional[str]	Path of the file or directory within the repo.
sha	Optional[str]	SHA identifier for this content item.
item_type	Optional[str]	Type of content. Typically ‘file’, ‘dir’, ‘submodule’, or ‘symlink’.
size	Optional[int]	Size of the content (in bytes).
html_url	Optional[str]	HTML URL for viewing this content on GitHub.
download_url	Optional[str]	Direct download URL if applicable.
content	Optional[str]	File content (base64-encoded) if retrieved via ‘mediaType=raw’ or similar.
encoding	Optional[str]	Indicates the encoding of the content (e.g., ‘base64’).

Setting up a GitHub Personal Access Token for Airweave

To connect your GitHub repositories to Airweave, you’ll need to create a Personal Access Token (PAT) with the appropriate permissions. This guide walks you through the process of creating and configuring a fine-grained token for use with Airweave.

Step 1: Access Developer Settings in GitHub

Navigate to your GitHub account settings by clicking on your profile picture in the top right corner, then select “Settings”. From there, scroll down to find and click on “Developer settings” in the left sidebar.

Step 2: Create a New Fine-Grained Token

In the Developer settings page, select “Fine-grained tokens” from the left menu, then click on “Generate new token”.

Step 3: Configure Your Token

Fill out the token form with the following details:

Token name: Choose a descriptive name like “Airweave Integration”
Expiration: Select an appropriate expiration date (recommended: 1 year for production use)
Repository access: Choose either “All repositories” or select specific repositories you want to connect to Airweave

Step 4: Set Required Permissions

For the GitHub connector to work properly, you need to grant the following permissions:

Under “Repository permissions”:

Set “Contents” to “Read-only” - This allows Airweave to read repository files

Step 5: Generate and Save Your Token

After configuring the permissions, scroll to the bottom of the page and click “Generate token”.

Important: GitHub will display your token only once. Make sure to copy and store it in a secure location, as you won’t be able to view it again.

Step 6: Add Your Token to Airweave

When setting up the GitHub connector in Airweave:

Paste your personal access token in the “Personal Access Token” field
Enter the repository name in the format owner/repo (e.g., airweave-ai/airweave)

Your GitHub repository is now connected to Airweave and ready for synchronization.