Concepts

It's worth getting familiar with the basic concepts that comprise BrainRex as they are used throughout the documentation. This knowledge will be helpful as you proceed and is also cool to brag about amongst friends.

Components

"Component" is the generic term we use for sources, transforms, and destinations. You compose components to create pipelines, allowing you to ingest, transform, and send data.

View all components

Sources

BrainRex would be junk if it couldn't ingest data. A "source" defines where BrainRex
should pull data from, or how it should receive data pushed to it. A pipeline
can have any number of sources, and as they ingest data they proceed to
normalize it into [events](#events) \(see next section\). This sets the stage

for easy and consistent processing of your data. Examples of sources include file, syslog, socket, and stdin.

View all sources

Transforms

A "transform" are machine learning models that can learn how to tranforms raw unstructured data from

View all transforms

Destinations

A "destination" is a destination for events. Each sink's interacting with. For example, the [socket sink][docs.sinks.÷] will design and transmission method is dictated by the downstream service it is stream individual events, while the aws_s3 sink will buffer and flush data.

View all sinks

Events

All items (both logs and metrics) passing through Vector are known as an "event", which is explained in detail in the data model section.

View data model

Pipelines

A "pipeline" is the end result of connecting sources, transforms, and sinks. You can see a full example of a pipeline in the configuration section.

View configuration