Jay Taylor's notes

back to listing index

fluent/fluent-bit

[web search]
Original source (github.com)
Tags: logging fluentd fluentbit github.com
Clipped on: 2019-02-11

Skip to content
Fast and Lightweight Log processor and forwarder for Linux, BSD and OSX http://fluentbit.io/
Branch: master
New pull request
Clone or download
Image (Asset 3/6) alt= .github community: add initial Issue Template for Feature Requests and Bug Re… 7 months ago bin Initial import. 4 years ago ci ci: add FLB_COVERAGE to calculate test-code coverage, add summary to … 3 months ago cmake build: avoid including Windows-specific build definitions (#1088) 5 days ago conf parsers: add support for CRI-O and containerd (#881) 3 months ago cpack build: CMake: update package info 2 years ago debian debian: bump to v1.1.0 2 months ago documentation Doc: fix URL 3 years ago examples compat: include <unistd.h> through monkey/mk_core.h 2 months ago include pipe: add flb_pipe_set_nonblocking() for portability (#1095) 3 days ago init build: fix systemd unit file missing '/' in path when make rpm package ( 2 months ago lib lib: chunkio: sync windows support changes 3 days ago plugins out_kafka: add timestamp_format to kafka output (#1086) 5 days ago scripts scripts: test.lua: output table contents (#627) 8 months ago src core: use mk_event_closesocket() instead of plain close(2) (#1093) an hour ago tests test: http client test segfaults in macOS. (#1097) 3 days ago tools/xxd-c tools: xxd-c: include getopt.h through <mk_getopt.h> for portability (#… 25 days ago .dockerignore dockerfile: switch to distroless as base image for container, add .do… 3 months ago .gitignore config: new static configuration mode 4 months ago .travis.yml test: filter_kubernetes: send systemd test message after start (#929) 2 months ago CMakeLists.txt build: make LuaJIT compilable on Windows (#1053) 18 days ago CONTRIBUTING.md docs: contributing: fix typo s/pacth or patches/patches (#1049) 17 days ago Dockerfile dockerfile: bump to v1.1.0 2 months ago Dockerfile.debug build: Add Dockerfile.debug to allow 'shell into image' (#1034) 26 days ago GOLANG_OUTPUT_PLUGIN.md doc: GOLANG: text improvements (#712) 6 months ago LICENSE Doc: add reference to Apache License v2.0 4 years ago MAINTAINERS.md Doc: add MAINTAINERS.md file 2 years ago README.md doc: add travis build badge to README.md (#947) 2 months ago appveyor.yml CI: Appveyor: disable examples 2 years ago debian.sh Debian: add packager script 3 years ago fluent-bit_git.bb bitbake: re-work recipe, pull from GIT master 25 days ago fluentbit_logo.png Doc: Add logo to README 3 years ago valgrind.supp core: add valgrind suppression error files (dl-open leaks) 2 years ago

README.md

Image (Asset 4/6) alt=Quick Start 

$ cd build
$ cmake ..
$ make
$ bin/fluent-bit -i cpu -o stdout

Features

Fluent Bit support the following features through plugins:

Input plugins

name option description
CPU cpu gather CPU usage between snapshots of one second. It support multiple cores
Disk disk usage of block device
Dummy dummy generates dummy event
Exec exec executes external program and collects event logs
Forward forward Fluentd forward protocol
Memory mem usage of system memory
MQTT mqtt start a MQTT server and receive publish messages
Netif netif usage of network interface
Kernel Ring Buffer kmsg read Linux Kernel messages, same behavior as the dmesg command line program
Syslog syslog read messages from a syslog daemon
Systemd/Journald systemd read messages from journald, part of the systemd suite
Serial Port serial read from serial port
Standard Input stdin read from the standard input
Head head read first part of files
Health health check health of TCP services
Process proc check health of Process
Random random generate random numbers
Tail tail tail log files
TCP tcp listen for raw JSON map messages over TCP

Filter Plugins

name option description
Record Modifier record_modifier Append/Remove key-value pair
Grep grep Match or exclude specific records by patterns
Nest nest Nest specific records by patterns
Kubernetes kubernetes Enrich logs with Kubernetes Metadata
Stdout stdout Print records to the standard output interface
Parser parser Parse records

Output Plugins

name option description
Counter counter count records
Elasticsearch es flush records to a Elasticsearch server
File file flush records to a file
FlowCounter flowcounter count records and its size
Forward forward flush records to a Fluentd service. On the Fluentd side, it requires an in_forward.
NATS nats flush records to a NATS server
HTTP http flush records to a HTTP end point
InfluxDB influxdb flush records to InfluxDB time series database
Plot plot generate a file for gnuplot
Standard Output stdout prints the records to the standard output stream
Treasure Data td flush records to Treasure Data service (cloud analytics)

Official Documentation

The official documentation of Fluent Bit can be found in the following site:

http://fluentbit.io/documentation/

Contributing

In order to contribute to the project please refer to the CONTRIBUTING guidelines.

Contact

Feel free to join us on our Slack channel, Mailing List or IRC:

License

This program is under the terms of the Apache License v2.0.

Authors

Fluent Bit is made and sponsored by Treasure Data among other contributors.

Press h to open a hovercard with more details.