Log Collecting And Analysis

Collecting

There are various ways to collect logs from application.

Log files collector

You can use FilebeatFluentd to collect file logs including to use Kafka MQ to transport native-json format logs. When use this, need to open kafka-fetcher and enable configs enableNativeJsonLog.

Collector config examples:

Java agent’s toolkits

Java agent provides toolkit for log4j, log4j2, logback to report logs through gRPC with automatic injected trace context.

SkyWalking Satellite sidecar is a recommended proxy/side to forward logs including to use Kafka MQ to transport logs. When use this, need to open kafka-fetcher and enable configs enableNativeProtoLog.

Java agent provides toolkit for log4j, log4j2, logback to report logs through files with automatic injected trace context.

Log framework config examples:

Log Analyzer

Log analyzer of OAP server supports native log data. OAP could use Log Analysis Language to structurize log content through parse, extract, and save logs. Also the analyzer leverages Meter Analysis Language Engine for further metrics calculation.

log-analyzer:
  selector: ${SW_LOG_ANALYZER:default}
  default:
    lalFiles: ${SW_LOG_LAL_FILES:default}
    malFiles: ${SW_LOG_MAL_FILES:""}

Read Log Analysis Language documentation to learn log structurize and metrics analysis.