Enhancing Remote Infrastructure Resilience: How AccessParks Boosted Connectivity with AI Observability

ML Observability vs LLM Observability: A Complete Guide to AI Monitoring with InsightFinder AI

InsightFinder’s LLM Labs: Turning AI Innovation into Production-Ready Reality

Monitoring Large Language Models: What to Look for in a Solution That Keeps Your AI Smart, Safe, and Scalable

Making Sense of LLMs, RAG, Fine-Tuning, and Evaluation: How InsightFinder AI Delivers Observability for AI Systems

How OpenTelemetry and InsightFinder AI Unlock Proactive Observability for Modern Enterprises

Driving Smarter Operations: How InsightFinder AI and Zabbix Work Together for AI-Driven ITObservability

Driving AI Resilience: How Proactive Observability Reduced Downtime & Improved Fraud Detection with InsighFinder AI

Login

Fluentd

InsightFinder can stream the logs from Confluent Kafka topics and correlate it with other data to generate anomalies, automatically identify root causes and predict incidents. Below documentation is a walk through of how to setup and configure a confluent kafka agent and project.

Single Node Manual Installation

  1. Go to InsightFinder Agent td-agent repo
  2. Download fluent-plugin-out-InsightFinder.gemspec and out_InsightFinder.rb
  3. Move these 2 files to either /etc/fluent/plugin or /etc/td-agent/plugin depending on how you install the Fluentd
  4. By default, Fluentd adds the /etc/fluent/plugin directory to its load path. Thus, any additional plugins that are placed in /etc/fluent/plugin will be loaded automatically. If using td-agent, use /etc/td-agent/plugin
  5. Modify the configuration file (should be located in /etc/td-agent/td-agent.conf) of Fluentd, add the section for insight finder plugin according to example file td-agent.conf.example
  6. Restart Fluentd and the data will be ingested into InsightFinder.

Tested with Fluentd version 1.0

Multi-node installation using Ansible

  1. Please follow the ReadMe file in the tg-agent repo
  2. Check this reference documentation

Contents

  • Published: 30 Apr 2025
  • 1 min read

Share

Explore InsightFinder AI

Take InsightFinder AI for a no-obligation test drive. We’ll provide you with a detailed report on your outages to uncover what could have been prevented.