HAProxy Content Pack for Graylog3 and Graylog2 - HTTP Traffic Monitoring

Contests, Podcasts, Blogs, Give-Aways & Polls Dashing Dashboard Aug 2022 (Enter/Vote)
, , , ,
1

Setup Doc: Web Applications — Centralized Logging and Monitoring with Graylog

Graylog3 GitHub Link: GitHub - hariom282538/graylog-content-pack-haproxy-json: A Content Pack for Graylog2/Graylog3 which supports HTTP Real-Time logging and Monitoring from HAProxy[1.5/1.8].

Graylog2 GitHub Link: GitHub - hariom282538/graylog-content-pack-haproxy-json at graylog2_contentPack

This content pack includes following configurations for one click setup:

  • JSON Logging
    • HTTP Access/Request/Captured Log
  • Inputs
    • HaProxy log - Syslog UDP
  • Extractors
    • Extract JSON fields
    • Empty JSON field
    • Reduced message to path
    • HTTP Method from haproxy_httpRequest
    • HTTP URI from haproxy_httpRequest
    • HTTP Request Protocol version from haproxy_httpRequest
    • Empty haproxy_httpRequest Field
    • Removing parenthesis from haproxy_capturedRequestHeaders
    • Host Extraction from Captured HTTP Request
    • User Agent Extraction from Captured HTTP Request
    • HTTP Referer Extraction from Captured HTTP Request
    • HTTP XForwardedFor Extraction from Captured HTTP Request
    • Browser Extraction from haproxy_capturedHttpRequestUserAgent
  • Streams
    • HAProxy
    • HAProxy HTTP 4XX
    • HTTP HTTP 5XXs
  • Dashboards
    • Requests last 24h (Count)
    • Requests last 24h (Histogram)
    • HTTP 4XXs last 24h(Count)
    • HTTP 4XXs last 24h (Histogram)
    • HTTP 5XXs last 24h (Count)
    • HTTP 5XXs last 24h (Histogram)
    • Map of requests last 24h (World Map)
    • Top 5 countries with Most Requests last 24h (pie with table)
    • Frontend Connection Graph: Last 7 days (Field Graph)
    • Requests per HTTP Methods: last 24h (pie with table)
    • Response codes last 24h (pie with table)
    • Top 10 Most Requested Domains : 24h (pie with table)
    • Top 10 URLs with most requests : last 24h (pie with table)
    • Top 10 IPs with Most Requests last 24h (pie with table)
    • Top Hourly backends(pie with table)
    • Top 10 Browsers with most requests : 24h (pie with table)
    • Average Request Time (in ms) last 24 h (count)
    • Average Request Size (in bytes) last 24 h (count)
    • Time/Size last 24h (combined graph)
    • Response size (bytes) last 24h (Line Graph)
    • Response Time (ms) last 24h (Line Graph)
      1
      11440×900 66.7 KB

      2
      21440×900 94.5 KB

      3
      31440×900 69.7 KB

      4
      41440×900 96.2 KB

      5
      51440×900 82.9 KB
1 Like
2

Awesome, @hariom282538 ! Thank you for submitting a dashboard entry. I’ll include this one in the August contest entries.

TO the community, Please be sure to check out these dashboard, contribute your own, and vote for the existing ones! The July contest winner will be announced later in this final week of July!

1 Like
3

Thanks @dscryber , Looking forward.

1 Like
4

@hariom282538
Very nice :+1:
I miss the old Widgets like that.

2 Likes
5

Will this work in Graylog5 ?

6

There is a good chance it won’t (some parts may), there were several key changes between 3 and 5.