Long time Statistics with Average

Hi @All!

We want a long time overview (3 years +) of some parameters from our webapplication, an average per month. With this information, we would compare the site speed in a monthly average, for the last 3 Years.

Our WebApplication writes statistic files looks like this: (GELF-Format)

{"version":"1.1","timestamp":1545296398.948,"host":"ServerName","short_message":"STAT","level":6,"_actionName":"InternalSiteCode","_app":"InternalApplicationCode","_contentType":"text/html","_duration":3,"_durationAction":1,"_durationDb":0,"_durationFast":0,"_durationFilter":0,"_durationHds":0,"_durationHss":0,"_durationServlet":0,"_durationSolr":0,"_durationSolrQuery":0,"_durationXslt":2,"_ipBlocked":false,"_overload":false,"_referer":"","_remoteAddress":"aaa.bbb.ccc.ddd","_requestUrl":"/path/to/url","_responseCode":200,"_resultType":"NO_RESULT","_servletClassName":"NewUriTree","_suppress":false,"_userAgent":"Mozilla/5.0","_userSessionId":"aaabbbcccddd"}

On this webapp we have about 2 Millions of PageImpressions (PI) per Day and every PI generates this logentry. So how can i aggregate all data from one month, build an average of the “_duration*” fields and store this monthly average in an extra index for a longer time (3 years +), so that we can compare e.g. averages from december 2018 with december 2017 and december 2016. Historical data are available …

thanks for help
Michael

you can’t do this with plain graylog.

To generate the data you would need to write a script that use the Graylog API and then you reingest the result into Graylog that this is saved in one extra index.

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.