Long time Statistics with Average


(Michael Radda) #1

Hi @All!

We want a long time overview (3 years +) of some parameters from our webapplication, an average per month. With this information, we would compare the site speed in a monthly average, for the last 3 Years.

Our WebApplication writes statistic files looks like this: (GELF-Format)

{"version":"1.1","timestamp":1545296398.948,"host":"ServerName","short_message":"STAT","level":6,"_actionName":"InternalSiteCode","_app":"InternalApplicationCode","_contentType":"text/html","_duration":3,"_durationAction":1,"_durationDb":0,"_durationFast":0,"_durationFilter":0,"_durationHds":0,"_durationHss":0,"_durationServlet":0,"_durationSolr":0,"_durationSolrQuery":0,"_durationXslt":2,"_ipBlocked":false,"_overload":false,"_referer":"","_remoteAddress":"aaa.bbb.ccc.ddd","_requestUrl":"/path/to/url","_responseCode":200,"_resultType":"NO_RESULT","_servletClassName":"NewUriTree","_suppress":false,"_userAgent":"Mozilla/5.0","_userSessionId":"aaabbbcccddd"}

On this webapp we have about 2 Millions of PageImpressions (PI) per Day and every PI generates this logentry. So how can i aggregate all data from one month, build an average of the “_duration*” fields and store this monthly average in an extra index for a longer time (3 years +), so that we can compare e.g. averages from december 2018 with december 2017 and december 2016. Historical data are available …

thanks for help
Michael


(Jan Doberstein) #2

you can’t do this with plain graylog.

To generate the data you would need to write a script that use the Graylog API and then you reingest the result into Graylog that this is saved in one extra index.


(system) closed #3

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.