Github repository log

gianluca-valentini · May 13, 2020, 3:58pm

Hi guys,
I have the task to read log from Github repository. Can you address me to understand if there is some Graylog input that I can use?

Somebody can help and address me to understand how I can start the project?
Thanks for your help
Gianluca

shoothub · May 13, 2020, 4:28pm

There is logstash input plugin for reading event from webhooks, I don’t know if it is something you are finding:
https://www.elastic.co/guide/en/logstash/current/plugins-inputs-github.html

jan · May 13, 2020, 4:43pm

afaik @konrad has a polling script for that … maybe he shares.

gianluca-valentini · May 13, 2020, 5:39pm

thanks a lot.
The script can be very helpful @konrad, please can you help me?

konrad · May 14, 2020, 8:01am

Hi @gianluca-valentini,

I have a ruby script which I use, but it is not working properly. Some logs are not passed correctly, it is fixable but I never had the time to do it.

github.com

kmerz/ruby-git-gelf/blob/master/git-graylog.rb

#! /usr/bin/env ruby

require 'json'
require 'socket'
require 'date'

class Config
  LASTCOMMITS_FILE = "~/.lastcommits.json"

  def initialize(path = nil, flush = false)
    @configFile = File.expand_path LASTCOMMITS_FILE
    @config = readLastCommits
    @flush = flush
    unless path.nil?
      project_name = projectFromPath(path)
      @config[project_name] = {}
      @config[project_name]["path"] = File.expand_path(path)
    end
  end

This file has been truncated. show original

On a long weekend I did it in haskell since I wanted to play around with parser:

This works better, but has not yet so much fields as the ruby script has.

In both cases I take a custom git-log command:

git log --pretty=format:'%cI - %an - %h - %s' --abbrev-commit --no-merges --shortstat origin/master

and parse it. What needs to be fixed in the ruby script is that I use a dash - as a separator, which is not very wise. That’s why some of the logs get not parsed correctly since someone is using - in their commit message.

I hope this helps. Let me know if you need help or you come up with a fix or a better solution.

- Konrad

gianluca-valentini · May 14, 2020, 9:31am

Thanks a lot !! I will try to understand the script as I don’t know ruby.
Thanks again

Gianluca

system · May 28, 2020, 9:40am

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.

Topic		Replies	Views
Graylog - Inputs - Help Graylog Central (peer support)	2	362	March 27, 2019
Ingesting Log Files from JSON into graylog Graylog Central (peer support)	13	4188	August 31, 2022
Adding Graylog to already existing ELK stack Graylog Central (peer support)	5	5601	March 26, 2018
Logstash Output to Graylog 3.0 (Can't search message) Graylog Central (peer support)	3	2534	May 24, 2019
Ask for Elasticsearch input type in Graylog-Server Graylog Central (peer support)	2	657	September 25, 2020

Github repository log

Related topics