Github repository log

gianluca-valentini · May 13, 2020, 3:58pm

Hi guys,
I have the task to read log from Github repository. Can you address me to understand if there is some Graylog input that I can use?

Somebody can help and address me to understand how I can start the project?
Thanks for your help
Gianluca

shoothub · May 13, 2020, 4:28pm

There is logstash input plugin for reading event from webhooks, I don’t know if it is something you are finding:
https://www.elastic.co/guide/en/logstash/current/plugins-inputs-github.html

jan · May 13, 2020, 4:43pm

afaik @konrad has a polling script for that … maybe he shares.

gianluca-valentini · May 13, 2020, 5:39pm

thanks a lot.
The script can be very helpful @konrad, please can you help me?

konrad · May 14, 2020, 8:01am

Hi @gianluca-valentini,

I have a ruby script which I use, but it is not working properly. Some logs are not passed correctly, it is fixable but I never had the time to do it.

github.com

kmerz/ruby-git-gelf/blob/master/git-graylog.rb

#! /usr/bin/env ruby

require 'json'
require 'socket'
require 'date'

class Config
  LASTCOMMITS_FILE = "~/.lastcommits.json"

  def initialize(path = nil, flush = false)
    @configFile = File.expand_path LASTCOMMITS_FILE
    @config = readLastCommits
    @flush = flush
    unless path.nil?
      project_name = projectFromPath(path)
      @config[project_name] = {}
      @config[project_name]["path"] = File.expand_path(path)
    end
  end

This file has been truncated. show original

On a long weekend I did it in haskell since I wanted to play around with parser:

This works better, but has not yet so much fields as the ruby script has.

In both cases I take a custom git-log command:

git log --pretty=format:'%cI - %an - %h - %s' --abbrev-commit --no-merges --shortstat origin/master

and parse it. What needs to be fixed in the ruby script is that I use a dash - as a separator, which is not very wise. That’s why some of the logs get not parsed correctly since someone is using - in their commit message.

I hope this helps. Let me know if you need help or you come up with a fix or a better solution.

- Konrad

gianluca-valentini · May 14, 2020, 9:31am

Thanks a lot !! I will try to understand the script as I don’t know ruby.
Thanks again

Gianluca

system · May 28, 2020, 9:40am

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.