Compiling graylog server for production

pbrocker · August 28, 2017, 8:35pm

How do I compile a graylog.jar file that is ready for production on my local machine?

I downloaded the latest source code (tag 2.3.1) graylog from https://github.com/Graylog2/graylog2-server.

I then ran mvn compile and then mvn package just fine.

I noticed that only target/jar files where created in most of the sub folders and not the master project.

Am I just using the wrong command to create a production ready jar?

jochen · August 29, 2017, 7:01am

You have to run mvn assembly:single to produce a tar-ball with the Graylog release.

Also take a look at the Travis CI configuration, which produces these artifacts:

github.com

Graylog2/graylog2-server/blob/2.3.1/.travis.yml

sudo: required
dist: trusty
language: java
jdk:
  - oraclejdk8
cache:
  directories:
    - $HOME/.m2
notifications:
  slack:
    on_success: change
    on_failure: always
    rooms:
      secure: |-
        g6Gpj2n1Bl6hIwWlywEkw8wRjpN2XuFsxFr9KQu/p7mRLYPdF3V5qQPVLBRd
        KvkjCIM7gZy2DTRNUooQPXdJB3npbnlbQn4jNWqA7/fp434Sw5sdfSUMawGr
        XvemLvn0KxQxCO9GfN3wfmYxEWJwXO36Q29BnRWWgMQOXpFFD8A=
after_success:
  - curl -X GET https://letsencrypt.org/certs/lets-encrypt-x3-cross-signed.der -o lets-encrypt-x3-cross-signed.der && sudo keytool -trustcacerts -keystore $JAVA_HOME/jre/lib/security/cacerts -storepass changeit -noprompt -importcert -alias lets-encrypt-x3-cross-signed -file lets-encrypt-x3-cross-signed.der
  - mvn -B -Dmaven.test.skip=true -Dskip.web.build=true -pl graylog2-server versioneye:securityAndLicenseCheck

This file has been truncated. show original

pbrocker · August 29, 2017, 1:15pm

@jochen…

Thank you so much for the help. I am able to curl and set up the certs. And also run the mvn assembly:single command.
But I am not able to run mvn -B -Dmaven.test.skip=true -Dskip.web.build=true -pl graylog2-server versioneye:securityAndLicenseCheck

It gives me missing API key errors. I assume I am going to have to obtain (or set these somewhere). I do have a versionEye account.

Would you be able to point me in the right direction?

jochen · August 29, 2017, 2:02pm

You don’t need to do that if you have an up-to-date certificate store.

You don’t need to run this. See https://www.versioneye.com/ for details about what VersionEye is.

pbrocker · August 29, 2017, 6:46pm

After installing my custom built version of graylog 2.3.1. I get a message saying graylog is out of date.

The most recent stable Graylog version is 2.3.1 (Tegernseer) released at 2017-08-25T00:00:00.000Z. Get it from https://www.graylog.org/.

Is there a way to turn this off?

pbrocker · August 29, 2017, 7:08pm

@jochen

I also have a enterprise license and have moved the enterprise plugins to the plugin directory

pbrocker · August 29, 2017, 7:36pm

My graylog version in the web-ui is showing 0-0-unknown even thought my package.json says 2.3.1

pbrocker · August 29, 2017, 8:20pm

Found this log error…

	at com.github.zafarkhaja.semver.VersionParser.ensureValidLookahead(VersionParser.java:530) ~[graylog.jar:?]
	at com.github.zafarkhaja.semver.VersionParser.parseBuild(VersionParser.java:358) ~[graylog.jar:?]
	at com.github.zafarkhaja.semver.VersionParser.parseBuild(VersionParser.java:237) ~[graylog.jar:?]
	at com.github.zafarkhaja.semver.Version.setBuildMetadata(Version.java:458) ~[graylog.jar:?]
	at org.graylog2.plugin.Version.buildSemVer(Version.java:149) ~[graylog.jar:?]
	at org.graylog2.plugin.Version.from(Version.java:140) ~[graylog.jar:?]
	at org.graylog2.plugin.Version.fromClasspathProperties(Version.java:239) [graylog.jar:?]
	at org.graylog2.plugin.Version.fromClasspathProperties(Version.java:199) [graylog.jar:?]
	at org.graylog2.plugin.Version.fromClasspathProperties(Version.java:173) [graylog.jar:?]
	at org.graylog2.plugin.Version.<clinit>(Version.java:66) [graylog.jar:?]
	at org.graylog2.bootstrap.CmdLineTool.<clinit>(CmdLineTool.java:90) [graylog.jar:?]
	at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) ~[?:1.8.0_111]
	at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) [?:1.8.0_111]
	at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) [?:1.8.0_111]
	at java.lang.reflect.Constructor.newInstance(Constructor.java:423) [?:1.8.0_111]
	at com.github.rvesse.airline.parser.ParserUtil.createInstance(ParserUtil.java:39) [graylog.jar:?]
	at com.github.rvesse.airline.DefaultCommandFactory.createInstance(DefaultCommandFactory.java:25) [graylog.jar:?]
	at com.github.rvesse.airline.parser.ParserUtil.createInstance(ParserUtil.java:94) [graylog.jar:?]
	at com.github.rvesse.airline.parser.ParseResult.getCommand(ParseResult.java:114) [graylog.jar:?]
	at com.github.rvesse.airline.parser.command.CliParser.parse(CliParser.java:54) [graylog.jar:?]
	at com.github.rvesse.airline.Cli.parse(Cli.java:107) [graylog.jar:?]
	at com.github.rvesse.airline.Cli.parse(Cli.java:93) [graylog.jar:?]
	at org.graylog2.bootstrap.Main.main(Main.java:43) [graylog.jar:?]```

jochen · August 30, 2017, 7:16am

You have to build the artifacts by running mvn install once in the root directory of the project.

pbrocker · August 30, 2017, 12:37pm

I ran mvn package before running mvn assembly:single

pbrocker · August 30, 2017, 12:57pm

@jochen Here are the steps I have followed.

Download 2.3.1 zip file from https://github.com/Graylog2/graylog2-server/releases
Unzip file
Run mvn install
Run mvn assembly:single
Copy graylog TAR from target/assembly to my server.
Extract contents and restart server.
Graylog UI boots just fine, but shows version 0.0.0-unknown

Looking at graylog server.log I see the following

2017-08-30T12:51:25.477Z ERROR [Version] Unable to read version.properties, this build has no version number.
com.github.zafarkhaja.semver.UnexpectedCharacterException: null
	at com.github.zafarkhaja.semver.VersionParser.ensureValidLookahead(VersionParser.java:530) ~[graylog.jar:?]
	at com.github.zafarkhaja.semver.VersionParser.parseBuild(VersionParser.java:358) ~[graylog.jar:?]
	at com.github.zafarkhaja.semver.VersionParser.parseBuild(VersionParser.java:237) ~[graylog.jar:?]
	at com.github.zafarkhaja.semver.Version.setBuildMetadata(Version.java:458) ~[graylog.jar:?]
	at org.graylog2.plugin.Version.buildSemVer(Version.java:149) ~[graylog.jar:?]
	at org.graylog2.plugin.Version.from(Version.java:140) ~[graylog.jar:?]
	at org.graylog2.plugin.Version.fromClasspathProperties(Version.java:239) [graylog.jar:?]
	at org.graylog2.plugin.Version.fromClasspathProperties(Version.java:199) [graylog.jar:?]
	at org.graylog2.plugin.Version.fromClasspathProperties(Version.java:173) [graylog.jar:?]
	at org.graylog2.plugin.Version.<clinit>(Version.java:66) [graylog.jar:?]
	at org.graylog2.bootstrap.CmdLineTool.<clinit>(CmdLineTool.java:90) [graylog.jar:?]
	at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) ~[?:1.8.0_111]
	at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) [?:1.8.0_111]
	at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) [?:1.8.0_111]
	at java.lang.reflect.Constructor.newInstance(Constructor.java:423) [?:1.8.0_111]
	at com.github.rvesse.airline.parser.ParserUtil.createInstance(ParserUtil.java:39) [graylog.jar:?]
	at com.github.rvesse.airline.DefaultCommandFactory.createInstance(DefaultCommandFactory.java:25) [graylog.jar:?]
	at com.github.rvesse.airline.parser.ParserUtil.createInstance(ParserUtil.java:94) [graylog.jar:?]
	at com.github.rvesse.airline.parser.ParseResult.getCommand(ParseResult.java:114) [graylog.jar:?]
	at com.github.rvesse.airline.parser.command.CliParser.parse(CliParser.java:54) [graylog.jar:?]
	at com.github.rvesse.airline.Cli.parse(Cli.java:107) [graylog.jar:?]
	at com.github.rvesse.airline.Cli.parse(Cli.java:93) [graylog.jar:?]
	at org.graylog2.bootstrap.Main.main(Main.java:43) [graylog.jar:?]
2017-08-30T12:51:25.774Z ERROR [CmdLineTool] Plugin "OpsGenie Alarm Callback" requires version 2.0.0 - not loading!
2017-08-30T12:51:25.775Z ERROR [CmdLineTool] Plugin "Aggregates" requires version 2.3.0 - not loading!
2017-08-30T12:51:25.776Z ERROR [CmdLineTool] Plugin "ArchivePlugin" requires version 2.3.1 - not loading!
2017-08-30T12:51:25.777Z ERROR [CmdLineTool] Plugin "Audit Log" requires version 2.3.1 - not loading!
2017-08-30T12:51:25.778Z ERROR [CmdLineTool] Plugin "Elastic Beats Input" requires version 2.3.1 - not loading!
2017-08-30T12:51:25.780Z ERROR [CmdLineTool] Plugin "Collector" requires version 2.3.1 - not loading!
2017-08-30T12:51:25.781Z ERROR [CmdLineTool] Plugin "Enterprise Integration Plugin" requires version 2.3.1 - not loading!
2017-08-30T12:51:25.782Z ERROR [CmdLineTool] Plugin "License Plugin" requires version 2.3.1 - not loading!
2017-08-30T12:51:25.784Z ERROR [CmdLineTool] Plugin "MapWidgetPlugin" requires version 2.3.1 - not loading!
2017-08-30T12:51:25.785Z ERROR [CmdLineTool] Plugin "Internal Metrics Datadog Reporter" requires version 2.0.0 - not loading!
2017-08-30T12:51:25.800Z ERROR [CmdLineTool] Plugin "Pipeline Processor Plugin" requires version 2.3.0 - not loading!
2017-08-30T12:51:25.801Z ERROR [CmdLineTool] Plugin "QuickValuesPlusWidget" requires version 2.3.0 - not loading!
2017-08-30T12:51:25.803Z ERROR [CmdLineTool] Plugin "Anonymous Usage Statistics" requires version 2.3.1 - not loading!

jochen · August 30, 2017, 1:02pm

What operating system are you using to build Graylog?
What’s the complete output of mvn install and mvn assembly:single?

pbrocker · August 30, 2017, 1:45pm

Using mac Sierra version 10.12.6

mvn install -> https://pastebin.com/kRFFutCP
mvn assmebly:single -> https://pastebin.com/7hNWwmS0

jochen · August 30, 2017, 2:01pm

Which version of Maven are you using?

Also make sure that the version.properties file is generated and has sane contents.

pbrocker · August 30, 2017, 2:02pm

Apache Maven 3.5.0 (ff8f5e7444045639af65f6095c62210b5713f426; 2017-04-03T15:39:06-04:00)
Maven home: /usr/local/Cellar/maven/3.5.0/libexec
Java version: 1.8.0_131, vendor: Oracle Corporation
Java home: /Library/Java/JavaVirtualMachines/jdk1.8.0_131.jdk/Contents/Home/jre
Default locale: en_US, platform encoding: UTF-8
OS name: “mac os x”, version: “10.12.6”, arch: “x86_64”, family: “mac”

pbrocker · August 30, 2017, 2:10pm

Also what do you mean by the version.properties file!?

pbrocker · August 30, 2017, 2:11pm

I can not find a version.properties file in the graylog zip that I downloaded!?

pbrocker · August 30, 2017, 2:14pm

All the version.properties files have project.version=${project.version}

one example being graylog2-server/src/resources/version.properties

jochen · August 30, 2017, 2:24pm

You have to check the filtered file inside the target/ directories.

Example:

$ cat ./graylog2-server/target/classes/version.properties
project.version=2.4.0-SNAPSHOT

pbrocker · August 30, 2017, 2:37pm

cat ./graylog2-server/target/classes/version.properties
project.version=2.3.1

above is what I get

Topic		Replies	Views
Compiling Graylog-server code for plugin development Development	7	583	December 31, 2022
Need Help On Complete Run process of Graylog2-server after completion of build process Development documentation	5	262	April 22, 2024
Request help for the contribution documentation Development	12	6389	May 3, 2017
Compiling Graylog from source and then create deb package? Development	12	1814	January 1, 2019
Graylog compilation Graylog Central (peer support) components	3	297	January 17, 2024

Compiling graylog server for production

Related topics