Hi everyone When I run an export of a csv format dataset in production with the Graylog 2.4.6 API (docker cluster) I have a bitrate of 5KO / sec, the total volume of this dataset is about 5GB, on another machine with graylog 2.0.1 (standalone install) with the same query and the same data size I ha…

Hey @keaoner , might this be your problem: [image] CSV export is slow after upgrading to 2.4.3 Graylog Central (peer support) Since the community was so responsive, I will answer my own question. The problem was that I had the -Djavax.net.debug=all enabled in /etc/default…

thank you for the answer I saw this post on the forum but I’m on a graylog installation under docker /etc/default/graylog-server does not exist, the ps aux command tells me the following launching parameters: /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/java -Xms4g -Xmx8000m -XX:NewRatio=1 -server -…

[image] keaoner: is the Djavax.net.debug = all parameter loaded by default in version 2.4.6 of graylog? how can i disable it in docker? AFAIK this is not loaded by default. And since it is not included in your ps aux, it is also not enabled in your environment. Could you make another export t…

Hi Philipp, Here is the log in debug mode, thanks your for your help https://drive.google.com/file/d/1_3OIPDOGOtlW9-1kLayJXNaxmhauFkCR/view?usp=sharing

Heyo :slight_smile: Non related issues, that you should fix anyway: 2018-09-20 06:36:00,724 WARN : org.graylog2.inputs.codecs.GelfCodec - GELF message <705fd23f-bc9f-11e8-b49a-d6e55e6cc41f> is missing mandatory "host" field. Over 106 thousand occurences… :smiley: 2018-09-20 09:37:28,840 ERROR: o…

Heyo @keaoner , I just stumbled across this: [image] CSV export using API Graylog Central (peer support) Yes, absolutely! You can request the search results of a query in CSV format by using the regular search resources (e. g. /search/universal/absolute) and setting the H…

Hi Philipp, I will redo a csv download test and provide you with the logs from the beginning I get to download the csv my problem is the download speed thank you very much, the performance is good during a query in the web interface, however when downloading the result in CSV is very slow 5ko/s B…

Hi Philipp, Here is my new debug log I started the csv file download on 2018-09-26 at 15H06 thanks again for your help https://drive.google.com/file/d/10bVKzr1tf64bGxfi2QfuP0xqgL4MNkJi/view?usp=sharing

Heyo :slight_smile: What’s your timezone? The logs end at 14:03 :smiley: (They’re in UTC, so… :smiley:) Greetings, Philipp

Hi Philipp My timezone is UTC+2 Thanks u

The export of dataset in a CSV file with graylog API is very slow in version 2.4.6 (docker cluster)

Graylog Central (peer support)

derPhlipsi (Philipp Ruland) September 18, 2018, 12:41pm 2

Hey @keaoner,

might this be your problem:

Greetings,
Philipp

Topic		Replies	Views
CSV export is slow after upgrading to 2.4.3 Graylog Central (peer support)	1	1114	September 13, 2018
Export graylog logs into CSV format Graylog Central (peer support)	6	3905	March 10, 2022
Export to CSV failed Graylog Central (peer support)	11	1874	January 13, 2022
Graylog 2.3.1 - Export to CSV via API Call Graylog Central (peer support)	5	6888	February 11, 2018
Export CSV different times from 10 minutes to over an hour Graylog Central (peer support)	0	752	October 20, 2020

The export of dataset in a CSV file with graylog API is very slow in version 2.4.6 (docker cluster)

Related topics