could somebody give me a hint, how to make use of the “scroll” feature in REST API calls? I need to fetch a result greater than 10.000 messages without messing around with index.max_result_window (won’t help that much, because the result will contain >500K messages). I’m using python and the endpoints /api/search/universal/relative and /api/search/relative/absolute for the query.
thanks for your help. That solution sounds pretty good, but I’m wondering how the WUI gets this information
Found 246,742 messages in 48 ms, searched in 10
indices<https://<hostname>/search?rangetype=relative&fields=message%2Csource&width=1922&highlightMessage=&relative=86400
&q=source%3Afoo%20AND%20message%3A%22bar%22>
Because I need the total amount messages to iterate through all the pages using limit and offset.