-
Notifications
You must be signed in to change notification settings - Fork 314
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Update create track #1846
Update create track #1846
Conversation
@gareth-ellis Thank you for updating the docs. LGTM.
|
The data-stream option is already in the docs - https://esrally.readthedocs.io/en/stable/command_line_reference.html#data-streams - or were you meaning something different? |
You are right, I somehow missed it. |
I'd like to add the option to setup writing back to the datastream too - that isn't currently in place, but I thought that could be in a seperate PR |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM
I seem to mess up my old branch - this is the same as PR #1836
Add option to increase batch size when creating a track to speed up download of data. Update track layout to adhere to best practices
Creating tracks from large corpus can take quite a bit of time, so I have added the option to increase the batch size of scan, so if a user is running with a stable enough network connection and enough hardware resources on the rally instance, they can increase the batch size to speed up download.
I have also updated the track layout to better match how we tend to layout our tracks
There was feedback to add more docs, so that's done too