Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Enable multiple threads? #5

Open
waterml opened this issue Aug 15, 2021 · 2 comments
Open

Enable multiple threads? #5

waterml opened this issue Aug 15, 2021 · 2 comments

Comments

@waterml
Copy link

waterml commented Aug 15, 2021

Currently, yass runs with only single threads, and is slow for large fasta files.
Is it possible to speed up yass by running parallelly on more threads?
Thanks.

@laurentnoe
Copy link
Owner

laurentnoe commented Mar 6, 2022

There are several parameters to compile it with threads

./configure --help

  --with-threads          compile with all threads
  --with-thread-fr        compile with two separate threads for Forward and Reverse sequence
  --with-thread-aa        compile with two separate threads for Assemble and Align steps
  --with-thread-qc        compile with threads for the query chunks

however, for multiple queries (multifasta for the first file) there is also a way to increase (inside the util.h file) the number of threads to process queries independently
util.h:#define MAX_QUERY_CHUNK_THREADS 4

PS : if you use yass on the web server "https://bioinfo.univ-lille.fr" , THEN when large files are provided by the user, the single threaded version is used : the reason is here to reduce the "memory footprint" (only one index is created at a time) so the program is more likely to terminate without "being terminated" 🤖

@laurentnoe
Copy link
Owner

laurentnoe commented Mar 9, 2022

... is slow for large fasta files ...

😐

  • for full sensitivity with "rather small (weighted)" spaced seeds, yass will (always) be slow ...
  • to cope with that, we now propose Minimally overlapping words seeds, or "Mow" 🚜✂️🌱 seeds

@laurentnoe laurentnoe pinned this issue Oct 12, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants