Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Example biomedical knowledge graph for training and benchmarking #32

Closed
6 tasks
dmccloskey opened this issue Dec 5, 2024 · 1 comment · Fixed by #49
Closed
6 tasks

Example biomedical knowledge graph for training and benchmarking #32

dmccloskey opened this issue Dec 5, 2024 · 1 comment · Fixed by #49
Assignees
Labels
enhancement New feature or request

Comments

@dmccloskey
Copy link
Member

Description

As a researcher, I would like an open-source biomedical knowledge graph that can be used for testing and benchmarking. A popular open-source knowledge graph that has been used in various benchmarking tasks is PrimeKG https://github.com/mims-harvard/PrimeKG which has been used in STARK https://github.com/snap-stanford/stark and BioBridge https://github.com/RyanWangZf/BioBridge. In particular, we are most interested in the question and answering tasks (node classification) from STARK and potentially the cross-modality prediction from BioBridge

Checklist

  • Scripts for downloading PrimeKG
  • Scripts for setting up and running the STARK benchmark
  • (Optional) Scripts for setting up and running the BioBridge benchmark

Acceptance criteria

  • Docs, Lints, and Unit tests as appropriate to support the scripts for downloading the data assets and running the benchmarks
  • Jupyter notebook demonstrating how to download the datasets and run the benchmarks
  • Successful PR

Resources

Please see "Downloading datasets and models (Stark example)" from https://virtualpatientengine.github.io/VPEHackathonAIAgentsCO/setup/

Copy link
Contributor

github-actions bot commented Jan 9, 2025

🎉 This issue has been resolved in version 1.5.0 🎉

The release is available on GitHub release

Your semantic-release bot 📦🚀

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants