Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Implementation of ObjectSeeker Certifiably Robust Defense #2193

Closed
f4str opened this issue Jun 15, 2023 · 0 comments · Fixed by #2246
Closed

Implementation of ObjectSeeker Certifiably Robust Defense #2193

f4str opened this issue Jun 15, 2023 · 0 comments · Fixed by #2246
Assignees
Labels
enhancement New feature or request
Milestone

Comments

@f4str
Copy link
Collaborator

f4str commented Jun 15, 2023

Is your feature request related to a problem? Please describe.
ObjectSeeker is a certifiably robust defense against patch attacks on object detection models. The defense itself was originally intended for evasion patches, but may be generalizable for poisoning since it is patch agnostic. Therefore, this defense may be a good baseline against the BadDet poisoning attack on object detection models.

Paper link: https://arxiv.org/abs/2202.01811

Describe the solution you'd like
Since this is a certifiably robust defense, this should be implemented under art.estimators.certification. Just like the randomized_smoothing submodule, an object_seeker submodule will be created which will have the PyTorch implementation for now (TensorFlow may be added later).

The ObjectSeekerPyTorch class will take in an object detection model (Faster R-CNN or YOLO) and implement the corresponding fit, predict, and certify methods that all ART certification estimators typically do.

Describe alternatives you've considered
This may also be implemented somewhere under art.defenses since this is a defense, but it makes more sense under art.estimators.certification since it is a certifiably robust defense.

Additional context
A PyTorch implementation will only be done for now since object detection models (Faster R-CNN and YOLO) are typically only used in PyTorch. A TensorFlow implementation may be done in the future, but this is low priority.

@beat-buesser beat-buesser added the enhancement New feature or request label Jul 4, 2023
@beat-buesser beat-buesser added this to the ART 1.16.0 milestone Jul 4, 2023
@beat-buesser beat-buesser linked a pull request Aug 16, 2023 that will close this issue
14 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants