Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ASTM F3548 Clear Area failures block tests from passing even if the failing USS is not a tested participant #903

Open
wing-utm-sharing-airspace opened this issue Jan 23, 2025 · 0 comments
Labels
automated-testing Related to automated testing tools test-scenario-behavior

Comments

@wing-utm-sharing-airspace

Observed behavior
Failures in the Clear Area check at the beginning of an F3548 Automated Test cause tests to fail early even if the USS causing the failure is not a tested participant in the test configuration.

Example: Droneup causes the below test report to fail early because their Clear Area endpoint responds with an error. The only tested participants in the relevant test configuration are Avision, Wing, and Zipline. This failure blocks the tested USSs from achieving a passing result which can block their releases.

272a4dfe-a322-4f74-88a6-1b95f7f8f9bd.zip

Test check
ASTM F3548 flight planners preparation - Clear Area - step 34 in the above report

Proposed Improvement
Is it possible to make the Clear Area requests for non-tested USSs best effort and letting the test continue if the DSS is clear of operational intents at the start of the test?

This would unblock tested participants in scenarios where USSs who may not have passed all gates have an issue with their Clear Area endpoint but there are no left over operational intents that could cause issues with subsequent test scenarios.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
automated-testing Related to automated testing tools test-scenario-behavior
Projects
None yet
Development

No branches or pull requests

1 participant