judgevet.testing._conformance_async

Reusable pytest conformance tests for an AsyncSystemOnePort provider.

BaseAsyncProviderConformance applies the nine rules of the synchronous kit to an asynchronous provider:

• test_port_shape: system_one is callable with the port's positional and keyword arguments.
• test_typed_answers_pass_policy: system_one returns an awaitable, and awaiting it gives a SystemOneResponse whose answers pass judgevet.policy.evaluate_policy.
• test_failure_raises_provider_error: awaiting the failing port raises a ProviderError subclass.
• test_scope_entry_yields_usable_port, test_scope_exit_runs_once and test_scope_propagates_body_exception: the factory keeps the async_provider_scope lifecycle rules.
• test_media_refused_without_media_support: a port from the factory without every media method callable exposes no partial media surface, and async_judge_with_images refuses it with ProviderCapabilityError.
• test_media_port_refuses_undeclared_media: async_judge_with_images refuses media outside the declared capabilities before any media dispatch.
• test_media_port_judges_declared_media: system_one_media returns an awaitable, and one declared kit image returns answers that pass evaluate_policy.

Source: https://github.com/Alberto-Codes/judgevet/issues/251. Source: https://github.com/Alberto-Codes/judgevet/issues/252.

Each rule is an ordinary synchronous test method that drives its coroutine with anyio.run. The kit adds no pytest plugin, because AnyIO's pytest plugin and pytest-asyncio interfere when both are installed. Source: https://anyio.readthedocs.io/en/stable/testing.html. Source: https://github.com/agronholm/anyio/issues/328. Source: https://github.com/Alberto-Codes/judgevet/issues/246.

The kit's fixtures are synchronous. pytest-asyncio's auto mode runs a synchronous test that requests an asynchronous fixture, and its strict mode refuses one. Source: https://github.com/pytest-dev/pytest-asyncio/issues/1570.

The kit imports anyio directly, so the conformance extra declares it beside pytest. Source: https://github.com/Alberto-Codes/judgevet/issues/253#issuecomment-5904100904.

Examples:

from contextlib import nullcontext

import pytest

from judgevet.providers import ProviderTransportError
from judgevet.testing import AsyncFakeSystemOnePort
from judgevet.testing.conformance import (
    VALID_ANSWERS,
    BaseAsyncProviderConformance,
)


class TestAsyncFakeProvider(BaseAsyncProviderConformance):
    @pytest.fixture
    def provider_factory(self):
        return lambda: nullcontext(AsyncFakeSystemOnePort(answers=VALID_ANSWERS))

    @pytest.fixture
    def failing_port(self):
        return AsyncFakeSystemOnePort(error=ProviderTransportError("offline"))

class TestMyAsyncProvider(BaseAsyncProviderConformance):
    pass