ProxAIAdvanced FeaturesModel Test Timeout

Model Test Timeout

ProxAI tests models to determine availability before returning them in px.models.list_models() or similar API calls. If a model doesn’t respond within the timeout, it’s marked as failed.

  • By default, model_test_timeout is 25 seconds.

If you want to set a custom timeout, you can use the model_test_timeout parameter:

px.connect(model_test_timeout=60)

This can be useful for models that take longer to initialize or slower network connections.