Model Test Timeout
ProxAI tests models to determine availability before returning them in
px.models.list_models()
or similar API calls. If a model doesn’t respond
within the timeout, it’s marked as failed.
- By default,
model_test_timeout
is 25 seconds.
If you want to set a custom timeout, you can use the model_test_timeout
parameter:
px.connect(model_test_timeout=60)
This can be useful for models that take longer to initialize or slower network connections.