Error logs make it hard to tell whether 50x responses are being retried properly because the logs are cut off. Request IDs should be included for model requests so failures can be traced more easily when debugging issues that currently look like network blips.
Error logs make it hard to tell whether 50x responses are being retried properly because the logs are cut off. Request IDs should be included for model requests so failures can be traced more easily when debugging issues that currently look like network blips.