Hi, users of my Laravel app send requests to my API server (Laravel app, too).
The API server needs around 20 seconds to handle a request (machine learning) and can handle 5 at a time.
I am getting more than 5 requests and would like to put the overhang on a "waiting list".
Once the API server responded to a request, I'd like to send in the next request from the waiting list.
I thought "Laravel Queues" may work. However, after reading the docs it seems like "Laravel Queues" may not be a good fit.
It seems like that's more for background tasks.
Is there something I am missing or do you have any recommendation how I could handle this?
Thank you ☺️