My problem is general as I am just trying to find a right solution before starting the code. I will have 100 users registered in my web service and there is some API which provides updated data for each user account every 24 hours. What I need to do is, when the API provides new data I need to sync each user's data with the new data. Actually, there are 6 requests required to fetch all the data of a single user. So basically, 100*6 = 600 requests need to be made.
Can anybody suggest some efficient approach, to deal with this?
The simple approach is to run cron every minute and sent the requests but its 600 minutes of delay for users. The sync has to be quick as possible. So I am looking for some non-sequential approach here. Also, each request sometime takes 15-20 seconds to return a response.
Thanks.