Ability to limit concurrent rest api calls

Even though we have rate limiting over a time window, costly restapis
run concurrently by users can still bring down the server. Add a way to
limit concurrent requests per user. Only applies to restapis.

Change-Id: I0a89cf31199ae9c610be8b32e47d7b122826b605