You can use rpc + message queues for that. client request1 --> web server --> rpc server --> work queue <process other requests> client request1 <-- web serv

You can use rpc + message queues for that. client request1 --> web server --> rpc server --> work queue <process other requests> client request1 <-- web server <-- rpc server <-- done queue Of course you need to create consumers to operate on the work queue, process the jobs and put them in a different queue (eg. 'done queue') signaling the rpc server that you finished the job so that the rpc server in turn will reply back to the web server.