5 ms·
24 servers? Can you elaborate on your architecture a little more? What tools do you use to help you manage them?
by inchforward 12y ago
24 servers? Can you elaborate on your architecture a little more? What tools do you use to help you manage them?
- ashark 12y agoOne server to serve an RSS reader to the 5k users, 23 others to host 23 different stats and monitoring applications to make sure that one server is working OK?
- ShinyCyril 12y agoI can't speak for him, but the RSS reader I am working on at the moment is similarly split into multiple parts: * Crawler - retrieves RSS feeds and parses articles * Database server * Analyser - performs semantic analysis and various other statistical processing on posts * Propagator - pushes new posts to everyone's feed * Cacher - serves a cached copy of the user's feed * Web server Based on loads I would just add more nodes depending on what was needed.
- jsherer 12y agoPretty close :)
- thebiglebrewski 12y agoOne server (machine), 23 servers (waiters) to cater to that one servers' (machine) every needs?
- jsherer 12y agoCloser to 50/50. 50% of the servers do actual tedious work. 50% cater to users' needs.
- jsherer 12y agoMost of the servers are workers which fetch feeds. Parallel downloads across a number of low-level commodity servers. Additionally, there's a master and slave Postgres database, a small Cassandra cluster, 2 redis boxes, an elasticsearch cluster, front-end servers, caching servers, etc. Shoot me an email if you want to talk in more detail.
- NYCounihan 12y agoand one server to rule them all...