5 ms·

Hi, one of the developers here, there was no specific reason why we went mongo at the start, but there have been talks to move to a different database if needed

Hi, one of the developers here, there was no specific reason why we went mongo at the start, but there have been talks to move to a different database if needed. Currently mongodb is fine for us.

hardwaresofton 5y ago
Just want to suggest that if you're interested in doing this in the future, some investment in defining interfaces up front is worth doing. I took a quick look at the codebase and it looks like mongo is "in there pretty good"[0] without any abstraction to make it easily shimmable. Just a little specification around the that interface (Trait) will go a long way to making other backends possible and should make it much easier to know and manage the API contract a capable database must provide. [0]: https://github.com/revoltchat/delta/blob/master/src/database/mod.rs https://github.com/revoltchat/delta/blob/master/src/database...
vorpalhex 5y ago
> Currently mongodb is fine for us. As someone who has administered too many MongoDBs, those are some famous last words.
- mrits 5y ago
  Cassandra or HBase are not exactly a utopia either though
  - baq 5y ago
    discord has a good writeup of their migration from mongo to cassandra. https://blog.discord.com/how-discord-stores-billions-of-messages-7fa6ec7ee4c7 https://blog.discord.com/how-discord-stores-billions-of-mess...
  - zorkian 5y ago
    Can confirm. We (Discord) moved off of MongoDB for various reasons and are quite happy about that decision but managing Cassandra/Scylla clusters is not exactly a walk in the park either.
    - rusht 5y ago
      If you had to do it all over again, would you still start with MongoDB or would you go with Cassandra right off the bat?
      - zorkian 5y ago
        I didn't make the original decision but if I were starting something and I had no idea whether or not it'd be successful, I'd do whatever was the absolute fastest way to get to MVP. That'd probably be a cloud database, honestly -- but a modern MongoDB would be technically fine too (licensing stuff notwithstanding.) Most startups fail not because they picked a suboptimal database for their usage but because they didn't build something that was good or it didn't achieve product market fit. I wouldn't worry about your database over-much in the beginning (unless it's critical to what you're doing and in that case, worry like hell, but you will probably know if that's the case.) Many of Discord's issues with Mongo were exacerbated that we were using TokuMX which was abandoned shortly after we started using it. A few years into Discord we found ourselves with a rapidly scaling dataset and userbase that was built on top of an abandoned and not super popular third party version of MongoDB. (Funny story: at one point towards the end we realized that all of the packages had been pulled from every mirror we could find and literally the only place we could find the package files was off of some gov.uk mirror... that was a bad day. Thankfully we had the hashes and were able to validate the packages...) FWIW, we did honestly debate moving our core user model (which was what was left in TokuMX by the end there) into a modern version of MongoDB -- some of the things we did (reverse indexes, secondary indexes, locking, etc) are much more complicated in a database like Scylla. It was tempting to just migrate the data from one "Mongo" to another and call it a day. We didn't for a variety reasons, not least of which is keeping things simple by reducing the number of technologies you have in production (like when we chose to embrace Rust we went back and migrated nearly all of our Go systems). Anyway, I'm pretty happy with not running MongoDB anymore, but not because MongoDB is inherently bad. It's popular for a reason!
        rusht 5y ago
        Really appreciate this great, detailed answer! 100% agree with getting to an MVP with PMF as quickly as possible should be the top priority for a startup.
- neeleshs 5y ago
  If one can afford it, mongodb Atlas is really just fine. As someone said, at scale, all technologies need significant know-how and time investment.
  - junon 5y ago
    It is not "just fine". They do not have encryption on the wire by default and require an enterprise plan, which is percentage of income based, to enable it.
    - neeleshs 5y ago
      As I said, if one can afford it. Also not sure what you mean by wire encryption is on for enterprise plan and income based. Their plans are size based.
      - junon 5y ago
        I worked with them and had meetings with them in person. SSO and TLS were Enterprise-only features, and enterprise pricing was percentage based. It was insanely expensive.
        neeleshs 5y ago
        Interesting. Probably it's different now. We use both SSO and TLS and TLS is on by default now. May be they changed their plans since you spoke with them. https://docs.atlas.mongodb.com/reference/faq/security/ https://docs.atlas.mongodb.com/reference/faq/security/
        junon 5y ago
        Thanks, seems like they indeed changed it (good on them! this always bugged me.) > Atlas requires TLS connections for all Atlas clusters. After July 2020, Atlas will enable Transport Layer Security (TLS) protocol version 1.2 by default for all new Atlas clusters regardless of the MongoDB version. The last time I interacted with them was in 2019.
Conan_Kudo 5y ago
I would strongly urge you to consider migrating to an alternative database, given MongoDB's SSPL license that is difficult to comply with.
- Zomatree 5y ago
  What are the best nosql databases? half of our devs dont like sql much (ive tried to make them use orms too, didnt work)
  - rusht 5y ago
    “Best” depends on your use case. I don’t even think a SQL database is an option for a chat app since it’s write heavy. FB Messenger uses HBase and Discord uses Cassandra and they’ve done their research at scale, so those could be possible options.
    - mekster 5y ago
      Which self hosting instance would go at the size of Facebook or Discord? Just because Discord took a method doesn't mean a competing product should too.
      - rusht 5y ago
        I am assuming they want to provide a hosted service just like Discord at some point.
  - Felk 5y ago
    > half of our devs dont like sql much I'd suggest you and your team shouldn't rule out SQL-like databases, given a lot of very competent NoSQL databases have SQL-like syntaxes (say Cassandra or ScyllaDB, what Discord went with). And regarding hiding it behind an ORM, if you want or need cream of the crop performance not only do you need to have chosen a database that fits your needs, but you will also need to occasionally work very close to the database to avoid abstraction inversion situations.
  - 5y ago

Hi, one of the developers here, there was no specific reason why we went mongo at the start, but there have been talks to move to a different database if needed. Currently mongodb is fine for us.

hardwaresofton 5y ago

Just want to suggest that if you're interested in doing this in the future, some investment in defining interfaces up front is worth doing. I took a quick look at the codebase and it looks like mongo is "in there pretty good"[0] without any abstraction to make it easily shimmable. Just a little specification around the that interface (Trait) will go a long way to making other backends possible and should make it much easier to know and manage the API contract a capable database must provide. [0]: https://github.com/revoltchat/delta/blob/master/src/database/mod.rs https://github.com/revoltchat/delta/blob/master/src/database...

vorpalhex 5y ago

> Currently mongodb is fine for us. As someone who has administered too many MongoDBs, those are some famous last words.

mrits 5y ago
Cassandra or HBase are not exactly a utopia either though
- baq 5y ago
  discord has a good writeup of their migration from mongo to cassandra. https://blog.discord.com/how-discord-stores-billions-of-messages-7fa6ec7ee4c7 https://blog.discord.com/how-discord-stores-billions-of-mess...
- zorkian 5y ago
  Can confirm. We (Discord) moved off of MongoDB for various reasons and are quite happy about that decision but managing Cassandra/Scylla clusters is not exactly a walk in the park either.
  - rusht 5y ago
    If you had to do it all over again, would you still start with MongoDB or would you go with Cassandra right off the bat?
    - zorkian 5y ago
      I didn't make the original decision but if I were starting something and I had no idea whether or not it'd be successful, I'd do whatever was the absolute fastest way to get to MVP. That'd probably be a cloud database, honestly -- but a modern MongoDB would be technically fine too (licensing stuff notwithstanding.) Most startups fail not because they picked a suboptimal database for their usage but because they didn't build something that was good or it didn't achieve product market fit. I wouldn't worry about your database over-much in the beginning (unless it's critical to what you're doing and in that case, worry like hell, but you will probably know if that's the case.) Many of Discord's issues with Mongo were exacerbated that we were using TokuMX which was abandoned shortly after we started using it. A few years into Discord we found ourselves with a rapidly scaling dataset and userbase that was built on top of an abandoned and not super popular third party version of MongoDB. (Funny story: at one point towards the end we realized that all of the packages had been pulled from every mirror we could find and literally the only place we could find the package files was off of some gov.uk mirror... that was a bad day. Thankfully we had the hashes and were able to validate the packages...) FWIW, we did honestly debate moving our core user model (which was what was left in TokuMX by the end there) into a modern version of MongoDB -- some of the things we did (reverse indexes, secondary indexes, locking, etc) are much more complicated in a database like Scylla. It was tempting to just migrate the data from one "Mongo" to another and call it a day. We didn't for a variety reasons, not least of which is keeping things simple by reducing the number of technologies you have in production (like when we chose to embrace Rust we went back and migrated nearly all of our Go systems). Anyway, I'm pretty happy with not running MongoDB anymore, but not because MongoDB is inherently bad. It's popular for a reason!
      - rusht 5y ago
        Really appreciate this great, detailed answer! 100% agree with getting to an MVP with PMF as quickly as possible should be the top priority for a startup.
neeleshs 5y ago
If one can afford it, mongodb Atlas is really just fine. As someone said, at scale, all technologies need significant know-how and time investment.
- junon 5y ago
  It is not "just fine". They do not have encryption on the wire by default and require an enterprise plan, which is percentage of income based, to enable it.
  - neeleshs 5y ago
    As I said, if one can afford it. Also not sure what you mean by wire encryption is on for enterprise plan and income based. Their plans are size based.
    - junon 5y ago
      I worked with them and had meetings with them in person. SSO and TLS were Enterprise-only features, and enterprise pricing was percentage based. It was insanely expensive.
      - neeleshs 5y ago
        Interesting. Probably it's different now. We use both SSO and TLS and TLS is on by default now. May be they changed their plans since you spoke with them. https://docs.atlas.mongodb.com/reference/faq/security/ https://docs.atlas.mongodb.com/reference/faq/security/
        junon 5y ago
        Thanks, seems like they indeed changed it (good on them! this always bugged me.) > Atlas requires TLS connections for all Atlas clusters. After July 2020, Atlas will enable Transport Layer Security (TLS) protocol version 1.2 by default for all new Atlas clusters regardless of the MongoDB version. The last time I interacted with them was in 2019.

Conan_Kudo 5y ago

I would strongly urge you to consider migrating to an alternative database, given MongoDB's SSPL license that is difficult to comply with.

Zomatree 5y ago
What are the best nosql databases? half of our devs dont like sql much (ive tried to make them use orms too, didnt work)
- rusht 5y ago
  “Best” depends on your use case. I don’t even think a SQL database is an option for a chat app since it’s write heavy. FB Messenger uses HBase and Discord uses Cassandra and they’ve done their research at scale, so those could be possible options.
  - mekster 5y ago
    Which self hosting instance would go at the size of Facebook or Discord? Just because Discord took a method doesn't mean a competing product should too.
    - rusht 5y ago
      I am assuming they want to provide a hosted service just like Discord at some point.
- Felk 5y ago
  > half of our devs dont like sql much I'd suggest you and your team shouldn't rule out SQL-like databases, given a lot of very competent NoSQL databases have SQL-like syntaxes (say Cassandra or ScyllaDB, what Discord went with). And regarding hiding it behind an ORM, if you want or need cream of the crop performance not only do you need to have chosen a database that fits your needs, but you will also need to occasionally work very close to the database to avoid abstraction inversion situations.
- 5y ago