Elektrine lite

← Feed

@fallenhitokiri@social.screamingatmyscreen.com

2023-09-21 06:29 UTC

One day I’ll write a book „how to build scalable system for the 95%“. You’ll be able to summarize it with - pick any mainstream language - deploy on one server - deploy Postgres on another server - double the number of server for redundancy So many systems I’ve seen lately could run off in memory SQLite and a replication to a CSV file. Yet there’s a relational database, a document database, a key value store and four services deployed on k8s for all 100MB data and 2000 customers.

Replies (16)

  • @fallenhitokiri@social.screamingatmyscreen.com 1. Databases are for wimps. GraphQL FTW 2. The size of the code is 20 times larger than the size of data 3. And service discovery.

    Open ##2445443

  • @DerMolly@toot.kif.rocks 2023-09-21 06:55

    @fallenhitokiri@social.screamingatmyscreen.com While I agree, such system can be easily built if management tells you we‘ll have lot‘s of users and we need to be able to massivly scale at some point. Doesn‘t excuse the bad way it‘s build to work with few users though.

    Open ##2445444

  • @robinsyl@meow.social 2023-09-21 07:11

    @fallenhitokiri@social.screamingatmyscreen.com subtitle: admit it, you are not Google

    Open ##2445451

  • @robertpi@functional.cafe 2023-09-21 07:19

    @fallenhitokiri@social.screamingatmyscreen.com Related: most perf issues I've investigated do not require architectural changes to fix. They're simply bugs where code is executed far more times than it should be.

    Open ##2445455

  • @ratkins@mastodon.social 2023-09-21 07:27

    @fallenhitokiri@social.screamingatmyscreen.com Oh god yes. “I have just saved you three years getting your service to market, my consulting fee is a very modest $10,000. Please and thank you.”

    Open ##2445459

  • @az@scorpinc.social 2023-09-21 07:41

    @fallenhitokiri@social.screamingatmyscreen.com i'm reminded of the wonderful quote; "You can have a second computer once you’ve shown you know how to use the first one." by Paul Barham

    Open ##2445466

  • @joshoconnorchen@mastodon.nz 2023-09-21 07:44

    @fallenhitokiri@social.screamingatmyscreen.com Two servers seems like a lot of overengineering. One server, with good backups/restores, and a chapter on realistic recovery time objectives would suffice quite nicely.

    Open ##2445467

  • @oschonrock@mastodon.social 2023-09-21 08:05

    @fallenhitokiri@social.screamingatmyscreen.com 💯 For once I am happy to admit that our "legacy architecture" is exactly this... (except MariaDB instead of Postgres)

    Open ##2445468

  • @schaueho@functional.cafe 2023-09-21 08:40

    @fallenhitokiri@social.screamingatmyscreen.com This is what you get from CVDD, cv-driven development.

    Open ##2445469

  • @tyarosh@mastodon.social 2023-09-21 10:11

    @fallenhitokiri@social.screamingatmyscreen.com + keep team small. This is absurd when an uncontrolled crowd of multiple architects, dozens of software engineers, few project and delivery managers, designers, and a bunch of business analytics build microservices for an app that can be replicated as an iOS Shortcut

    Open ##2445470

  • @tomw@mastodon.social 2023-09-21 10:54

    @fallenhitokiri@social.screamingatmyscreen.com Yes but MySQL, MariaDB, SQLite also all fine. And don't particularly need to be on a separate server at the smallest scale.

    Open ##2445471

  • @fallenhitokiri@social.screamingatmyscreen.com You'd like this from David Crawshaw https://crawshaw.io/blog/one-process-programming-notes There's also a talk linked from that post.

    Open ##2445475

  • @fallenhitokiri@social.screamingatmyscreen.com I really want a fresh front-end book for the 95%. Or is that "Bootstrap 5"?

    Open ##2445478

  • @fallenhitokiri@social.screamingatmyscreen.com back when nosql was a new thing what I kept saying was "if SQL is fast enough for Walmart it's probably fast enough for you".

    Open ##2445489

  • @groxx@hachyderm.io 2023-09-21 16:25

    @fallenhitokiri@social.screamingatmyscreen.com include a "what to do if X is no longer enough" per section (e.g. how do I live-migrate from SQLite to postgres) and tbh I think it might work. Fear of being stuck with no clear way out is a pretty big part of it.

    Open ##2445490

  • @chrisg@fosstodon.org 2023-09-21 16:34

    @fallenhitokiri@social.screamingatmyscreen.com Hey, I wrote a whole thing about exactly this idea. It makes me so happy to see others say this too. https://radiki.dev/posts/a-small-dbms/

    Open ##2445491