Oh, that's really cool. I hope there's more linkage between the twitter-like and reddit-like islands of the fediverse in the future; I'm somewhat interested in reading the former but it seems to be complicated to actually get federation with it.
Didn't someone actually try making SQL as a filesystem and it ended up being something like 50 times slower than ZFS after they applied a ton of optimizations?
Not as a serious project, but more like a joke to see what would actually happen.
Just fucking putting data into json files in a folder is so much easier than databases. Sure, databases are faster and give you access to powerful SQL queries. But if you're just making something small and simple, you don't need those things. Save yourself the hassle and just use the filesystem.
Or use minio/s3, which can either be the best or the worst of both worlds depending on your usecase.
It also makes you re-implement a database, but worse.
Use a JSON file if you just need to serialize/deserialize some data. Use SQLite or a DB server if you need more. Your own code will never match the quality of SQLite.
Made a bash script using sqlite recently to automate processing some data. Best part is it terrifies everyone else at work and no one else wants to touch it because it's on Linux and none of them have used it before.
Welcome to the lovely world of the Fediverse! Mastodon and Lemmy, among many other kinds of software, both run on ActivityPub. This means that even if the servers aren't both running Lemmy or Mastodon, they still speak the same language and can therefore understand the content of each other's posts (think of it as email, gmail.com can still send and receive mail to outlook.com). Other examples of AcitvityPub software are Misskey, Mbin, Friendica, Pixelfed, Loops, Piefed, PeerTube and many others that I haven't learned about yet. While they theoretically can all fetch and present posts from each other, due to the choices that each developer makes while designing their software, it might not be very possible to get every post from every software. For example, Mastodon is all about following people, and Lemmy about following communities. Even though Mastodon is able to follow Lemmy communities, Lemmy has (as of writing) no function to follow people (yet).
"I have a system". Items are sorted randomly on to the top of "piles". I can retrieve any item from any pile, but pulling from anywhere except from the top of the pile destroys it.
72 Comments
slazer2au@lemmy.world · 69 pts · 1y
If file systems are databases, then does that mean storing a sqlite db on a HDD is database inception?
drq@mastodon.ml · 20 pts · 1y
@slazer2au Yes!
drq@mastodon.ml · 50 pts · 1y
@linuxmemes Wow, that worked!
mogoh@lemmy.ml · 19 pts · 1y
How do you post from mastodon to lemmy?
drq@mastodon.ml · 47 pts · 1y
@mogoh I just mentioned the group and it worked!
The way it's supposed to be!
I'm so happy for this omfgrotflolcopter
@linuxmemes
lukewarm_ozone@lemmy.today · 12 pts · 1y
Oh, that's really cool. I hope there's more linkage between the twitter-like and reddit-like islands of the fediverse in the future; I'm somewhat interested in reading the former but it seems to be complicated to actually get federation with it.
mogoh@lemmy.ml · 7 pts · 1y
wow, that's simple! Thx!
vint@mastodon.ml · 6 pts · 1y
@drq @mogoh
Do you mean just mentioning the group anywhere in the post finally works? Before, I had to mention it on first line. That's some progress.
danc4498@lemmy.world · 1 pts · 1y
I could not figure out what a rotflol coptor was…
drq@mastodon.ml · 3 pts · 1y
@danc4498
OMFG: Oh My Fucking God
ROTFLOL: Rolling On The Floor Laughing Out Loud
ROFLCOPTER:
...
Zoomers... *cracks open a can of zero sugar monster energy*
drq@mastodon.ml · 3 pts · 1y
@danc4498 Oh, goddammit, the Lemmy thing fucked up the ASCII art. Whatever, google it.
some_guy@lemmy.sdf.org · 13 pts · 1y
Federation.
Wait till you get a comment from threads. I've only had it happen once and it made me feel dirty.
th3rdsergeevich@mastodon.ml · 7 pts · 1y
@mogoh AFAIK, I should mention @linuxmemes handle to make the comment visible inside the original Lemmy thread.
@drq
30p87@feddit.org · 8 pts · 1y
It does!
drq@mastodon.ml · 13 pts · 1y
@30p87 Okay, looks like we *finally* have *actual* groups in Fedi that are compatible across the board.
I've been waiting for this for so long, I've almost given up all hope.
@linuxmemes
FlowerTree@pawb.social · 3 pts · 1y
Wait until you see Pixelfed and Mastodon's intercompatibility
Nearly all the posts in my Pixelfed global feed literally comes from Mastodon instances as if I'm on Mastodon with Pixelfed ui
th3rdsergeevich@udongein.xyz · 1 pts · 1y
@drq what worked
th3rdsergeevich@mastodon.ml · 3 pts · 1y
@th3rdsergeevich@udongein.xyz
@drq @linuxmemes you forgor to mention linuxmemes
lnkr_@mastodon.ml · 1 pts · 1y
lnkr_@mastodon.ml · 1 pts · 1y
TheReturnOfPEB@reddthat.com · 35 pts · 1y
everything is a file including a filesystem*
* including databases
kate@lemmy.uhhoh.com · 34 pts · 1y
git repo is blockchain
TheBat@lemmy.world · 33 pts · 1y
whoisearth@lemmy.ca · 10 pts · 1y
Tbh still preferred to that asshat who rolls out an MS Access "app"
superkret@feddit.org · 1 pts · 1y
*starts rocking back and forth in chair
fnrir@lemmy.world · 5 pts · 1y
or CSV files
gandalf_der_12te@discuss.tchncs.de · 28 pts · 1y
and anuses are vaginas, as long as you treat them as one.
BakedCookie@lemmy.dbzer0.com · 24 pts · 1y
bussy
coacoamelky@lemm.ee · 18 pts · 1y
As a man of science I prefer to test every theory.
not_IO@lemmy.blahaj.zone · 9 pts · 1y
the anus isnt self lubricating :(
Saik0Shinigami@lemmy.saik0.com · 14 pts · 1y
https://my.clevelandclinic.org/health/body/24784-anus-function
It is though...
superkret@feddit.org · 7 pts · 1y
It can be if you're lactose intolerant.
mlg@lemmy.world · 22 pts · 1y
Didn't someone actually try making SQL as a filesystem and it ended up being something like 50 times slower than ZFS after they applied a ton of optimizations?
Not as a serious project, but more like a joke to see what would actually happen.
mugdad1@mastodon.social · 2 pts · 1y
@mlg @drq lol imagne that :michaelwazowski: :michaelwazowski:
Irelephant@lemm.ee · 21 pts · 1y
You're right! Ill just store all this data as static json files in a directory then
collapse_already@lemmy.ml · 18 pts · 1y
And files are streams. 🎵 Islands in the stream. 🎵
Bishma@discuss.tchncs.de · 12 pts · 1y
🎵 That is what we awk 🎵
hperrin@lemmy.ca · 15 pts · 1y
They’re more like blob storage.
thedeadwalking4242@lemmy.world · 5 pts · 1y
Blob storage usually uses a FS back end so it’s more like blob storage is like a file system
renzev@lemmy.world · 11 pts · 1y
Just fucking putting data into json files in a folder is so much easier than databases. Sure, databases are faster and give you access to powerful SQL queries. But if you're just making something small and simple, you don't need those things. Save yourself the hassle and just use the filesystem.
Or use minio/s3, which can either be the best or the worst of both worlds depending on your usecase.
twice_hatch@midwest.social · 12 pts · 1y
The trouble is, filesystems don't have ACID. The first time you have a power loss during a write, your data will get corrupted.
renzev@lemmy.world · 1 pts · 1y
Hmm that's a valid criticism, thanks for pointing it out
FooBarrington@lemmy.world · 10 pts · 1y
It also makes you re-implement a database, but worse.
Use a JSON file if you just need to serialize/deserialize some data. Use SQLite or a DB server if you need more. Your own code will never match the quality of SQLite.
seliaste@lemmy.blahaj.zone · 3 pts · 1y
Sqlite is the best in most cases
Korhaka@sopuli.xyz · 3 pts · 1y
Made a bash script using sqlite recently to automate processing some data. Best part is it terrifies everyone else at work and no one else wants to touch it because it's on Linux and none of them have used it before.
a2part2@lemmy.zip · 3 pts · 1y
Duckdb can query them with SQL like they are in a database. Csv, tsv, parquet also. You can even connect to and query postures and cloud storage also
foxido@social.cutie.team · 10 pts · 1y
But they are not DBMS
@drq@mastodon.ml @linuxmemes@lemmy.world
drosophila@lemmy.blahaj.zone · 10 pts · 1y
That's less the Unix way and more the BeOS way.
mugdad1@lemm.ee · 10 pts · 1y
drq@mastodon.ml · 6 pts · 1y
@mugdad1 Trick is, I'm not on Lemmy.
mugdad1@lemm.ee · 5 pts · 1y
drq@mastodon.ml · 12 pts · 1y
@mugdad1 I don't mix, I'm on Mastodon. I just mentioned @linuxmemes in op-post et voila! Neat, huh?
superkret@feddit.org · 9 pts · 1y
That's what federation is all about.
mugdad1@lemm.ee · 5 pts · 1y
RobotZap10000@feddit.nl · 4 pts · 1y
Welcome to the lovely world of the Fediverse! Mastodon and Lemmy, among many other kinds of software, both run on ActivityPub. This means that even if the servers aren't both running Lemmy or Mastodon, they still speak the same language and can therefore understand the content of each other's posts (think of it as email, gmail.com can still send and receive mail to outlook.com). Other examples of AcitvityPub software are Misskey, Mbin, Friendica, Pixelfed, Loops, Piefed, PeerTube and many others that I haven't learned about yet. While they theoretically can all fetch and present posts from each other, due to the choices that each developer makes while designing their software, it might not be very possible to get every post from every software. For example, Mastodon is all about following people, and Lemmy about following communities. Even though Mastodon is able to follow Lemmy communities, Lemmy has (as of writing) no function to follow people (yet).
mugdad1@lemm.ee · 2 pts · 1y
addie@feddit.uk · 8 pts · 1y
Filesystem-as-a-db is why MongoDB is webscale. You just turn it on and it scales right up.
RizzRustbolt@lemmy.world · 8 pts · 1y
Every Homestuck fan already knows this.
drq@mastodon.ml · 3 pts · 1y
@RizzRustbolt What's your fetch modus, warrior?
RizzRustbolt@lemmy.world · 3 pts · 1y
"I have a system". Items are sorted randomly on to the top of "piles". I can retrieve any item from any pile, but pulling from anywhere except from the top of the pile destroys it.
drq@mastodon.ml · 2 pts · 1y
@RizzRustbolt Associative array here. Aka dictionary. Boring but practical.
Redacted@lemmy.world · 6 pts · 1y
The list of reasons filesystems are not databases is a database.
azvasKvklenko@sh.itjust.works · 6 pts · 1y
I love how pacman/libalpm database is just directories with tiny little files, and it’s faster in resolving dependencies than mostly anything else
th3rdsergeevich@mastodon.ml · 5 pts · 1y
@drq Come on, that can't be your F I R S T post.
@linuxmemes
drq@mastodon.ml · 9 pts · 1y
@th3rdsergeevich It is my first op-post on lemmy, that's right.
@linuxmemes
nialv7@lemmy.world · 5 pts · 1y
Behold! I present to you: Database as Filesystem
possiblylinux127@lemmy.zip · 5 pts · 1y
Honestly that's basically what CephFS is
drq@mastodon.ml · 2 pts · 1y
@possiblylinux127 Or BeFS
possiblylinux127@lemmy.zip · 2 pts · 1y
BeFS doesn't run on top of a data store. CephFS runs on RADOS.
reddit_sux@lemmy.world · 5 pts · 1y
And the worst FAT32
whotookkarl@lemmy.world · 3 pts · 1y
And all code is data too, and all processes are data transformers
kbal@fedia.io · 2 pts · 1y
Mine's more of a databivouac.
4oreman@lemy.lol · 2 pts · 1y
🤯😵
some_guy@lemmy.sdf.org · 1 pts · 1y
I don't know why this one was such a good laugh, but great first post.
drq@mastodon.ml · 1 pts · 1y
@some_guy Thank you!
top@top.ofthe.top · 1 pts · 1y
Well, that's ok, you are welcome.
maj@cosocial.ca · 1 pts · 1y
alsu2launda@lemmy.world · 0 pts · 1y
@pics
alsu2launda@lemmy.world · 1 pts · 1y
Does not work
th3rdsergeevich@lamp.leemoon.network · 0 pts · 1y
@drq@mastodon.ml Second post?
@linuxmemes@lemmy.world
grysbok@lemmy.sdf.org · 1 pts · 1y
mugdad1@lemm.ee · 0 pts · 1y