Also multiple systems included. the old base plotting from the 90s, lattice for really custom things, ggplot as the most humanely understandable and reasonable system for composing plots and great interfaces to plotly and d3.js
initially read my data from whatever source (CSV, relational database somewhere, whatever)
write it to one or more parquet files in a directory
tell duckdb that the directory is my data source
Then duckdb treats the directory just like a databese that you can build indexes on, and since they're parquet files they're hella small and have static typing. It was pretty fast and efficient before, and duckdb has really sped up my data wrangling and analysis a ton.
26 Comments
grimdeter@lemmy.ml · 38 pts · 2y
Package manager for biologists and purpose made for data science makes me think of R. But if its true, i never knew you can write inline c++
merari42@lemmy.world · 25 pts · 2y
RCpp is crazy good. You can super easily write Cpp inline with R code, it is easy to use and half of the tidyverse is written in it.
grimdeter@lemmy.ml · 11 pts · 2y
I saw RCpp in my package manager, but I thought that it is not for users and just a dependancy. Maybe I will look into that
BlueBockser@programming.dev · 9 pts · 2y
itsnotits@lemmy.world · 11 pts · 2y
Aatube@kbin.melroy.org · 7 pts · 2y
to everybody downvoting: read the username
i wonder if this is a bot? it doesn't have the bot label
Yax@feddit.de · 13 pts · 2y
Bot or not, it's no tits!
charolastra@programming.dev · 1 pts · 2y
notitsbot
marcos@lemmy.world · 20 pts · 2y
Most sane language designers stop at embedding C.
C++ is really taking it up to 11.
nieceandtows@programming.dev · 19 pts · 2y
Must be python, because it's my favorite, and I reject this image.
KindaABigDyl@programming.dev · 16 pts · 2y
Uhhh... R?
That, MATLAB, and Python are the only languages I know of used in that field, and it's not MATLAB or Python lol. I don't know anything about R tho
h30x@lemmy.zip · 7 pts · 2y
No, Julia. LLVM compiled scientific language
merari42@lemmy.world · 4 pts · 2y
Na this is about R
KindaABigDyl@programming.dev · 2 pts · 2y
Oh actually I have heard of that as well
RustyShackleford@programming.dev · 13 pts · 2y
R is for Removed by moderator.
eran_morad@lemmy.world · 13 pts · 2y
witty_username@feddit.nl · 11 pts · 2y
Should've included:
ridiculously good at plotting if you can figure out the correct syntaxes
merari42@lemmy.world · 7 pts · 2y
Also multiple systems included. the old base plotting from the 90s, lattice for really custom things, ggplot as the most humanely understandable and reasonable system for composing plots and great interfaces to plotly and d3.js
Ironfacebuster@lemmy.world · 6 pts · 2y
It has to be Kepler, my terrible home grown interpreted language that has none of these features!
JK it's gotta be JavaScript
bobburger@fedia.io · 5 pts · 2y
Should include "has duckplyr" which is bad ass in the few weeks I've been using it.
eran_morad@lemmy.world · 5 pts · 2y
bobburger@fedia.io · 4 pts · 2y
I love duckDB, my usual workflow is:
Then duckdb treats the directory just like a databese that you can build indexes on, and since they're parquet files they're hella small and have static typing. It was pretty fast and efficient before, and duckdb has really sped up my data wrangling and analysis a ton.
h30x@lemmy.zip · 4 pts · 2y
That's how Julia looks. https://julialang.org/
Bye@lemmy.world · 3 pts · 2y
Also my fav OP :)
Rcpp is probably the best thing to ever exist.
I reject tidyverse though
anzo@programming.dev · 3 pts · 2y
Best IDE ever, help pages with references to statistics journal articles, and the most useful feature:
pipe()lowleveldata@programming.dev · 3 pts · 2y
F#? I know it's probably not but I love F#
devfuuu@lemmy.world · 2 pts · 2y
The many oop systems makes me think perl.
DumbAceDragon@sh.itjust.works · 2 pts · 2y
Was thinking Nim because it's a couple of these.