Thanks for the newsletter, been loving it so far. I'm interested in any tips and workflows with dealing with big data sets. I know there's Arrow and DuckDB but would love to hear if you have any recs or workflows. I am currently dealing with large data bases and I need to pull data from them but I ran out of memory most of the time. I'm not a data scientist so I struggle more than one, I suppose.
Thanks!!
Hey Ted!
Thanks for the newsletter, been loving it so far. I'm interested in any tips and workflows with dealing with big data sets. I know there's Arrow and DuckDB but would love to hear if you have any recs or workflows. I am currently dealing with large data bases and I need to pull data from them but I ran out of memory most of the time. I'm not a data scientist so I struggle more than one, I suppose. Thanks!!