How Did I

How Did I

How Did I Lower Zipped CSV Files Extraction and Filtering RAM Usage by 200x

Recently, I created a dashboard to monitor the status of Roraima's revenue agreements, available here. This open government data is sourced by the Governo Federal, specifically the TransfereGov system. The open data for the dashboard is served as zipped CSV files (.csv.zip). These files, when unzipped, reach

How Did I

How Did I Make a Report 150x Faster

Working at Governo do Estado de Roraima, I frequently need to work with reports, whether to create a dashboard or to modify how data is processed/presented. Given this context, there was this specific report that took WAY TOO LONG to be generated, and it was driving me insane. It