Data-Engineering Lessons

2 lessons in this domain

ETL pipeline derives identifiers from source filenames (e.g., `robot_name` from Excel sheet names). Filenames are inhere

Running `UPDATE` on a 1.2GB SQLite database via WSL2's NTFS mount (`/mnt/d/`) takes 5+ minutes for a single statement up