cruft | archive of old projects and repos

I'm packaging up a minimal Ubuntu distro to fit in a 4GB disk image, for use on a VPS. This image is a (C++) webapp which (among other things) writes and runs simple Python scripts to handle conversions between csv and xls files, with csvkit and XlsxWriter doing the heavy lifting. My entire Python knowledge is unfortunately limited to writing and running these scripts.

Problem: I install pip in the image to handle the download and install of csvkit and XlsxWriter. This creates a huge amount of cruft, including what seems to be a C++ development environment, just to install what I imagine (presumably incorrectly) is simply Python source code. I can't really afford this in a 4GB distribution.

Is there a lightweight alternative to using pip to do this? Can I just copy over a handful of files from the dev machine, for example? I suppose one alternative is simply to uninstall pip after use, but I'd rather keep the disk image clean if possible (if nothing else, it will compress better).

db:Postgresql-14. This will be an infrequent transformation, and I'm looking for recommendations / improvements that can be made so I may learn/hone my postgres/json skills (and speed/optimize this very slow query).

We receive variable size/structure json objects from an external api.

Each json object is a survey response. Each nested "question/answer" object can have a quite different structure. In total there are about ~5 known structures.

Response objects are stored in a jsonb column that has a jsonb_ops gin index.

Table has about 500,000 rows. Each row's jsonb column object has about 200 nested values.

Our goal is to extract all the nested question/answer responses into another table of id,question,answer. On the destination table we'll be doing extensive querying with FTS and trigram, and are aiming for schema simplicity. That is why I'm extracting to a simple table instead of doing anything more exotic with jsonb querying. There is also a lot of metadata cruft in those objects that I don't need. So I'm also hoping to save some space by archiving the origin table (it's 5GB + indexes).

Specifically I'd love to learn a more elegant way of traversing and extracting the json to the destination table.

And I've been unable to figure out a way to cast the results to actual sql text instead of quoted jsontext (normally I'd use ->>, ::text, or the _text version of the jsonb function)

This is a very simplified version of the json object to ease just running this.

Thank you in advance!

I have an array of Java-style package names and want to sort it in a specific way. The sort order I want is generally alphabetically, but with the additional requirement that lowercase always goes either before or after uppercase, depending on a user supplied flag to the sorting function (which allows also a third option of leaving the original order alone).

Example:

I'm trying to make a simple as possible make file that uses the math library (fmax below, the rest is C cruft for this examlpe):

easy.c:

I have a Vue component that I just converted to class syntax. I have done this to three other components in my project with no problem. My component looks like this after reducing it to just the problematic code and no cruft:

Is there a way to grep the IP address of the inbound connection and disconnect after a timeout?

If I do

I am working on a script to do some cleanup of the many GB of cruft an Autodesk install leaves behind, and I am getting an error about some log file buried deep in the folder structure that is still in use. So, I want to get $_.exception.GetType().fullname so I can have a do/while loop that loops as long as that is the failure. Or more likely loops until success or a specified number of tries fails. To that end I created an RTF file on my C drive, opened it in Wordpad and tried this code to get the exception info.

I'm not super familiar with the internals of JavaScript and garbage collection. I want to avoid circular references that could create memory issues when using a MutationObserver, and I'm aware that with the wrong GC assumptions, I could make the MutationObserver hold a reference to an element that would prevent the element from getting GC'd.

When an element is removed from the page, the MutationObserver instance is no longer referenced, but it is still observing the removed element, would it stay in memory and continue to observe the element?

Maybe that's a question for a particular browser implementation? I don't want unnecessary/defensive code cruft, but I'd hate to make a subtle memory leak this way.

Here is the error: