paranoia | Paranoia add-on for Thunderbird | Email library

Consider the following bash script:

I'm trying to debug an OutOfMemoryError I'm getting in my Hadoop reducers. The mappers complete successfully. They generate small records that are less than 128 bytes. In my reducer, I collect records with the same key (there around 15 possible keys), and write them to separate output files with MultipleOutputs. The distribution of records per key isn't uniform.

In the middle of the reduce phase, I start getting OutOfMemoryErrors. I've checked a lot of things:

• The reducer doesn't save data; once it gets a value, it writes it out to the corresponding output
• I tried different values for the number of reduce tasks. Tuning this is a bit weird in my case because more than 15 won't help because there are only 15 keys
• Instantiating MultipleOutputs and closing it in reduce(), thinking it holds onto resources for the output files. This only works because keys and output files have a one-to-one mapping.
• I tried adding data to the end of the keys so the data would get distributed evenly between reduce tasks
• Out of paranoia, mapreduce.reduce.shuffle.memory.limit.percent=0
• Verified keys and values really are small
• Disabled output compression, thinking there's a memory leak in the compressor
• Blindly tuning things like mapreduce.reduce.shuffle.merge.percent

I'm not sure where else memory could be going other than aggressively buffering the shuffle output.

This is running on GCP Dataproc with Hadoop 3.2.2. A lot of guides recommend setting mapreduce.reduce.java.opts. I tried this unsuccessfully, but I also assume Google chose a reasonable default for the host size, and I don't have a convincing story about where the memory's going. My one other theory is something in GoogleHadoopOutputStream that writes to cloud store is buffering. I have some output files between 10GB and 100GB--larger than the memory of the machine.

What else should I look at? Are these other flags I should try to tune? Attaching VisualVM doesn't look easy, but would a heap dump help?

I am busy testing an API setup on AWS with API gateway this is the first time I have tested an API off a server for a SPA I am developing from my local PC. I therefore never knew about this CORS thing and boy is it frustrating!

Are there any ways to simply bypass this in 2020 because the plugins for Chrome dont work and starting the browser with disable security argument is also not working.

The question is why is this so hard for a developer who wants to work on their local machine to bypass its causing me endless frustration and swearwords I mean seriously really!??! Why does whoever implemented do this? Rant over.

For me the thought of building infrastructure and getting the site up and running on AWS within the same domain is too much of a detour right now when I want to get the page open on my browser on my local pc to call the API.

To make things more frustrating I tried following an outdated guide on AWS docmentation (https://docs.aws.amazon.com/apigateway/latest/developerguide/how-to-cors-console.html) to disable this and the updated AWS console does not allow wildcards for "Access-Control-Allow-Origin" anymore.

What evil things have been done that have caused this paranoia?

Any suggestions?

I am hosting the email for one of my domains at Gmail. I then run an IMAP client on my local computer to read and send email. Totally standard.

I now want to move the hosting for that domain to another email provider, where I will again run an IMAP client to deal with the mail.

Question: What happens to all the messages that are currently on Gmail? I THINK that they will stay in place, and I'll be able to access them via gmail.com and/or a Gmail app. But maybe not? Maybe Gmail will somehow find out about the MX change and decide that it should delete them all, because Reasons. Or it can't find the messages on its own server because the MX has changed, and so won't let me see them. Or something. In any case, losing access to these old messages would be Very Bad.

So, which is it? Will the world behave the way that I'm 99% sure that it will, such that I'll still be able to go to gmail.com and read the old messages after the switch? Or do I need to move the old messages somewhere else before making the hosting switch? Thanks for helping with my paranoia!

Forgive my ignorance or paranoia if this is a stupid question, but I can't seem to find anything on this specific situation in particular (which leads me to think maybe most people either know to avoid it or have better ways to handle this).

Here's the premise: I don't know whether or not my code will necessarily always be ran in a browser, and as such, I don't know if I'll have access to window (specifically by that name) or if that scope will be named something else in whatever environment my code may find itself in.

So my idea was to find that scope once, assign it to a local variable then let everything within my function just reference that local variable if I ever need to access the global scope instead of reaching for window (again, it could be called something else—I won't know).

My concern is, is this going to cause some memory leak issue (or maybe it's a bad idea for other reasons)? Is there something I should be mindful of or am I good to go?

I recently purchased a django-react code off fiverr. I don't know too much about web development. This may be just paranoia but is it possible that there could be some malicious malware in these kind of Files. And that if I run the server then something could happen to the pc I run it on?

I'm trying to implement the double __ieee754_sqrt(double x) function which uses hardware instruction to obtain the 1st approximation:

Background: I'm using a Perl script that submits abuse reports to abuseipdb.com. The script has only one default category (14 Port Scan), but I want to submit the correct category/categories for the abuse reports. Submitting the category is done by a number. Multiple categories are possible and are separated by a comma ','.

List of categories: https://www.abuseipdb.com/categories

Source of the script: https://www.abuseipdb.com/csf, scroll roughly halfway down for "abuseipdb_report.pl".

I've modified the script to scan the log files for keywords and if found give it a correct category number. (Disadvantage: only 1 category number can be used this way.)

It's working, but far from pretty. All those if and elsif statements will take a lot of processing time.

Here are the snippets that I've cooked up. (it's working!)

This has just recently started happening, not sure if it's a bug with node or discord.js or something else, but I can't find anything that would be causing issues in my code.

The program having issues is a program for a discord bot I made. The error only happens during one command, which sends a message to the mentioned user and stores some info in a log for later. The relevant code: