robustness | Corruption and Perturbation Robustness | Machine Learning library

I need to detect (among other things) the first occurrence of a non-"F" code in a patient's list, after the first "F" code occurrence. The below code seems to succeed in this, however it is shown to be too inefficient on the server running in a data set of one million observations.

The final data set should have a variable of number of non-F codes (nhosp), and the first non-F code found after the first F-code appearance on the DAIGNOSTICO variable. No duplicates of ID.

• How can I improve both in terms of complexity and speed? Tidyverse pipe preferred.

This is how the result should look like:

Considering following example:

I'm trying to match PowerShell dash comments (# ...) but not inline comments (<# .. #>) in same regex. How can I achieve it?

I'd like to match PowerShell comments (using hashtag comment syntax). So simply everything after # is commented out. I use #(.*$)/gm for it.

Test-cases where the regex match is written inside brackets [..]:

• Write-Host "Hello world" [# comment here]
• [# A line with only comment]
• Comment without whitespace[#before]
• [Comment with whitespace [#after ]

However what I'd like to use here is have an exception for "inline comments syntax". Inline comments in PowerShell looks like lorem <# inline comment #> ipsus.

So here I'm looking for exclusions for:

• Write-Host "Hello world" <# inline comment here #>
• <# A line with only inline comment #>
• Comment without whitespace<#no whitespace#>around
• Inline comment <# in middle #> of line
• Comment with whitespace #comment with >
• Comment with whitespace #comment with <
• Comment with whitespace #comment with <# test #>

I tried to use [^<>] for something like #[^<>](.*[^<>]$) but it did not work for all cases given in the above.

My progress on regex101 until I got stuck.

I'm parsing PowerShell in JavaScript/TypeScript runtime to be able to inline them to run them in batch (cmd) for a community driven open-source project. I know there will be exceptions to this (like strings with dashes inside) but I trade off simple regex parsing for robustness.

Thank you!

I am writing a program that aims at wrapping a C code starting a phasemeter acquisition.

This code is supposed to be run on several process at the same time so I use multiprocessing.

I read nearly all answered questions on SO on this subject but I think i'm missing something. I would be glad if someone could give me a hand on this one.

I have the following error :

wdir='/home/castaing/Documents/LISA/lisa_zifo_monitoring/Python Drivers/Phasemeter/Py_Code') Traceback (most recent call last):

File "/home/castaing/Documents/LISA/lisa_zifo_monitoring/Python Drivers/Phasemeter/Py_Code/DriverPhasemeter.py", line 297, in Process.map(start,Phasemeter.phase_list)

File "/home/castaing/anaconda3/envs/LISA/lib/python3.7/multiprocessing/pool.py", line 268, in map return self._map_async(func, iterable, mapstar, chunksize).get()

File "/home/castaing/anaconda3/envs/LISA/lib/python3.7/multiprocessing/pool.py", line 657, in get raise self._value

File "/home/castaing/anaconda3/envs/LISA/lib/python3.7/multiprocessing/pool.py", line 431, in _handle_tasks put(task)

File "/home/castaing/anaconda3/envs/LISA/lib/python3.7/multiprocessing/connection.py", line 206, in send self._send_bytes(_ForkingPickler.dumps(obj))

File "/home/castaing/anaconda3/envs/LISA/lib/python3.7/multiprocessing/reduction.py", line 51, in dumps cls(buf, protocol).dump(obj)

AttributeError: Can't pickle local object 'CDLL.init.._FuncPtr'

I tried to define a global function to call the phasemeter object's method as you can see below. At the beginning I had a multistart method in the phasemeter object which code was :

I wanted my BASH script to end in a defined way doing some cleanup before exiting. It's easy to do if the script runs until end, but it's getting tricky if the user is impatient and sends a SIGINT (^C).

So I added a trap cleanup INT EXIT (cleanup is my function to clean things up), and I thought things were OK (as cleanup would be called when the script exits, cleanup itself does not use exit).

But then I started a test adding kill -INT $$; sleep 4 in the middle of the script, and I realized that cleanup is being called on SIGINT, but still the sleep 4 was executed and at the end of my script cleanup was called a second time, something I did not intend.

So I wanted to "reset" the handlers at the end of my cleanup using trap INT EXIT as the manual page said the syntax is "trap [-lp] [[arg] sigspec ...]" (also saying: "If arg is absent (and there is a single sigspec) or -, each specified signal is reset to its original disposition (the value it had upon entrance to the shell).").

Interestingly that did not work as intended, so I used trap '' INT EXIT instead (The manual says: "If arg is the null string the signal specified by each sigspec is ignored by the shell and by the commands it invokes."). It would be a nice sub-question how to do it correctly, but let's ignore that right now.

If I modify my trap to trap cleanup INT, then the cleanup is executed immediately when receiving the SIGINT, and not when the script exits after the sleep eventually (SIGINT does not cause the script to exit early).

If I modify my trap to trap cleanup EXIT, then the cleanup is executed immediately when receiving the SIGINT, and the script ends after cleanup returned.

So the question is: Does trap cleanup INT EXIT make any sense (for cleanup purposes)? It seems to me that EXIT includes the exits caused by any signal, too (I'm unsure whether that has been the case always). Contrary trapping SIGINT would perform cleanup actions without actually causing the script to exit.

Is there a general agreed-on "cleanup trap pattern"? (There is a similar question in bash robustness: what is a correct and portable way to trap for the purpose of an "on exit" cleanup routine?, but it has no good answer)

I am familiar with the regular way of applying a high pass filter on an image:

1. Apply FFT np.fft.fft2 on an image.
2. FFT shift np.fft.fftshift so that the low frequencies are centered.
3. Apply the appropriate high pass filter on this frequency domain image
4. FFT shift np.fft.fftshift and inverse Fourier transformation np.fft.ifft2 to get the corresponding image in spatial domain.

If my understanding is correct, when we follow these steps, low frequencies lie near the center in Fourier domain image.

How do we apply np.fft.fft2 so that high frequencies instead of low frequencies are centered?

Additional info: I came across this particular way of applying a high pass filter in the following paper 'A Fourier Perspective on Model Robustness in Computer Vision' by Yin et. al. https://arxiv.org/abs/1906.08988

I am curious how they actually implemented it.

I have an existing Devops pipeline that trains ML models. To guaranty the robustness for the models, it will be necessary to retrain it periodically. For this I decided to create an Azure function that will be executed each month. will It collect the new data, apply the data pre-processing and finally trigger the Azure Devops training pipeline. All of this must be done with python. By doing a research, I understood that this can be done using REST Azure Devops API request. I founded this python git repo https://github.com/microsoft/azure-devops-python-api which provides an API to communicate with Azure DevOps. I executed the code provided by this package which displays the list of my devops projects. But I can't found how trigger the pipeline. Assuming that my organisation named ORGA1, the project named PROJ1 and the pipeline that I want ti execute named PIPELINE1, How can I launch it using an Azure function or even a simple python script ? PS: I am using a python 3.9 Timer Trigger Azure function. Thank you in advance for your help.

EDIT

I tired to use LOGIC APP to do this like @mohammed described in the comment and I think that this is a good solution. Above the workflow that I created:

So I launch the logic app each X hours, this will trigger the azure Devops, and ASA it end training with Success it will send me an email. I have one error here, is that I am creating a new release and not triggering a specific pipeline each time. But navigating in the different actions under the devops service, I cannot found any thing related to launching a devops pipeline. Can anyone have an idea how to do it.

I need to bootstrap a beta regression model to check its robustness - because of a data point with a large cook's distance - with the boot package (other suggestions welcomed).

I have the following error:

I have two dataframes, one of which contains a subset of IDs and columns of the other (but has different values).