buckets | A simple key/value store based on Bolt | Storage library

I need to split my products into a total of 120 predefined price clusters/buckets. These clusters can overlap and look somewhat like that:

As I dont want to write down all of these strings manually: Is there a convenient way to do this in M or DAX directly using a bit of code?

Thanks in advance! Dave

My pipeline is going to be run across several different AWS accounts. Some accounts have all the S3 buckets needed, while some are missing some of the buckets.

I need my IAM policy to include ARNs of all S3 buckets if they exist. If an account has some s3 buckets that do not exist, those ARNs should be omitted from the policy. Something along the lines of:

Everything works perfectly in the code below if run without the 4 lines starting NotificationConfiguration . I thought this might be because of needing the topic policy before setting notification on the bucket. So have tried to do the initial create without the NotificationConfiguration lines and then add these in and update the stack. But get the error Unable to validate the following destination configurations (Service: Amazon S3; Status Code: 400; Error Code: InvalidArgument; . I've tried things like putting the actual topic arn not using !Ref but no joy. Thanks!

I have an overarching Bash script where there are 3 main processes that are executed within the script:

1. Spin up an ec2 instance (lets say ec2-1) which will pull data from a private s3 bucket (in the same region: us-east-1) and run some programs.
2. Spin up an ec2 instance (lets say ec2-2) which will pull data from a public amazon s3 bucket (in the same region: us-east-1) and run some programs.
3. Spin up an ec2 instance (lets say ec2-3) which will pull data from a private s3 bucket (separate from 1), but still in region: us-east-1) and run some programs.

To ensure that each, individual process worked, I ran them all separately. For example, in my bash script, I would run only process 1) and ensure it completes from start-to-finish. After that completes, I would test 2), wait for this to run through completely, and then test 3) to ensure that runs through completely. Everything works fine, and have it all working well. Download speeds are in excess of 25-30 MB/s, which is perfect since a lot of data is being moved to/from s3 buckets.

Now I am at the stage where I attempt to run 1, 2, and 3 together all within the same Bash script. Note: all three ec2 instances SHOULD be independent from one another as they all have their own unique instance-id but are all in the same region (us-east-1). However, when I run all 3 at once, there is something that causes download speeds to/from the s3 buckets to become VERY slow - from ~ 25MB/s to 1 kB/s, and sometimes even completely stopping. It is interesting because 1) and 3) are pulling data from a private bucket, whereas 2) is pulling data from Amazon's public s3 bucket, yet ALL THREE instances have slow/stopped download speeds. I have even increased all of the three ec2 instances to m5dn.24xlarge, and the download speeds are still abysmal.

I also tried to run two separate instances of 1), 2), or 3), and they perform slower as well. For example, if I run 1) for two separate dates (with two separate instance-id's), the speed is lower compared to if I just run one instance of 1).

My question is: how/why would this be happening? Any feedback / info would be very helpful.

I am working with the AWS S3 SDK in GoLang, playing with uploads and downloads to various buckets. I am wondering if there is a simpler way to upload structs or objects directly to the bucket?

I have a struct representing an event:

Using Windows downloadable EXEs for Influx. Was connecting and working great until this morning.

I started influxd today, and I see in the console:

I am migrating my db from postgres to elasticsearch. My postgres query looks like this:

I have a sample df

I need to create another column C that buckets column B based on some breakpoints

Breakpts = [50,100,250,350]

I have the following code that works

I have created a hive table with 4 buckets.. I can read the data from nth bucket ..

For example..