aws-with | command line utility to help manage complex AWS | Command Line Interface library

I am trying to connect to DocumentDB from a Lambda function.

I have configured my DocumentDB as per this tutorial and can access it through the cloud9 command prompt.

The documentDB cluster is part of two security groups. The first security group is called demoDocDB and the second called default and is the vpc defulat security group.

The inbound rules for demoDocDB forward requests from the cloud9 instance to port 27017 where my documentDB database is running.

The inbound rules for the defualt security group specify all traffic, all port ranges and a source of itself. The VPC ID is the default VPC setup.

In lambda when editing the VPC details, I have inputted:

1. VPC - The defualt VPC
2. Subnets - Chosen all 3 subnets available
3. Security Groups - The default security group for VPC

The function has worked twice in writting to the Database, the rest of the time it has timed out, the timeout on the Lambda function is 2 minutes but before reaching that it will throw a time out error.

I have been trying to follow this tutorial to change my website from HTTP to HTTPS. I have my website set up with a namecheap domain and AWS S3 for hosting. According to the tutorial, I successfully got the SSL certificate. But not sure how to use it to make my website HTTPS. I am having a problem following step 3 of the tutorial

I tried to follow the Deploy to AWS with CodeDeploy instruction

and used the bitbucket-pipelines.yml

But I'm getting this error:

I am using AWS Elastic Beanstalk and have deployed my nodejs app on it. Now I want to automate this proces i.e commiting changes to Github and then automatically reflecting those changes in app. Now I have two options, use whether Elastic Beanstlak or using Code Deploy. I have searched on both services,

• I can automate using deployBot with elastic beanstalk or using jenkins plugin for automation (AWS Elastic Beanstalk Deployment Plugin) for elastic beanstalk. Also found this link to automate: https://aws.amazon.com/blogs/devops/building-continuous-deployment-on-aws-with-aws-codepipeline-jenkins-and-aws-elastic-beanstalk/

• I can also use AWS CodeDeploy service for automation to deploy my app on EC2 instances using CodeCommit , code pipeline. In case of code deploy I can also do by using this: https://aws.amazon.com/blogs/devops/automatically-deploy-from-github-using-aws-codedeploy/

Now both services can be used , but which one is more suitable to use. That will automate my process whether using AWS Elastic Beanstalk or AWS Code Deploy.

We have web application used by customers and they have option to create reports. Report contains email and scheduled time(Ex: every day, 9 a.m.).

When the scheduled time matches the current time web app does some work and sends result to the email.

I have one requirement where I need to implement scalable cron architecture on top of swf.

My needed architecture looks like below:

1. User creates report (DONE)
2. Webapp saves report to the db and sends report data and timer to the cron microservice through SQS(simple query service). (DONE)
3. Cron microservice reads incoming SQS messages and sends back SQS message when timer elapsed. (NEED THIS)
4. Webapp reads SQS message and triggers Data Analyzer and Emailer function to send analyzed data. (DONE)

From I read about SWF service is we can create cron jobs and SWF autoscales. How can I create scalable cron microservice using SWF?

Open to any suggestions...

P.S. Web app is written in nodejs, it will be very good to write microservice in nodejs.

Update 1: After spending some time researching possible solutions, I found https://github.com/capside/CloudCron project. But it relies on cloudwatch event. For many scheduled tasks it may charge a lot IMO.

Update 2: Banjo Obayomi suggested to use Lambda function with SQS and CWE.

Solution 1:

1. Webapp sends SQS message.
2. SQS message triggers Lambda function1
3. Lambda function creates CWE rule
4. CWE rule triggers Lambda function2
5. Lambda function2 sends SQS message back to webapp.

Limitations: We can only create 100 CWE rules per region. It means webapp can not generate more than 100 reports with scheduled date.

Links: cron-in-aws-with-lambda-function

I have a rails app working on heroku. I wonder how i migrate from Heroku to AWS Elastic Beanstalk.

I use Heroku postgres and I have cron jobs running on working dynos.

I searched on the internet but most links use docker but i need native solution.

EDIT: I'd better write a few things for people who will read it later.

Firstly, we set the environment variables on elastic beanstalk. Next, we have configured the database.yml file for RDS. You can follow this blog post for these initial setup steps.

sidekiq was the hardest thing that forced us the most in this process.

We created a redis instance with Amazon ElastiCache. Then we changed the redis and sidekiq config settings. In doing this, this blog post was very useful to us in this regard.

Next step is backup our database and restore to RDS. After this step we configured ssl and dns settings.

Meanwhile, if you have the force_ssl config setting in your project, it will cause your project to fail in the newly opened elastic beanstalk environment. Because elastic beanstalk does not have any ssl definition by default.

I have similar issue as this post: kube-controller-manager don't start when using “cloud-provider=aws” with kubeadm, but that does not provide any solution to solve the issue. Below is the log stats from kubernetes controller manager.