firecracker | Secure and fast microVMs for serverless computing | Continuous Deployment library

BACKGROUND:

I am trying to write a DPDK app which is supposed to handle packets coming from inside a Virtual Machine Monitor.

Basically the VMM is getting the packets from its guest, then is going to send those packets to DPDK. Then Dpdk sends them out on the NIC.

Virtual Machine -> Virtual Machine Manager -> DPDK -> NIC

This architecture from above is supposed to replace and outperform the original architecture. In the original architecture, the VMM is putting the packets on a TAP interface.

Original:

Virtual Machine -> Virtual Machine Manager -> TAP interface -> NIC

Problem:

I have written the new architecture and the throughput is way worse than when using the TAP interface. (TAP 300 MB/s any direction, Dpdk: 50MB/s VM sender, 5MB/s VM receiver)

I am suspecting that I am not configuring my DPDK Application properly. Could you give an opinion on my configurations?

Environment:

I have done all the testing inside a Qemu virtual machine, so the architectures described above were both ran inside this Virtual Machine:

3 logical CPUs (out of 8 on host)

4096 MB memory

OS: Ubuntu 20.4

2 NICs, one for SSH and one for DPDK

What I did so far:

2GB Hugepages

Isolated the cpu which DPDK is using.

Here is the code: https://github.com/mihaidogaru2537/DpdkPlayground/blob/Strategy_1/primary_dpdk_firecracker/server.c

All functional logic is in "lcore_main", everything else is just configuration.

All the advice I could find about increasing performance would involve hardware stuff and not configuration parameters, I don't know if the values I am using for things such as:

The architecture is as follows:

Secondary DPDK app ------> Primary DPDK App ----> (EDIT)Interface

Inside my Secondary I have a vector of u8 bytes representing an L2 packet. I want to send this L2 packet to the Primary App so the primary could send it to the internet. From what I understood, the L2 packet has to be wrapped in mbuf in order to be able to put on a shared ring. But I have no clue on how to do this wrapping.

What I don't know exactly: my packet is just a vector of bytes, how could I extract useful information out of it in order to fill the mbuf fields? And which fields of the mbuf should be filled minimally for this to work?

For better understanding, here is what should happen step by step:

1. Vector of bytes gets in secondary (doesn't matter how)
2. Secondary gets an mbuf from the shared mempool.
3. Secondary puts the vector inside the mbuf (the vector is an L2 packet)

• mbuf has many fields representing many things, so I don't know which field to fill and with what.

1. Secondary places the mbuf on a shared ring.
2. Primary grabs the mbuf from shared ring.
3. Primary send the mbuf to the internet.

This is what I coded so far, the secondary App is in Rust and primary App is in C language.

Secondary is here (github):

Remember, L2 Packet is just Vec, that is like [1, 222, 23, 34...], a simple array.

Basically I am trying to cargo build a crate which has a build.rs file. This crate is located inside a bigger project and it's supposed to be a lib crate. And inside this build.rs file, I am trying to compile a .C file which includes a couple of headers.

Fun fact: I got this build.rs file and crate structure from another little demo crate, and in that demo crate I had no problem to compile this exact C file with these headers.

FULL ERROR HERE:

Here is a link to github: https://github.com/mihaidogaru2537/FirecrackerPlayground/tree/dpdk_component/firecracker/src/dpdk_component

There is the crate I am talking about and you can also see the bigger project in which it resides. In the README file you can see the full error.

Either I do cargo build from the root of the big project or from the root of this problematic crate, the error is the same.

"cargo:warning=/usr/include/asm-generic/errno.h:5:10: fatal error: asm-generic/errno-base.h: No such file or directory cargo:warning= 5 | #include "

The missing file might change depending on the .flag("-I/path/..") calls I am doing inside the build.rs

As you can see, right now it's unable to find errno-base.h, but I am including the path to asm-generic.

Here is the code of the build.rs file from the crate where the compilation of this C file works, as you can see, I did not have to add any include flags before calling compile.

I'm currently working on a web application that has to function as some sort of webshop later on. I'm now working on an addToCart function, that has to pick certain data from the clicked element (the name and the price of the product, and add 1 to pcs and save everything to a session), and paste these 2 values into a template I've made and place this in the shopCart. I'm now trying to print out the 2 values I've just mentioned, but I'm stuck now.

This is the current javascript code I've made for loading in all the products, and my attempt on showing some of the values of the clicked items:

I'm pretty new to programming and right now I have a website that shows different fireworks from my json file in the frontend. I have made a categories menu, that I would like to actually work. I wondered what would be the most efficient way to make this menu work. I have made a function that returns all existing json objects from my json file, and wondered if it would be possible to use this existing function to filter on the different categories, and only show the items with the designated categorie. The script I'm using to loop through all de json object is:

I'm trying to make my functionality work that eventually has to add items to my shopping cart. However, the tutorial I'm following is making use of data in his html that he passed down with a data type in the element itself. I'm retreiving data from a json file. I would like to know how I can make this simple functionality work, so I can continue on working out the functionality. At this moment I'm getting back "undefined" in my console.

Html code:

I am aware of the cold-start and warm-start in AWS Lambda.

However, I am not sure during the warm-start if the Lambda architecture reuses the Firecracker VM in the backend? Or does it do the invocation in a fresh new VM?

Is there a way to enforce VM level isolation for every invocation through some other AWS solution?

I have a function all_purch_spark() that sets a Spark Context as well as SQL Context for five different tables. The same function then successfully runs a sql query against an AWS Redshift DB. It works great. I am including the entire function below (stripped of sensitive data of course). Please forgive its length but I wanted to show it as is given the problem I am facing.

My problem is with the second function repurch_prep() and how it calls the first function all_purch_spark(). I can't figure out how to avoid errors such as this one: NameError: name 'sqlContext' is not defined

I will show the two functions and error below.

Here is the first function all_purch_spark(). Again I put the whole function here for reference. I know it is long but wasn't sure I could reduce it to a meaningful example.

I'm hitting a lifetime error when compiling a change I made for Firecracker (on aarch64, but I doubt the issue is architecture-dependent):