swiftiply | high performance clustering proxy / web server | Proxy library

by wyhaines Ruby Version: Current License: No License

X-Ray Key Features Code Snippets Community Discussions(10)Vulnerabilities Install Support

kandi X-RAY | swiftiply Summary

swiftiply is a Ruby library typically used in Networking, Proxy applications. swiftiply has no vulnerabilities and it has low support. However swiftiply has 3 bugs. You can download it from GitHub.

Swiftiply is a backend agnostic clustering proxy for web applications that is specifically designed to support HTTP traffic from web frameworks. It is a targeted proxy, intended specifically for use in front of web frameworks, and is not a general purpose proxy. What it is, though, is a very fast, narrowly targeted clustering proxy, with the current implementation being written in Ruby. Swiftiply works differently from a traditional proxy. In Swiftiply, the backend processes are clients of the Swiftiply server -- they make persistent socket connections to Swiftiply. One of the major advantages to this architecture is that it allows one to start or stop backend processes at will, with no configuration of the proxy. The proxy always knows exactly what resources it has available to handle a given request. The obvious disadvantage is that this is not behavior that web applications typically expect. Swiftiply was originally written in an era when Mongrel was the preferred deployment method for most Ruby frameworks. Swiftiply includes a version of Mongrel(found in swiftcore/swiftiplied_mongrel.rb) that has been modified to work as a swiftiply client. This should be transparent to any existing Mongrel handlers, allowing them all to with Swiftiply. Swiftiply also provides a traditional proxy model, allowing it to be used as a proxy in front of any web application. TODO: Provide an implementation of a swiftiply access proxy. This is a Swiftiply TODO: "client" that maintains N connections into Swiftiply, but that operates as TODO: a traditional proxy on the web application facing side. This lets an individual TODO: server modulate the total number of connections that it is willing to handle TODO: simultaneously, while not requiring the applications themselves to know anything TODO: about it. Swiftiply takes a single configuration file which defines for it where it should listen for incoming connections, whether it should daemonize itself, and then provides a map of incoming domain names and the address/port to proxy that traffic to. That outgoing address/port is where the backends for that site will connect to.

Support

Quality

Security

License

Reuse

Support

swiftiply has a low active ecosystem.

It has 70 star(s) with 12 fork(s). There are 6 watchers for this library.

It had no major release in the last 6 months.

There are 0 open issues and 4 have been closed. On average issues are closed in 3128 days. There are no pull requests.

It has a neutral sentiment in the developer community.

The latest version of swiftiply is current.

Quality

swiftiply has 3 bugs (0 blocker, 0 critical, 3 major, 0 minor) and 105 code smells.

Security

swiftiply has no vulnerabilities reported, and its dependent libraries have no vulnerabilities reported.

swiftiply code analysis shows 0 unresolved vulnerabilities.

There are 0 security hotspots that need review.

License

swiftiply does not have a standard license declared.

Check the repository for any license declaration and review the terms closely.

Without a license, all rights are reserved, and you cannot use the library in your applications.

Reuse

swiftiply releases are not available. You will need to build from source code and install.

swiftiply saves you 2914 person hours of effort in developing the same functionality from scratch.

It has 6294 lines of code, 461 functions and 55 files.

It has high code complexity. Code complexity directly impacts maintainability of the code.

Top functions reviewed by kandi - BETA

kandi has reviewed swiftiply and discovered the below as its top functions. This is intended to give you an instant insight into swiftiply implemented functionality, and help decide if they suit your requirements.

Parse command line options
Called when the data was received .
Process HTTP requests .
Creates a new file .
Instantiates and installs the RDF files .
Create a new server instance .
Change the privileges for the user
Create resources
Transforms the given string to the given dir and dir .
Search for a specific type .

Get all kandi verified functions for this library.

swiftiply Key Features

No Key Features are available at this moment for swiftiply.

swiftiply Examples and Code Snippets

No Code Snippets are available at this moment for swiftiply.

Community Discussions

Trending Discussions on Proxy

Does a web request with proxy always require a new connection?

Setting proxies when crawling websites with Python

Trusting individual invalid certs in mitmproxy

Execute SSIS package with Proxy - Could not get proxy data for Proxy_id

How to configure nginx to serve an angular app on / and proxy /api to another api server?

Make reverse TCP connection accept any amount of connections (like a normal TCP server)

Should transparent HTTP proxy remove hop HTTP headers?

Constant Error Trying to Use Proxy to Request IP via httpbin.org

Is it possible to run a javascript proxy that proxy the video's media request on the client side?

Does WebRTC Leak Your Real IP without User Interaction?

QUESTION

Does a web request with proxy always require a new connection?

Asked 2022-Mar-13 at 22:40

This is a question around how a proxy should behave with HTTPS requests. If there are 2 users behind a proxy and both go to https://example.com one after another, can the proxy reuse the existing TCP connection created with example.com earlier for user1.

Both TCP and HTTPS are different protocols, so it doesn't seem like it should affect anything, and in practice it doesn't as well.

Is there something in existing TLS implementations that might not like this kind of behavior of having two different sessions over the same connection? Would this be a bad idea from a security perspective to have the same TCP connection for different users?

...

ANSWER

Answered 2021-Aug-11 at 01:56

You mean if two HTTP clients make requests to a reverse HTTP proxy, could the proxy reuse TCP connections to the HTTP server?

Yes, absolutely. This is called connection pooling and it is common in practice. The proxy opens a pool of persistent connections with each backend endpoint. Then, the proxy queues requests and each request gets sent on an available TCP connection.

From a TLS perspective, if the proxy is an HTTP proxy (L7), clients perform TLS handshakes with the proxy, not the backend web servers and, hence, there's no problem. However, if the proxy operates at L4, TLS termination must occur downstream (TLS pass-through), which poses complication.

My current understanding is that L4 proxies maintain 1:1 connections with backends. Meaning, each incoming connection has a corresponding outgoing connection to a backend, which removes our ability to reuse connections and leverage connection pooling.

For example, NGINX does this:

NGINX maintains a “cache” of keepalive connections – a set of idle keepalive connections to the upstream servers – and when it needs to forward a request to an upstream, it uses an already established keepalive connection from the cache rather than creating a new TCP connection.

Load Balancing with NGINX and NGINX Plus, Part 2

Helpful resources

Introduction to modern network load balancing and proxying, Matt Klein
TLS termination proxy

Source https://stackoverflow.com/questions/68615189

QUESTION

Setting proxies when crawling websites with Python

Asked 2022-Mar-12 at 18:30

I want to set proxies to my crawler. I'm using requests module and Beautiful Soup. I have found a list of API links that provide free proxies with 4 types of protocols.

All proxies with 3/4 protocols work (HTTP, SOCKS4, SOCKS5) except one, and thats proxies with HTTPS protocol. This is my code:

...

ANSWER

Answered 2021-Sep-17 at 16:08

I did some research on the topic and now I'm confused why you want a proxy for HTTPS.

While it is understandable to want a proxy for HTTP, (HTTP is unencrypted) HTTPS is secure.

Could it be possible your proxy is not connecting because you don't need one?

I am not a proxy expert, so I apologize if I'm putting out something completely stupid.

I don't want to leave you completely empty-handed though. If you are looking for complete privacy, I would suggest a VPN. Both Windscribe and RiseUpVPN are free and encrypt all your data on your computer. (The desktop version, not the browser extension.)

While this is not a fully automated process, it is still very effective.

Source https://stackoverflow.com/questions/69064792

QUESTION

Trusting individual invalid certs in mitmproxy

Asked 2022-Mar-02 at 07:37

I use mitmproxy to gather intel from outbound AS2 (HTTP) requests leaving our network. The schema goes like this:

...

ANSWER

Answered 2022-Mar-02 at 07:37

It's been a while since I've tried to solve this using a custom addon and it seems to work fine so I'll share it here:

https://gist.github.com/jsmucr/24cf0859dd7c9bba8eb2817d7b0bf4b6

This approach has a bit of disadvantage and that's the fact that it doesn't check if the peer certificate changes.

Source https://stackoverflow.com/questions/70515761

QUESTION

Execute SSIS package with Proxy - Could not get proxy data for Proxy_id

Asked 2022-Feb-21 at 19:38

I am trying to execute an SSIS package using a Credential and Proxy - it works fine with a user with a SysAdmin role and we want to avoid using SysAdmin.

I have followed all the steps to create a Credential and Proxy and set up the permissions for the user in msdb and SSISDb tables and in the Security -> logins

I have followed the steps in the below links as a guide:-

Proxy -> properties -> Principals

When I run the job I get the below error - looks like a permission issue

Unable to start execution of step 1 (Reason: Could not get proxy data for proxy_id = 198_. The step failed.

What am I missing?

...

ANSWER

Answered 2022-Feb-21 at 19:37

As you mentioned in the comments, you are using an SQL Server login as a proxy account. While in the Microsoft documentation they mentioned that:

SQL Server Agent proxies use credentials to store information about Windows user accounts. The user-specified in the credential must have "Access this computer from the network" permission (SeNetworkLogonRight) on the computer on which SQL Server is running.

I suggest following one of the following articles to set up an SQL Server agent proxy:

Source https://stackoverflow.com/questions/71197909

QUESTION

How to configure nginx to serve an angular app on / and proxy /api to another api server?

Asked 2022-Jan-26 at 13:53

I am trying to configure a nginx Docker container to serve the Angular application on its root path (which works so far) and make the backend via a proxy on /api available.

I've read multiple threads on Stackoverflow and some blogs, but no configuration worked so far. If I call my app on / the Angular app works. When I try to call /api on the same url it gets redirected to / and shows no content -- I guess the Angular router got some route it cannot handle. But Nginx should catch that route before the Angular app gets called. How do I do that?

I am not sure what is wrong. Do you see the error in my config?

...

ANSWER

Answered 2022-Jan-26 at 13:32

I would use the syntax below to let Nginx know this comes before your generic location location /.

Source https://stackoverflow.com/questions/70864008

QUESTION

Make reverse TCP connection accept any amount of connections (like a normal TCP server)

Asked 2022-Jan-11 at 18:24

I'm trying to create a reverse proxy to a CONNECT-based HTTP proxy. The user who wants to use the proxy just treats machine A as an HTTP proxy. It works the following way:

machine B opens a TCP socket to machine A.
On machine A, a TCP socket is exposed on a port and all the incoming data is tunneled to machine B (io.Copy).
On machine B, all the data is tunneled to the local HTTP server and the socket to machine A.

Essentially this is a reverse-proxy behind an HTTP proxy. The reason it's this complex is because the HTTP proxy is behind NAT (on machine B) and therefore not accessible directly. The use case is being able to host an HTTP proxy behind a NAT.

Machine A tunnel (Go):

...

ANSWER

Answered 2022-Jan-10 at 19:54

When you do

Source https://stackoverflow.com/questions/70557765

QUESTION

Should transparent HTTP proxy remove hop HTTP headers?

Asked 2022-Jan-02 at 14:23

I read that HTTP proxy should be removing hop HTTP headers (https://www.freesoft.org/CIE/RFC/2068/143.htm)

It makes sense since some of these headers are connection-related.

The question is. Is this RFC applicable for explicit proxy only or should be it be done on transparent HTTP proxies too?

Just to give you an example. Let say a client does HTTP call and it has an explicit proxy set. However, there is a transparent proxy in the middle. So, the overall pipeline looks like that

...

ANSWER

Answered 2021-Dec-28 at 21:01

Transparent proxies don’t exist.

As far as the HTTP RFC is concerned, there is simply no such thing. The specification does not recognise the concept. A client (A) may connect to a server (C) to fetch or modify a resource, or it may connect to a proxy (B) to have the latter do so on its behalf. In the former case, the hop-by-hop headers regulate the connection between the client and the server; in the latter, they regulate the connection between the client and the proxy. If the proxy connects to the server to serve the request, it has to manage its own hop-by-hop headers for the proxy–server link.

Anything else you add beyond that is simply not a party to the protocol and its presence should not influence how it operates. Whether (A)’s connection to either (B) or (C) (or (B)’s connection to (C)) is mediated by something else is immaterial. All that matters is that when (A) chooses to send a request to (B), it should receive the same resource that it would if it chose to make a request to (C) directly. (B) or (C) don’t even have to be single hosts; they may themselves pass requests though any number of intermediary layers.

For all it matters, the ‘transparent proxy’ may as well be a SOCKS proxy, in which case it will not modify any HTTP headers at all, because it cannot even be sure whether what it forwards is HTTP in the first place.

Source https://stackoverflow.com/questions/70366013

QUESTION

Constant Error Trying to Use Proxy to Request IP via httpbin.org

Asked 2021-Dec-27 at 00:44

I've been looking around trying to find a solution, but nothing has worked. I have this code:

...

ANSWER

Answered 2021-Dec-27 at 00:44

Answer that worked

You need to remove the colon from proxy URL, the redundant one is before the user.

Another possibility (first answer)

I'm virtually sure that all problem is you've reached the limit of requests and the vendor forbids you to send more. You can test it with curl:

Source https://stackoverflow.com/questions/70490709

QUESTION

Is it possible to run a javascript proxy that proxy the video's media request on the client side?

Asked 2021-Dec-20 at 01:07

I have video files hosted on the CDN, the video file is encrypted. So I need the decrypt it before play it in the browser. But the web video tag has no interface to modify the media stream.

So I want to run a proxy in the client side with javascript to proxy the media stream request, and decrypt the stream before feet to the video tag.

Is it possible?

By math-chen's answer, I have tryed below code, but when I paly it, the video keep spin and not render the frame like below image.

I use a very small unencrypted video file out.mp4, so it can be loaded by once.

...

ANSWER

Answered 2021-Dec-17 at 09:29

it does not need a proxy

Source https://stackoverflow.com/questions/70390112

QUESTION

Does WebRTC Leak Your Real IP without User Interaction?

Asked 2021-Nov-16 at 18:59

It has been discussed many times on Stackoverflow that by default WebRTC technology leaks your real IP even if your using a proxy to browse the web. What I haven't seen discussed is whether this requires the end user to click a button to enable this kind of leak or whether the leak occurs regardless of any action taken by the user.

For example, when you go to Express VPN they require you press a button to test for WebRTC leak. My question is - is this done for privacy reasons or somehow the button activates WebRTC tech so it can leak your IP?

In other words, assuming you never need to use WebRTC tech (just browser a blog or eCommerce shop) and all you do is click a few links - can a website still detect your real IP through WebRTC?

Thanks

...

ANSWER

Answered 2021-Nov-16 at 18:59

Yes, a browser can detect your public IP address using WebRTC.

No, the leak is not reliant on your button interaction.

Recently, I found an unpatched github repo webrtc-ip, which can leak a user's public IP address using WebRTC. This is powerful because you cannot trace it, as nothing is shown in the Networks tab.

Sadly, this leak does not work for private IPs, due to the gradual shift to mDNS (at least for WebRTC), which is described completely in this great blog. Anyways,a here's a working demo:

https://webrtc-ip.herokuapp.com/

I am not sure if this leaks your true IP address even if you are using a proxy, but feel free to test it out.

Source https://stackoverflow.com/questions/69968104

Community Discussions, Code Snippets contain sources that include Stack Exchange Network

Vulnerabilities

No vulnerabilities reported

Install swiftiply

You can download it from GitHub.
On a UNIX-like operating system, using your system’s package manager is easiest. However, the packaged Ruby version may not be the newest one. There is also an installer for Windows. Managers help you to switch between multiple Ruby versions on your system. Installers can be used to install a specific or multiple Ruby versions. Please refer ruby-lang.org for more information.

Support

For any new features, suggestions and bugs create an issue on GitHub. If you have any questions check and ask questions on community page Stack Overflow .

Find more information at: