bsdiff | Automatically exported from code.google.com/p/bsdiff | Runtime Evironment library

I have to compare using Spark-based big data analysis data sets (text files) that are very similar (>98%) but with very large sizes. After doing some research, I found that most efficient way could be to use delta encoders. With this I can have a reference text and store others as delta increments. However, I use Scala that does not have support for delta encoders, and I am not at all conversant with Java. But as Scala is interoperable with Java, I know that it is possible to get Java lib work in Scala.

I found the promising implementations to be xdelta, vcdiff-java and bsdiff. With a bit more searching, I found the most interesting library, dez. The link also gives benchmarks in which it seems to perform very well, and code is free to use and looks lightweight.

At this point, I am stuck with using this library in Scala (via sbt). I would appreciate any suggestions or references to navigate this barrier, either specific to this issue (delata encoders), library or in working with Java API in general within Scala. Specifically, my questions are:

1. Is there a Scala library for delta encoders that I can directly use? (If not)

2. Is it possible that I place the class files/notzed.dez.jar in the project and let sbt provide the APIs in the Scala code?

I am kind of stuck in this quagmire and any way out would be greatly appreciated.

I would like to use bsdiff into c++ project by external links.

So I have to build a static link. I can do that with ar rcs bsdiff.a bsdiff.o But there is already a main function. So When I link bsdiff.a to my cpp build and build it, I have redefinition of main function.

So how avoid the main function ?

(I already try to comment bsdiff_CFLAGS = -DBSDIFF_EXECUTABLE into Makefile.am but get undefined reference to main function)

I am looking for an executable (or a library that I might embed in C# or via Managed C++ into the C# project) to create binary diff files for two folders and their contents and a patch tool to apply those patch files as well targeting Windows.

This SO post refers to various tools such as bsdiff/bspatch which is highly dated. The 3rd party executable that is available here does not work when trying it out though. Another variant that is not compatible with the original is the following. Unfortunately it relies on bzlib and certain Linux headers and I wasn't really able to set it up accordingly under Visual Studio.

Anyways, all tools and posts are about 8-10 years old and I'd like to know which tools and libraries are currently maintained that I might take a look at.

I recently read about that Google is using File-by-File Patching and another one algorithm BsDiff - Delta update which patches apk files and gives only update sized apk to download from Play Store.

I went through below blogs and links:

1) https://android-developers.googleblog.com/2016/12/saving-data-reducing-the-size-of-app-updates-by-65-percent.html

2) https://github.com/andrewhayden/archive-patcher/blob/master/README.md for "File-by-File Patching"

3) https://android-developers.googleblog.com/2016/07/improvements-for-smaller-app-downloads.html for "BsDiff" patching

I installed BsDiff on my Linux and applied it on old and new apk but it remains the same size of the app and also while I update it on Play Store, it shows full size as at the time of install.

Also, I downloaded "File-by-File Patching" code and made apk through it and updated it on Play Store but the same, no reduced size of apk.

So, If anybody who has done this or know about this, Please give your answer so I can make my app update of reduced size app update on Play Store.