spark-infotheoretic-feature-selection | package contains a generic implementation

 by   sramirez Scala Version: 1.4.0 License: Apache-2.0

kandi X-RAY | spark-infotheoretic-feature-selection Summary

kandi X-RAY | spark-infotheoretic-feature-selection Summary

spark-infotheoretic-feature-selection is a Scala library typically used in Big Data, Spark applications. spark-infotheoretic-feature-selection has no bugs, it has no vulnerabilities, it has a Permissive License and it has low support. You can download it from GitHub.

The present framework implements Feature Selection (FS) on Spark for its application on Big Data problems. This package contains a generic implementation of greedy Information Theoretic Feature Selection methods. The implementation is based on the common theoretic framework presented in [1]. Implementations of mRMR, InfoGain, JMI and other commonly used FS filters are provided. In addition, the framework can be extended with other criteria provided by the user as long as the process complies with the framework proposed in [1]. Please cite as: S. Ramírez-Gallego; H. Mouriño-Talín; D. Martínez-Rego; V. Bolón-Canedo; J. M. Benítez; A. Alonso-Betanzos; F. Herrera, "An Information Theory-Based Feature Selection Framework for Big Data Under Apache Spark," in IEEE Transactions on Systems, Man, and Cybernetics: Systems, in press, pp.1-13, doi: 10.1109/TSMC.2017.2670926 URL:
Support
    Quality
      Security
        License
          Reuse

            kandi-support Support

              spark-infotheoretic-feature-selection has a low active ecosystem.
              It has 123 star(s) with 47 fork(s). There are 17 watchers for this library.
              OutlinedDot
              It had no major release in the last 12 months.
              There are 1 open issues and 9 have been closed. On average issues are closed in 167 days. There are 2 open pull requests and 0 closed requests.
              It has a neutral sentiment in the developer community.
              The latest version of spark-infotheoretic-feature-selection is 1.4.0

            kandi-Quality Quality

              spark-infotheoretic-feature-selection has 0 bugs and 9 code smells.

            kandi-Security Security

              spark-infotheoretic-feature-selection has no vulnerabilities reported, and its dependent libraries have no vulnerabilities reported.
              spark-infotheoretic-feature-selection code analysis shows 0 unresolved vulnerabilities.
              There are 0 security hotspots that need review.

            kandi-License License

              spark-infotheoretic-feature-selection is licensed under the Apache-2.0 License. This license is Permissive.
              Permissive licenses have the least restrictions, and you can use them in most projects.

            kandi-Reuse Reuse

              spark-infotheoretic-feature-selection releases are available to install and integrate.
              Installation instructions are not available. Examples and code snippets are available.
              It has 1219 lines of code, 96 functions and 10 files.
              It has medium code complexity. Code complexity directly impacts maintainability of the code.

            Top functions reviewed by kandi - BETA

            kandi's functional review helps you automatically verify the functionalities of the libraries and avoid rework.
            Currently covering the most popular Java, JavaScript and Python libraries. See a Sample of spark-infotheoretic-feature-selection
            Get all kandi verified functions for this library.

            spark-infotheoretic-feature-selection Key Features

            No Key Features are available at this moment for spark-infotheoretic-feature-selection.

            spark-infotheoretic-feature-selection Examples and Code Snippets

            No Code Snippets are available at this moment for spark-infotheoretic-feature-selection.

            Community Discussions

            QUESTION

            SPARK 2.0: spark-infotheoretic-feature-selection java.lang.NoSuchMethodError: breeze.linalg.DenseMatrix
            Asked 2018-Mar-30 at 14:13

            I am trying to use MRMR feature of InfoGain third-party (https://github.com/sramirez/spark-infotheoretic-feature-selection) package of Spark. But my cluster is 2.0 and I am getting this exception. Even though I added all the required Jar files to spark class path. But still it is not working. Although it's working on local machine properly but not on cluster.

            Exception:

            ...

            ANSWER

            Answered 2018-Mar-30 at 14:13

            It was problem with the version of breeze. I was adding an old version breeze_2.11_0.11 and by changing it to breeze_2.11-0.13.2.jar solved the problem.

            Source https://stackoverflow.com/questions/49545814

            Community Discussions, Code Snippets contain sources that include Stack Exchange Network

            Vulnerabilities

            No vulnerabilities reported

            Install spark-infotheoretic-feature-selection

            You can download it from GitHub.

            Support

            For any new features, suggestions and bugs create an issue on GitHub. If you have any questions check and ask questions on community page Stack Overflow .
            Find more information at:

            Find, review, and download reusable Libraries, Code Snippets, Cloud APIs from over 650 million Knowledge Items

            Find more libraries
            CLONE
          • HTTPS

            https://github.com/sramirez/spark-infotheoretic-feature-selection.git

          • CLI

            gh repo clone sramirez/spark-infotheoretic-feature-selection

          • sshUrl

            git@github.com:sramirez/spark-infotheoretic-feature-selection.git

          • Stay Updated

            Subscribe to our newsletter for trending solutions and developer bootcamps

            Agree to Sign up and Terms & Conditions

            Share this Page

            share link