Resolving Gender Bias in AI

share link

by Ashok Balasubramanian dot icon Updated: Oct 2, 2021

technology logo
technology logo

Solution Kit Solution Kit  

Artificial Intelligence is widely prevalent in day-to-day tech today and is expected to become more pervasive in the future. While AI learns from and mimics its human trainers, given the learning it achieves in a shorter duration relative to a human and the learning solely based on data and models, AI can amplify certain behaviors in a relatively shorter time.

Of the multiple such issues, this collection focuses on gender bias. Traditional gender bias was most visible with occupational description. With expanding AI use, gender bias could reflect across information areas like social feeds, news feeds, to more critical areas like medical care decisions, to product design decisions like airbag safety.

As AI becomes pervasive and the potential for biases to potentially disrupt the use cases they serve, it becomes crucial for developers to identify and rectify any biases in their models. While the area is vast and there is significant ongoing work, kandi has shortlisted libraries that help you in recognizing and resolving gender bias.

Stand-alone Use Cases

If you are looking at simpler stand-alone use cases to experiment, gender-bias by gender-bias, catalyst-bias-correct by EskaleraInc, bias-detector by intuit, catalyst-slack-service by willowtreeapps, Gender-Bias-Visualization by GesaJo can help you with use cases from bias detection to visualization to NLP auto-correct plugins.

gender-biasby gender-bias

Python doticonstar image 70 doticonVersion:Currentdoticon
License: Permissive (MIT)

Reading for gender bias

Support
    Quality
      Security
        License
          Reuse

            gender-biasby gender-bias

            Python doticon star image 70 doticonVersion:Currentdoticon License: Permissive (MIT)

            Reading for gender bias
            Support
              Quality
                Security
                  License
                    Reuse

                      catalyst-bias-correctby EskaleraInc

                      Java doticonstar image 27 doticonVersion:Currentdoticon
                      License: Permissive (Apache-2.0)

                      A Slack Application that identifies and corrects unconscious gender bias in messages and conversations

                      Support
                        Quality
                          Security
                            License
                              Reuse

                                catalyst-bias-correctby EskaleraInc

                                Java doticon star image 27 doticonVersion:Currentdoticon License: Permissive (Apache-2.0)

                                A Slack Application that identifies and corrects unconscious gender bias in messages and conversations
                                Support
                                  Quality
                                    Security
                                      License
                                        Reuse

                                          bias-detectorby intuit

                                          Python doticonstar image 32 doticonVersion:0.0.12doticon
                                          License: Permissive (MIT)

                                          Support
                                            Quality
                                              Security
                                                License
                                                  Reuse

                                                    bias-detectorby intuit

                                                    Python doticon star image 32 doticonVersion:0.0.12doticon License: Permissive (MIT)

                                                    Support
                                                      Quality
                                                        Security
                                                          License
                                                            Reuse

                                                              catalyst-slack-serviceby willowtreeapps

                                                              Java doticonstar image 12 doticonVersion:Currentdoticon
                                                              License: Permissive (Apache-2.0)

                                                              Unconscious gender bias has been fueling the gender gap for far too long. We’re releasing the #BiasCorrect code in hopes that coders around the world will adapt it for whatever chat-based platforms they use in order to give more people access to this tool for change.

                                                              Support
                                                                Quality
                                                                  Security
                                                                    License
                                                                      Reuse

                                                                        catalyst-slack-serviceby willowtreeapps

                                                                        Java doticon star image 12 doticonVersion:Currentdoticon License: Permissive (Apache-2.0)

                                                                        Unconscious gender bias has been fueling the gender gap for far too long. We’re releasing the #BiasCorrect code in hopes that coders around the world will adapt it for whatever chat-based platforms they use in order to give more people access to this tool for change.
                                                                        Support
                                                                          Quality
                                                                            Security
                                                                              License
                                                                                Reuse
                                                                                  HTML doticonstar image 10 doticonVersion:Currentdoticon
                                                                                  no licences License: No License (null)

                                                                                  A website to visualize gender bias in language models

                                                                                  Support
                                                                                    Quality
                                                                                      Security
                                                                                        License
                                                                                          Reuse

                                                                                            Gender-Bias-Visualizationby GesaJo

                                                                                            HTML doticon star image 10 doticonVersion:Currentdoticonno licences License: No License

                                                                                            A website to visualize gender bias in language models
                                                                                            Support
                                                                                              Quality
                                                                                                Security
                                                                                                  License
                                                                                                    Reuse

                                                                                                      Coreference Resolution focused on Gender Bias

                                                                                                      If you are looking for coreference resolution focused on gender bias, try corefBias by uclanlp, winogender-schemas by rudinger.

                                                                                                      corefBiasby uclanlp

                                                                                                      CSS doticonstar image 51 doticonVersion:Currentdoticon
                                                                                                      License: Permissive (MIT)

                                                                                                      To analyze and remove gender bias in coreference resolution systems

                                                                                                      Support
                                                                                                        Quality
                                                                                                          Security
                                                                                                            License
                                                                                                              Reuse

                                                                                                                corefBiasby uclanlp

                                                                                                                CSS doticon star image 51 doticonVersion:Currentdoticon License: Permissive (MIT)

                                                                                                                To analyze and remove gender bias in coreference resolution systems
                                                                                                                Support
                                                                                                                  Quality
                                                                                                                    Security
                                                                                                                      License
                                                                                                                        Reuse
                                                                                                                          Python doticonstar image 20 doticonVersion:Currentdoticon
                                                                                                                          License: Permissive (MIT)

                                                                                                                          Data for evaluating gender bias in coreference resolution systems.

                                                                                                                          Support
                                                                                                                            Quality
                                                                                                                              Security
                                                                                                                                License
                                                                                                                                  Reuse

                                                                                                                                    winogender-schemasby rudinger

                                                                                                                                    Python doticon star image 20 doticonVersion:Currentdoticon License: Permissive (MIT)

                                                                                                                                    Data for evaluating gender bias in coreference resolution systems.
                                                                                                                                    Support
                                                                                                                                      Quality
                                                                                                                                        Security
                                                                                                                                          License
                                                                                                                                            Reuse

                                                                                                                                              Review of Models and Unsupervised Bias Validation

                                                                                                                                              For in-depth review of models, data, labels, domains, and unsupervised bias validation, try CausalMediationAnalysis by sebastianGehrmann, Balanced-Datasets-Are-Not-Enough by uvavision, unsupervised_gender_bias by anjalief, GeBNLP2019 by alfredomg.

                                                                                                                                              CausalMediationAnalysisby sebastianGehrmann

                                                                                                                                              Python doticonstar image 35 doticonVersion:Currentdoticon
                                                                                                                                              License: Permissive (MIT)

                                                                                                                                              Code for the paper "Causal Mediation Analysis for Interpreting Neural NLP: The Case of Gender Bias"

                                                                                                                                              Support
                                                                                                                                                Quality
                                                                                                                                                  Security
                                                                                                                                                    License
                                                                                                                                                      Reuse

                                                                                                                                                        CausalMediationAnalysisby sebastianGehrmann

                                                                                                                                                        Python doticon star image 35 doticonVersion:Currentdoticon License: Permissive (MIT)

                                                                                                                                                        Code for the paper "Causal Mediation Analysis for Interpreting Neural NLP: The Case of Gender Bias"
                                                                                                                                                        Support
                                                                                                                                                          Quality
                                                                                                                                                            Security
                                                                                                                                                              License
                                                                                                                                                                Reuse
                                                                                                                                                                  Python doticonstar image 19 doticonVersion:Currentdoticon
                                                                                                                                                                  no licences License: No License (null)

                                                                                                                                                                  [ICCV 2019] Balanced Datasets Are Not Enough: Estimating and Mitigating Gender Bias in Deep Image Representations

                                                                                                                                                                  Support
                                                                                                                                                                    Quality
                                                                                                                                                                      Security
                                                                                                                                                                        License
                                                                                                                                                                          Reuse

                                                                                                                                                                            Balanced-Datasets-Are-Not-Enoughby uvavision

                                                                                                                                                                            Python doticon star image 19 doticonVersion:Currentdoticonno licences License: No License

                                                                                                                                                                            [ICCV 2019] Balanced Datasets Are Not Enough: Estimating and Mitigating Gender Bias in Deep Image Representations
                                                                                                                                                                            Support
                                                                                                                                                                              Quality
                                                                                                                                                                                Security
                                                                                                                                                                                  License
                                                                                                                                                                                    Reuse
                                                                                                                                                                                      Python doticonstar image 5 doticonVersion:Currentdoticon
                                                                                                                                                                                      no licences License: No License (null)

                                                                                                                                                                                      Code for https://arxiv.org/pdf/2004.08361.pdf

                                                                                                                                                                                      Support
                                                                                                                                                                                        Quality
                                                                                                                                                                                          Security
                                                                                                                                                                                            License
                                                                                                                                                                                              Reuse

                                                                                                                                                                                                unsupervised_gender_biasby anjalief

                                                                                                                                                                                                Python doticon star image 5 doticonVersion:Currentdoticonno licences License: No License

                                                                                                                                                                                                Code for https://arxiv.org/pdf/2004.08361.pdf
                                                                                                                                                                                                Support
                                                                                                                                                                                                  Quality
                                                                                                                                                                                                    Security
                                                                                                                                                                                                      License
                                                                                                                                                                                                        Reuse

                                                                                                                                                                                                          GeBNLP2019by alfredomg

                                                                                                                                                                                                          Python doticonstar image 5 doticonVersion:Currentdoticon
                                                                                                                                                                                                          no licences License: No License (null)

                                                                                                                                                                                                          Accompanying code and data to the paper "Measuring Gender Bias in Word Embeddings across Domains and Discovering New Gender Bias Word Categories" by Kaytlin Chaloner and Alfredo Maldonado

                                                                                                                                                                                                          Support
                                                                                                                                                                                                            Quality
                                                                                                                                                                                                              Security
                                                                                                                                                                                                                License
                                                                                                                                                                                                                  Reuse

                                                                                                                                                                                                                    GeBNLP2019by alfredomg

                                                                                                                                                                                                                    Python doticon star image 5 doticonVersion:Currentdoticonno licences License: No License

                                                                                                                                                                                                                    Accompanying code and data to the paper "Measuring Gender Bias in Word Embeddings across Domains and Discovering New Gender Bias Word Categories" by Kaytlin Chaloner and Alfredo Maldonado
                                                                                                                                                                                                                    Support
                                                                                                                                                                                                                      Quality
                                                                                                                                                                                                                        Security
                                                                                                                                                                                                                          License
                                                                                                                                                                                                                            Reuse

                                                                                                                                                                                                                              Audit Models

                                                                                                                                                                                                                              A popular audit tool for your models is fairml by adebayoj.

                                                                                                                                                                                                                              fairmlby adebayoj

                                                                                                                                                                                                                              Python doticonstar image 308 doticonVersion:Currentdoticon
                                                                                                                                                                                                                              License: Others (Non-SPDX)

                                                                                                                                                                                                                              Support
                                                                                                                                                                                                                                Quality
                                                                                                                                                                                                                                  Security
                                                                                                                                                                                                                                    License
                                                                                                                                                                                                                                      Reuse

                                                                                                                                                                                                                                        fairmlby adebayoj

                                                                                                                                                                                                                                        Python doticon star image 308 doticonVersion:Currentdoticon License: Others (Non-SPDX)

                                                                                                                                                                                                                                        Support
                                                                                                                                                                                                                                          Quality
                                                                                                                                                                                                                                            Security
                                                                                                                                                                                                                                              License
                                                                                                                                                                                                                                                Reuse

                                                                                                                                                                                                                                                  See similar Kits and Libraries