speech-transformer | Transformer framework speciaized in speech recognition | Speech library
kandi X-RAY | speech-transformer Summary
kandi X-RAY | speech-transformer Summary
Transformer framework speciaized in speech recognition tasks using Pytorch.
Support
Quality
Security
License
Reuse
Top functions reviewed by kandi - BETA
- Performs the forward computation
- Calculate successor
- Performs a forward step
- Get the non - padding mask
- Returns a list of the predicted sentences
- Takes a sequence of y_hats
- Given a sequence of attn
- Returns True if all tasks are finished
- Inflate tensor
- Forward computation
speech-transformer Key Features
speech-transformer Examples and Code Snippets
Community Discussions
Trending Discussions on speech-transformer
QUESTION
github: https://github.com/sephiroce/tfsr/tree/exprimental
I'm trying to reproduce recognition accuracies described in the speech transformer paper [1]. The attention penalty is a technique I could not fully understand. This is the description of the attention penalty in the paper.
"In addition, we encouraged the model attending to closer positions by adding bigger penalty on the attention weights of more distant position-pairs."
I understood as it means adding smaller negative values for more away from the diagonal on scaled attention logits (before masking) except for the first multi-head attention in decoders.
This is a code snippet for computing attention weights.
...ANSWER
Answered 2020-Jan-13 at 10:33I think you understand it well. They probably did a stripe around the diagonal, something like:
Community Discussions, Code Snippets contain sources that include Stack Exchange Network
Vulnerabilities
No vulnerabilities reported
Install speech-transformer
You can use speech-transformer like any standard Python library. You will need to make sure that you have a development environment consisting of a Python distribution including header files, a compiler, pip, and git installed. Make sure that your pip, setuptools, and wheel are up to date. When using pip it is generally recommended to install packages in a virtual environment to avoid changes to the system.
Support
Reuse Trending Solutions
Find, review, and download reusable Libraries, Code Snippets, Cloud APIs from over 650 million Knowledge Items
Find more librariesStay Updated
Subscribe to our newsletter for trending solutions and developer bootcamps
Share this Page