What is scheduled sampling? Improving sequence prediction in RNNs
Impossible d'ajouter des articles
Échec de l’élimination de la liste d'envies.
Impossible de suivre le podcast
Impossible de ne plus suivre le podcast
What is scheduled sampling? Improving sequence prediction in RNNs
-
Lu par :
-
De :
À propos de cette écoute
In this episode, we explore how Scheduled Sampling helps Recurrent Neural Networks (RNNs) make better predictions for tasks like machine translation and image captioning. Normally, during training, RNNs use the actual previous word or token to predict the next one. But when making predictions, the model has to use its own previous predictions, which can lead to mistakes building up. Scheduled Sampling solves this by slowly shifting the model from using the correct token during training to using its own predictions, helping it learn more effectively and reduce errors. Tune in to learn how this approach helped improve results in a major image captioning competition!
Link to research paper-
https://arxiv.org/abs/1506.03099
Follow us on social media:
Linkedin: https://www.linkedin.com/company/smallest/
Twitter: https://x.com/smallest_AI
Instagram: https://www.instagram.com/smallest.ai/
Discord: https://smallest.ai/discord
Vous êtes membre Amazon Prime ?
Bénéficiez automatiquement de 2 livres audio offerts.Bonne écoute !