O

Services

Case studies

Contact

23.02.22

Learning prompts for language models

featured image thumbnail for post Learning prompts for language models

Write a short summary of language model prompting techniques:

One of the exciting outcomes from the recent wave of progress in NLP was the ability to train models using a prompt. Rather than using a large labelled dataset to train a model about film reviews, it is possible to use a prompt like Is the following movie review positive or negative?” before the input sequence, “This movie was amazing!”".

However, the problem with this is that choosing your prompt can have a large impact of performance. A new paper from Google AI suggests a new approach, they call 'prompt tuning'. Using this model, prompts are represented using a vector and the best performing one is learnt from the data. It still allows learning with a small dataset, but performance is improved without the need for hand writing of prompts.

←Previous: How does a data business work?

Next: A visual introduction to machine learning→


Keep up with the latest developments in data science. One email per month.

ortom logoortom logoortom logoortom logo

©2025

LINKEDIN

CLUTCH.CO

TERMS & PRIVACY