Examples
Last updated
Last updated
In the last section we learned the difference between a field, its reference, and its value.
Now let's talk about "examples."
Intuitively, examples are what you use to evaluate prompts. They are also what you use to fine-tune a model.
If you picture a typical spreadsheet where you have multiple columns and rows of data, each row of data is one example. Each cell in the row is a field value in Entry Point terminology.
An example includes values for both inputs and outputs.
Templates are used to format examples. That makes it very easy to test different formatting on your data without modifying the actual data itself. This is important because formatting can have an outsize impact on model performance. At Entry Point, we think of formatting as important as any other fine-tuning hyperparameter.
Now let's put templates, fields, and examples together.
Let's say we need a model that will generate a word that is the opposite of whatever word we enter.
We would create two fields of type text
:
Input Word (reference: input_word
)
Output Word (reference: output_word
)
Then, we would write a template:
Template Part | Content |
---|---|
Finally, we need examples, which contain the concrete datapoints to replace the references above.
We would write a few examples:
Each row above is one example.
Input Word | Output Word |
---|---|
System Prompt
Based on the following word, come up with a word that is most opposite to it. Only respond with a single word.
User Prompt
{input_word}
Assistant Output
{output_word}
hot
cold
near
far
wet
dry
high
low