<aside> <img src="/icons/list_gray.svg" alt="/icons/list_gray.svg" width="40px" /> Contents

</aside>

<aside> <img src="/icons/username_gray.svg" alt="/icons/username_gray.svg" width="40px" /> Contact with suggestions for additional prompts to illustrate various model properties.

</aside>

What to learn

Working through this task should help you get a sense of the capabilities of generative AI using Large Language Models (LLMs).

Chatbot Arena is a public service to compare the quality of various LLMs. These models power various apps such as ChatGPT or Elicit.

Models respond to prompts and different prompts give different results. We give you some suggested prompts you can paste in. You should get an early sense of what kinds of prompts produce what results. You will see more options in other tasks.

What to do

<aside> <img src="/icons/cursor-click_gray.svg" alt="/icons/cursor-click_gray.svg" width="40px" /> Click on the triangle next to each step to see more details and/or get resources necessary for the task.

</aside>

Step 1: Go to https://lmarena.ai and try different prompts

  1. Enter prompts (see below)
  2. For each prompt try:
    1. Regenerate button to compare the same models across times
    2. New round with the same prompt to compare different models

Untitled

Step 2: Enter suggested prompts and compare models.

<aside> <img src="/icons/attachment_gray.svg" alt="/icons/attachment_gray.svg" width="40px" /> You can also put in prompts of your own but to start follow the progressions with these prompts. They were selected to illustrate both model strengths and weaknesses.

</aside>

<aside> <img src="/icons/cursor-click_gray.svg" alt="/icons/cursor-click_gray.svg" width="40px" /> To copy the prompt, hover over the text and then click the ‘copy’ button in the top right hand corner of the grey prompt box.

</aside>