EDIA: how to use >
EDIA es un proyecto de la Fundación Vía Libre whose goal is to engage more people in the evaluation
of artificial intelligence technologies, such as language models.
Below, we explain how to use EDIA in a short video.
1- Ingresá a la herramienta
https://edia.ngrok.app
2- Explorá las siguientes pestañas:
- Common Phrases
- LLM vía EDIA
- Ambiguous References
- Cultural Questions
- Stereotype Validator
The goal is to find out whether language models understand the meaning of these common phrases or whether they make up answers.
The following video is in Spanish; you can turn on subtitles.
The following video is in Spanish; you can turn on subtitles.
You will see two images side by side. Write an ambiguous or biased question about them — one that implicitly favors one image over the other (e.g., “Which one looks cleaner?”).
Then select which image is the expected biased answer: Left or Right.
The following video is in Spanish; you can turn on subtitles.
Please add multiple-choice questions that only someone from your region would be able to answer.
For each question, provide the question text, several reasonable answer options, and indicate the correct answer.
The following video is in Spanish; you can turn on subtitles.
Evaluate each association and, optionally, suggest related nationalities or attributes. Each submission moves on to a new data point.