File size: 1,571 Bytes
9e4515d
 
0e74a15
ad807d7
9e4515d
81d1dbe
64e0d0d
0e74a15
8c26112
64e0d0d
 
 
 
bb0346d
64e0d0d
bb0346d
64e0d0d
fe74548
 
 
 
0173b7e
 
fe74548
0e74a15
 
 
64e0d0d
 
ad807d7
e7a84e7
 
3dc412b
 
bb0346d
fe74548
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
---
sdk: gradio
sdk_version: 5.41.1
app_file: gradio_launcher.py
---
# MedVQA

A CLI tool used for multiple MedVQA competitions:
[ImageCLEFmed-MEDVQA-GI-2025](https://github.com/simula/ImageCLEFmed-MEDVQA-GI-2025), [ImageCLEFmed-MEDVQA-GI-2026](https://github.com/simula/ImageCLEFmed-MEDVQA-GI-2026), [MediaEval-Medico-2025](https://github.com/simula/MediaEval-Medico-2025), and [MediaEval-Medico-2026](https://multimediaeval.github.io/editions/2026/tasks/medico/).

## Installation

```bash
pip install -U medvqa
```
The library is under heavy development. So, we recommend to always make sure you have the latest version installed.

For development:
```bash
pip install git+https://github.com/SushantGautam/MedVQA.git
```
Also has full_evaluate and challenge_evaluate modules for detailed evaluation for the competition organizers.


## Example Usage
Check respective competition repo for detailed submission instructions. For example: 
 [MediaEval-Medico-2025 competition repo](https://github.com/simula/MediaEval-Medico-2025#-submission-system).

```bash
medvqa validate_and_submit --competition=medico-2025 --task=1 --repo_id=...
# or for Medico 2026:
medvqa validate_and_submit --competition=medico-2026 --task=1 --repo_id=...
# or for MEDVQA-GI 2026:
medvqa validate_and_submit --competition=gi-2026 --task=1 --repo_id=...
```
where repo_id is your HuggingFace Model repo id (like SushantGautam/XXModelCheckpoint) with the submission script as required by the competition organizers, for eg, submission_task1.py file for task 1 and submission_task2.py for task 2.