gchhablani commited on
Commit
82b495f
1 Parent(s): 16ddc80

Update usage

Browse files
Files changed (1) hide show
  1. sections/usage.md +7 -0
sections/usage.md CHANGED
@@ -0,0 +1,7 @@
 
 
 
 
 
 
 
 
1
+ - This demo loads the `FlaxCLIPVisionMBartforConditionlGeneration` present in the `model` directory of this repository. The checkpoint is loaded from `ckpt/ckpt-17499` which is pre-trained checkpoint with 17.5k steps. 100 random validation set examples are present in the `references.tsv` with respective images in the `images` directory.
2
+
3
+ - We provide `English Translation` of the generated caption and reference captions for users who are not well-acquainted with the other languages. This is done using `mtranslate` to keep things flexible enough and needs internet connection as it uses the Google Translate API. We will also add the original captions soon.
4
+
5
+ - The sidebar contains generation parameters such as `Number of Beams`, `Top-P`, `Temperature` which will be used when generating the caption.
6
+
7
+ - Lastly, one can choose the `Language` of the caption in the dropdown below to generate a caption in that particular language.