PB Unity commited on
Commit
74725fe
1 Parent(s): e4042e9

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +23 -0
README.md CHANGED
@@ -1,3 +1,26 @@
1
  ---
 
2
  license: apache-2.0
 
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ pipeline_tag: object-detection
3
  license: apache-2.0
4
+ library_name: unity-sentis
5
  ---
6
+
7
+ # Iris Landmark from Google Mediapipe validated for Unity Sentis
8
+ This is the [Iris Landmark model](https://github.com/google/mediapipe/blob/master/docs/solutions/iris.md) from Google in the Sentis format.
9
+
10
+ The model detects 3D markers on and around a centered image of an eye. You could use these markers, to detect eye movements.
11
+
12
+ **IMPORTANT:** The eye needs to be centered and cropped to fit the image showing a region around the eye. For images with faces not in the center or for multiple faces, you will need another model to detect faces, and crop them before feeding them into this model. For example you could use [Blaze Face](https://huggingface.co/unity/sentis-blaze-face) to detect them
13
+ Then you can use the [face landmark](https://huggingface.co/unity/sentis-face-landmarks) model to single out the eye region to send to this model.
14
+
15
+ ## How to Use
16
+ * Create a new scene in Unity 2023
17
+ * Put the face_landmark.sentis file in the `Assets/StreamingAssets` folder
18
+ * Put a video in the `Assets/StreamingAssets` folder and set `videoName` variable to the video name
19
+ * Create a RawImage and place it in your scene. Link to this image in the `previewUI` field.
20
+
21
+ ## Preview
22
+ If you get it working it should look like this (original image from pexels.com):
23
+ ![image showing markers](preview_iris_landmark.png)
24
+
25
+ ## License
26
+ All Google Mediapipe models are open source under the Apache 2.0 license. The accompanying C# source code we provide can be used in your applications for commercial purposes.