SiLU or GLU activation?

#21

by JiaxinTsao - opened Mar 29

Mar 29

Databricks org Mar 29

Thanks @JiaxinTsao for the question -- closing htis comment as this was addressed now in the github issue!

hanlintang changed discussion status to closed Mar 29

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment