Example PR: Using 2048 as example dim. DO NOT MERGE
#30
by
michaelfeil
- opened
Load with --revision refs/pr/30 to use this PR
e.g.
docker run \
--gpus "0" -p "7997":"7997" \
michaelf34/infinity:latest \
v2 --model-id dunzhang/stella_en_400M_v5 --revision "refs/pr/30" --dtype bfloat16 --batch-size 16 --device cuda --engine torch --port 7997 --no-bettertransformer
DO NOT MERGE
michaelfeil
changed pull request title from
Example PR: Using 2048 as
to Example PR: Using 2048 as example dim. DO NOT MERGE
infgrad
changed pull request status to
merged
@infgrad Please do not merge this PR