Commit History
Update tokenizer.py
3901bef
verified
fix
8e5d4e2
oweller2
commited on
tokenizer
5448b02
oweller2
commited on
working
3807a72
oweller2
commited on
add back in
358a4d5
oweller2
commited on
test
26eb98d
oweller2
commited on
tokenizer
74aad37
oweller2
commited on
switch back to pad
0c3adcf
oweller2
commited on
pad
ecbaeab
oweller2
commited on
back to 5k
12340ec
oweller2
commited on
back to 8999
2269552
oweller2
commited on
done
2d5427f
oweller2
commited on
fix tok
082b6b3
oweller2
commited on
back to unpad:
8efbef0
oweller2
commited on
unpad
3cd88d6
oweller2
commited on
unpad
0f166fe
oweller2
commited on
unpad
27bdfe2
oweller2
commited on
fix
11a83af
oweller2
commited on
fix
f5a1962
oweller2
commited on
fix
a2fbe7f
oweller2
commited on
fix
c290a82
oweller2
commited on
fix
9bfde91
oweller2
commited on
fix
1400590
oweller2
commited on
pad
0b90701
oweller2
commited on
try again
9e4ff15
oweller2
commited on
udpdate
f66abc1
oweller2
commited on
update
6d1817e
oweller2
commited on
update
0b86b9b
oweller2
commited on
update
527bd0b
oweller2
commited on
done
101cdd7
oweller2
commited on
minor
e9e8f85
oweller2
commited on
no pad at inference
46797c8
oweller2
commited on
no unpad at inference
81b671b
oweller2
commited on
try unpadding in inferece
b9219f0
oweller2
commited on
8994
322b01b
oweller2
commited on
2999
5b5a913
oweller2
commited on
update to base
205a91f
oweller2
commited on
large
b4b3457
oweller2
commited on
update model
a9730e6
oweller2
commited on
modeling
a00859f
oweller2
commited on
update
1f61dbc
oweller2
commited on
breakpoint
3cd62e1
oweller2
commited on
start again
e8046aa
oweller2
commited on
same as training code
e1a243a
oweller2
commited on
update model
d831694
oweller2
commited on
add
7561dc4
oweller2
commited on
push
bfd1777
oweller2
commited on
pad
52d5cfa
oweller2
commited on
break
4d05aa0
oweller2
commited on