Hugging Face's logo
Joshua Rosenkranz's picture
5 1 2

Joshua Rosenkranz

JRosenkranz
GigaBoy's profile picture CircusPtr's profile picture dfbdokk's profile picture
·

AI & ML interests

None yet

Recent Activity

new activity 26 days ago
ibm-ai-platform/llama3-8b-accelerator:Unexpectedly Large Memory Usage of ibm-fms/llama3-8b-accelerator in vLLM
published an article about 2 months ago
Bamba: Inference-Efficient Hybrid Mamba2 Model
new activity 4 months ago
ibm-granite/granite-20b-code-instruct-accelerator:r1.1
View all activity

Organizations

IBM's profile picture ibm-ai-platform's profile picture LLHF's profile picture SLLHF's profile picture blhf's profile picture nltpt's profile picture

JRosenkranz's activity

New activity in ibm-ai-platform/llama3-8b-accelerator 26 days ago

Unexpectedly Large Memory Usage of ibm-fms/llama3-8b-accelerator in vLLM

1
#4 opened about 2 months ago by
baizhuoyan
New activity in ibm-granite/granite-20b-code-instruct-accelerator 4 months ago

r1.1

1
#3 opened 4 months ago by
sahilsuneja
New activity in ibm-ai-platform/llama3-8b-accelerator 9 months ago

ValueError: Unsupported model type mlp_speculator using TGI server

2
#2 opened 9 months ago by
rishabh-simpplr
New activity in ibm-ai-platform/granite-7b-lab-accelerator 9 months ago

Error: prefill failed

4
#1 opened 9 months ago by
ulrichkr
New activity in ibm-ai-platform/llama3-8b-accelerator 9 months ago

shard 0 never ready when given the speculator option?

7
#1 opened 9 months ago by
mhill4980

shard 0 never ready when given the speculator option?

7
#1 opened 9 months ago by
mhill4980
New activity in ibm-ai-platform/granite-7b-lab-accelerator 9 months ago

Error: prefill failed

4
#1 opened 9 months ago by
ulrichkr
New activity in ibm-ai-platform/llama3-8b-accelerator 9 months ago

shard 0 never ready when given the speculator option?

7
#1 opened 9 months ago by
mhill4980
New activity in ibm-ai-platform/granite-7b-lab-accelerator 9 months ago

Error: prefill failed

4
#1 opened 9 months ago by
ulrichkr