Zheng Zian(Andy)'s picture

Zheng Zian(Andy)

OrionZheng

·

https://zheng-zian-andy.com

AI & ML interests

LLM, Mixture-of-Experts, Data-Centric AI

Recent Activity

new activity 22 days ago

OrionZheng/openmoe-8b:Model source code

liked a dataset 4 months ago

MixEval/MixEval-X

authored a paper 4 months ago

OpenMoE: An Early Effort on Open Mixture-of-Experts Language Models

View all activity

Organizations

None yet

OrionZheng's activity

New activity in OrionZheng/openmoe-8b 22 days ago

Model source code

#2 opened 22 days ago by

New activity in OrionZheng/openmoe-8b 7 months ago

model_type "llama"

#1 opened 7 months ago by

New activity in reflectio/gemma-2b-wildchat-offload 7 months ago

Update config.json

#1 opened 7 months ago by

New activity in reflectio/AdaVocab-Gemma-2b-1024 7 months ago

Update ada_vocab_factory.py

#1 opened 7 months ago by

New activity in hpcai-tech/openmoe-base 12 months ago

convert t5x into pytorch model

#1 opened about 1 year ago by

New activity in shareAI/ShareGPT-Chinese-English-90k over 1 year ago

Fixed some data in bad format

#6 opened over 1 year ago by

New activity in allenai/peS2o over 1 year ago

Is there any overlap between peS2o dataset and the arxiv subset from Redpajama?

#2 opened over 1 year ago by

New activity in liwu/MNBVC over 1 year ago

Add snippet to locate errors in the data files

#3 opened over 1 year ago by

New activity in bigcode/starcoderdata over 1 year ago

How to obtain the original git-commits dataset?

#5 opened over 1 year ago by

New activity in bigcode/the-stack-dedup over 1 year ago

Confusion and Discrepancy Regarding Deduplication Versions and Dataset Sizes

#26 opened over 1 year ago by

New activity in wordcab/llama-natural-instructions-13b almost 2 years ago

Cannot run the inference on the playground

#1 opened almost 2 years ago by

New activity in mutiyama/alt almost 2 years ago

Error while loading "alt-parallel" config: TypeError: Couldn't cast array

#3 opened almost 2 years ago by

albertvillanova

🚩 Report

#2 opened almost 2 years ago by