ucalyptus (Sayantan Das)

upvoted an article 22 days ago

Article

Uncensor any LLM with abliteration

By

•

13 days ago

• 223

upvoted 2 collections 27 days ago

Mistral Bangla

Collection

A collection of Bangla Mistral 7B models fine-tuned for context-based question answering and Bengali retrieval-augmented generation. • 5 items • Updated May 25 • 1

Bangla Llama

Collection

A collection of Bangla Llama 3 8B models fine-tuned for context-based question answering and Bengali retrieval-augmented generation. • 6 items • Updated May 26 • 3

upvoted 2 papers 28 days ago

Your Transformer is Secretly Linear

Paper • 2405.12250 • Published May 19 • 142

Executable Code Actions Elicit Better LLM Agents

Paper • 2402.01030 • Published Feb 1 • 22

upvoted 2 articles about 1 month ago

Article

Unlocking Longer Generation with Key-Value Cache Quantization

May 16

• 17

Article

Synthetic dataset generation techniques: generating custom sentence similarity data

By

•

May 23

• 12

upvoted a collection about 1 month ago

🚀GGUF

Collection

Llama.cpp compatible models, can be used on CPUs and GPUs! • 666 items • Updated about 5 hours ago • 24

upvoted 4 articles about 1 month ago

Article

Hugging Face x LangChain : A new partner package in LangChain

May 14

• 82

Article

Train custom AI models with the trainer API and adapt them to 🤗

By

•

25 days ago

• 24

Article

Making LLMs even more accessible with bitsandbytes, 4-bit quantization and QLoRA

May 24, 2023

• 48

Article

Hugging Face + Google Visual Blocks

By

•

May 16

• 20

upvoted a collection about 2 months ago

Prem

Collection

Finetunes and Quantizations of the Prem LLMs • 11 items • Updated May 13 • 2

upvoted an article about 2 months ago

Article

Merge Large Language Models with mergekit

By

•

Jan 9

• 37

upvoted a collection about 2 months ago

fuck quadratic attention

Collection

11 items • Updated Apr 24 • 20

upvoted 4 papers about 2 months ago

CLLMs: Consistency Large Language Models

Paper • 2403.00835 • Published Feb 28 • 3

A Primer on the Inner Workings of Transformer-based Language Models

Paper • 2405.00208 • Published Apr 30 • 10

Can Large Language Models be Trusted for Evaluation? Scalable Meta-Evaluation of LLMs as Evaluators via Agent Debate

Paper • 2401.16788 • Published Jan 30 • 1

Octopus v4: Graph of language models

Paper • 2404.19296 • Published Apr 30 • 115

upvoted an article 2 months ago

Article

Introducing Idefics2: A Powerful 8B Vision-Language Model for the community

Apr 15

• 144

upvoted 2 papers 2 months ago

PoSE: Efficient Context Window Extension of LLMs via Positional Skip-wise Training

Paper • 2309.10400 • Published Sep 19, 2023 • 23

Llama 2: Open Foundation and Fine-Tuned Chat Models

Paper • 2307.09288 • Published Jul 18, 2023 • 235

upvoted an article 2 months ago

Article

LLM Comparison/Test: Llama 3 Instruct 70B + 8B HF/GGUF/EXL2 (20 versions tested and compared!)

By

•

Apr 24

• 51

upvoted a paper 2 months ago

Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone

Paper • 2404.14219 • Published Apr 22 • 239

upvoted 3 articles 2 months ago

Article

AI Apps in a Flash with Gradio's Reload Mode

Apr 16

• 17

Article

Towards Encrypted Large Language Models with FHE

Aug 2, 2023

• 6

Article

Fine-tune Llama 3 with ORPO

By

•

Apr 22

• 202

upvoted a paper 2 months ago

Learning to Route Among Specialized Experts for Zero-Shot Generalization

Paper • 2402.05859 • Published Feb 8 • 5

upvoted 2 collections 3 months ago

Zephyr ORPO

Collection

Models and datasets to align LLMs with Odds Ratio Preference Optimisation (ORPO). Recipes here: https://github.com/huggingface/alignment-handbook • 3 items • Updated Apr 12 • 15

SDXL LoRA

Collection

A few SDXL-LoRA models I've trained • 20 items • Updated Jan 22 • 6

upvoted an article 3 months ago

Article

CodeGemma - an official Google release for code LLMs

Apr 9

• 98

upvoted 10 papers 3 months ago

Mixture-of-Depths: Dynamically allocating compute in transformer-based language models

Paper • 2404.02258 • Published Apr 2 • 102

Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Prediction

Paper • 2404.02905 • Published Apr 3 • 61

LLaVA-Gemma: Accelerating Multimodal Foundation Models with a Compact Language Model

Paper • 2404.01331 • Published Mar 29 • 22

H2O-Danube-1.8B Technical Report

Paper • 2401.16818 • Published Jan 30 • 16

The Unreasonable Ineffectiveness of the Deeper Layers

Paper • 2403.17887 • Published Mar 26 • 75

PERL: Parameter Efficient Reinforcement Learning from Human Feedback

Paper • 2403.10704 • Published Mar 15 • 56

upvoted a collection 3 months ago

DRAGON Models

Collection

Production-grade RAG-optimized 6-7B parameter models - "Delivering RAG on ..." the leading foundation base models • 11 items • Updated Feb 3 • 42

upvoted 3 papers 3 months ago

RAFT: Adapting Language Model to Domain Specific RAG

Paper • 2403.10131 • Published Mar 15 • 65

KTO: Model Alignment as Prospect Theoretic Optimization

Paper • 2402.01306 • Published Feb 2 • 11

Evolutionary Optimization of Model Merging Recipes

Paper • 2403.13187 • Published Mar 19 • 47

upvoted 6 papers 4 months ago

WebArena: A Realistic Web Environment for Building Autonomous Agents

Paper • 2307.13854 • Published Jul 25, 2023 • 20

IndicVoices: Towards building an Inclusive Multilingual Speech Dataset for Indian Languages

Paper • 2403.01926 • Published Mar 4 • 1

Unifying Vision, Text, and Layout for Universal Document Processing

Paper • 2212.02623 • Published Dec 5, 2022 • 10

The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bits

Paper • 2402.17764 • Published Feb 27 • 572

BitNet: Scaling 1-bit Transformers for Large Language Models

Paper • 2310.11453 • Published Oct 17, 2023 • 94

Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Models

Paper • 2402.17177 • Published Feb 27 • 88

upvoted a collection 4 months ago

Data-efficient LLMs

Collection

dataset pruning for advancing the capabilities of LLMs • 26 items • Updated 24 days ago • 1

upvoted 6 papers 4 months ago

Datasets for Large Language Models: A Comprehensive Survey

Paper • 2402.18041 • Published Feb 28 • 2

Unmasking Deepfakes: Masked Autoencoding Spatiotemporal Transformers for Enhanced Video Forgery Detection

Paper • 2306.06881 • Published Jun 12, 2023 • 1

FaceForensics++: Learning to Detect Manipulated Facial Images

Paper • 1901.08971 • Published Jan 25, 2019 • 1

Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference time

Paper • 2203.05482 • Published Mar 10, 2022 • 5

Synthetic Data (Almost) from Scratch: Generalized Instruction Tuning for Language Models

Paper • 2402.13064 • Published Feb 20 • 46

LongRoPE: Extending LLM Context Window Beyond 2 Million Tokens

Paper • 2402.13753 • Published Feb 21 • 106

upvoted 2 collections 4 months ago

Papers about model merging

Collection

referenced in the mergekit repo: https://github.com/cg123/mergekit • 4 items • Updated Feb 13 • 13

Model Merging Papers

Collection

Collection of relevant papers about model merging • 13 items • Updated Apr 2 • 5

Sayantan Das

AI & ML interests

Organizations

ucalyptus's activity

Uncensor any LLM with abliteration

Unlocking Longer Generation with Key-Value Cache Quantization

Synthetic dataset generation techniques: generating custom sentence similarity data

Hugging Face x LangChain : A new partner package in LangChain

Train custom AI models with the trainer API and adapt them to 🤗

Making LLMs even more accessible with bitsandbytes, 4-bit quantization and QLoRA

Hugging Face + Google Visual Blocks

Merge Large Language Models with mergekit

Introducing Idefics2: A Powerful 8B Vision-Language Model for the community

LLM Comparison/Test: Llama 3 Instruct 70B + 8B HF/GGUF/EXL2 (20 versions tested and compared!)

AI Apps in a Flash with Gradio's Reload Mode

Towards Encrypted Large Language Models with FHE

Fine-tune Llama 3 with ORPO

CodeGemma - an official Google release for code LLMs