Hugging Face's logo
Adina Yakefu's picture
222 599 459

Adina Yakefu

AdinaY
umutphp's profile picture XuehangCang's profile picture JoPmt's profile picture
·

AI & ML interests

None yet

Recent Activity

reacted to Kseniase's post with 🔥 about 13 hours ago
15 types of attention mechanisms Attention mechanisms allow models to dynamically focus on specific parts of their input when performing tasks. In our recent article, we discussed Multi-Head Latent Attention (MLA) in detail and now it's time to summarize other existing types of attention. Here is a list of 15 types of attention mechanisms used in AI models: 1. Soft attention (Deterministic attention) -> https://huggingface.co/papers/1409.0473 Assigns a continuous weight distribution over all parts of the input. It produces a weighted sum of the input using attention weights that sum to 1. 2. Hard attention (Stochastic attention) -> https://huggingface.co/papers/1508.04025 Makes a discrete selection of some part of the input to focus on at each step, rather than attending to everything. 3. Self-attention -> https://huggingface.co/papers/1706.03762 Each element in the sequence "looks" at other elements and "decides" how much to borrow from each of them for its new representation. 4. Cross-Attention (Encoder-Decoder attention) -> https://huggingface.co/papers/2104.08771 The queries come from one sequence and the keys/values come from another sequence. It allows a model to combine information from two different sources. 5. Multi-Head Attention (MHA) -> https://huggingface.co/papers/1706.03762 Multiple attention “heads” are run in parallel.​ The model computes several attention distributions (heads), each with its own set of learned projections of queries, keys, and values. 6. Multi-Head Latent Attention (MLA) -> https://huggingface.co/papers/2405.04434 Extends MHA by incorporating a latent space where attention heads can dynamically learn different latent factors or representations. 7. Memory-Based attention -> https://huggingface.co/papers/1503.08895 Involves an external memory and uses attention to read from and write to this memory. See other types in the comments 👇
reacted to aifeifei798's post with 👀 1 day ago
一个加入水印的小程序 ```python from PIL import Image, ImageDraw, ImageFont def add_watermark(image): watermark_text = "AI Generated by DarkIdol FeiFei" # Ensure the input is an Image object if not isinstance(image, Image.Image): raise ValueError("Input must be a PIL Image object") width, height = image.size # Create a drawing object to draw on the image draw = ImageDraw.Draw(image) # Set the font size for the watermark text font_size = 10 # Set font size to 10 try: # Try to use a common font file font = ImageFont.truetype("Iansui-Regular.ttf", font_size) except IOError: # Use the default font if the specified font file is not found font = ImageFont.load_default() # Calculate the width and height of the watermark text using textbbox bbox = draw.textbbox((0, 0), watermark_text, font=font) text_width = bbox[2] - bbox[0] text_height = bbox[3] - bbox[1] # Calculate the position for the watermark text (bottom-right corner) x = width - text_width - 10 # 10 is the right margin y = height - text_height - 10 # 10 is the bottom margin # Add the watermark text to the image draw.text((x, y), watermark_text, font=font, fill=(255, 255, 255, 128)) # Return the modified image object return image ``` - 字体从https://fonts.google.com去找就可以了,程序都标注清楚了,自行修改
updated a Space 3 days ago
zh-ai-community/china-ai-policy-research
View all activity

Organizations

Hugging Face's profile picture Hugging Face Chinese Localization's profile picture Huggingface Projects's profile picture Blog-explorers's profile picture ICCV2023's profile picture Open LLM Leaderboard's profile picture huggingPartyParis's profile picture Qwen's profile picture Journalists on Hugging Face's profile picture Women on Hugging Face's profile picture Social Post Explorers's profile picture Chinese LLMs on Hugging Face's profile picture Hugging Face for Legal's profile picture

AdinaY's activity

upvoted a collection 4 days ago
upvoted a paper 4 days ago
upvoted a collection 4 days ago
upvoted 3 papers 5 days ago
upvoted 2 articles 5 days ago
view article
Article

Welcome Gemma 3: Google's all new multimodal, multilingual, long context open LLM

• 284
upvoted a collection 5 days ago
upvoted a paper 5 days ago
upvoted a paper 6 days ago
upvoted a paper 7 days ago
upvoted 2 papers 10 days ago
upvoted a collection 10 days ago
upvoted a paper 11 days ago
upvoted 3 papers 13 days ago
upvoted a paper 17 days ago