aixsatoshi
/

Honyaku-Multi-Translator-Swallow-ms7b

@@ -62,6 +62,9 @@ model_name = "aixsatoshi/Honyaku-Multi-Translator-Swallow-ms7b"
 model = AutoModelForCausalLM.from_pretrained(model_name).to("cuda")
 tokenizer = AutoTokenizer.from_pretrained(model_name)
 # Define the English prompt
 english_prompt = """
 Water, essential for all forms of life, is commonly found in diverse sources such as rivers, oceans, and even within organisms. This transparent fluid, which makes up a significant percentage of the human body, plays a pivotal role in ensuring daily hydration and supporting our body's intricate physiological functions.However, within the vast realm of biology, it's not just about drinking water. The intricate process of osmosis in our cells ensures a proper balance of vital electrolytes. Elements like sodium and potassium are crucial for various cellular functions, and without the precise regulation through osmosis, cells might experience detrimental effects, such as shriveling up or swelling to the point of bursting.In the fascinating world of neuroscience, the term "synaptic plasticity" refers to the remarkable ability of the synapses—the junctions between neurons—to strengthen or weaken over time. This plasticity, modulated by various factors including neurotrophins, plays an indispensable role in processes like learning and memory. Meanwhile, in the domain of cardiology, there's the concern of atherosclerosis. This condition, characterized by the hardening and narrowing of arteries due to plaque buildup, can lead to severe complications, such as coronary artery disease, affecting the heart's blood supply.In conclusion, the vast complexities of human biology stretch from basic hydration principles to advanced cellular mechanisms and even intricate vascular processes. Gaining a deep understanding of these multifaceted systems not only requires interdisciplinary knowledge but also demands precise translation of specialized terms, especially when sharing knowledge across linguistic and cultural boundaries.
@@ -70,9 +73,6 @@ Water, essential for all forms of life, is commonly found in diverse sources suc
 # Prepare the prompt for English to Japanese translation
 prompt = f"<english>: {english_prompt} </english>\n\n<japanese>:\n"
-# Define the streamer
-streamer = TextStreamer(tokenizer)
 # Tokenize the input text and move to CUDA device
 inputs = tokenizer(prompt, return_tensors="pt").to("cuda")

 model = AutoModelForCausalLM.from_pretrained(model_name).to("cuda")
 tokenizer = AutoTokenizer.from_pretrained(model_name)
+# Define the streamer
+streamer = TextStreamer(tokenizer)
 # Define the English prompt
 english_prompt = """
 Water, essential for all forms of life, is commonly found in diverse sources such as rivers, oceans, and even within organisms. This transparent fluid, which makes up a significant percentage of the human body, plays a pivotal role in ensuring daily hydration and supporting our body's intricate physiological functions.However, within the vast realm of biology, it's not just about drinking water. The intricate process of osmosis in our cells ensures a proper balance of vital electrolytes. Elements like sodium and potassium are crucial for various cellular functions, and without the precise regulation through osmosis, cells might experience detrimental effects, such as shriveling up or swelling to the point of bursting.In the fascinating world of neuroscience, the term "synaptic plasticity" refers to the remarkable ability of the synapses—the junctions between neurons—to strengthen or weaken over time. This plasticity, modulated by various factors including neurotrophins, plays an indispensable role in processes like learning and memory. Meanwhile, in the domain of cardiology, there's the concern of atherosclerosis. This condition, characterized by the hardening and narrowing of arteries due to plaque buildup, can lead to severe complications, such as coronary artery disease, affecting the heart's blood supply.In conclusion, the vast complexities of human biology stretch from basic hydration principles to advanced cellular mechanisms and even intricate vascular processes. Gaining a deep understanding of these multifaceted systems not only requires interdisciplinary knowledge but also demands precise translation of specialized terms, especially when sharing knowledge across linguistic and cultural boundaries.
 # Prepare the prompt for English to Japanese translation
 prompt = f"<english>: {english_prompt} </english>\n\n<japanese>:\n"
 # Tokenize the input text and move to CUDA device
 inputs = tokenizer(prompt, return_tensors="pt").to("cuda")