maywell commited on
Commit
6f7e8ca
โ€ข
1 Parent(s): 839e7cc

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +0 -3
README.md CHANGED
@@ -5,8 +5,6 @@ license: apache-2.0
5
 
6
  LG์—์„œ ๋™์ผ ๋ผ์ด์„ผ์Šค ์žฌ๋ฐฐํฌ์กฐ์ฐจ ๋ง‰์•„๋ฒ„๋ฆฐ ๊ด€๊ณ„๋กœ ๋ชจ๋ธ์„ ๊ณต์œ ํ•  ์ˆ˜ ์—†๊ฒŒ ๋˜์—ˆ์Šต๋‹ˆ๋‹ค. vLLM, ์ถ”๋ก  ๋ฐ ๊ธฐํƒ€ ํ™œ์šฉ์œผ๋กœ Llamafied ๋ชจ๋ธ์ด ํ•„์š”ํ•˜๋‹ค๋ฉด ์•„๋ž˜ ์Šคํฌ๋ฆฝํŠธ๋ฅผ ์‹คํ–‰ํ•ด์„œ ์‚ฌ์šฉํ•ด์ฃผ์‹œ๋ฉด ๊ฐ์‚ฌํ•˜๊ฒ ์Šต๋‹ˆ๋‹ค.
7
 
8
- ์•„๋ž˜ modeling_exaone๊ณผ configuration_exaone์˜ ๊ฒฝ์šฐ์—๋Š” ์›๋ณธ repository๋ฅผ ์ฐธ์กฐํ•ด์ฃผ์„ธ์š”.
9
-
10
  ```python
11
  import torch
12
  import gc
@@ -19,7 +17,6 @@ def unload_model(model):
19
  """Clear memory by deleting a model and calling the garbage collector."""
20
  del model
21
  gc.collect()
22
- # if torch.cuda.is_available():
23
  if torch.cuda.is_available():
24
  torch.cuda.empty_cache()
25
 
 
5
 
6
  LG์—์„œ ๋™์ผ ๋ผ์ด์„ผ์Šค ์žฌ๋ฐฐํฌ์กฐ์ฐจ ๋ง‰์•„๋ฒ„๋ฆฐ ๊ด€๊ณ„๋กœ ๋ชจ๋ธ์„ ๊ณต์œ ํ•  ์ˆ˜ ์—†๊ฒŒ ๋˜์—ˆ์Šต๋‹ˆ๋‹ค. vLLM, ์ถ”๋ก  ๋ฐ ๊ธฐํƒ€ ํ™œ์šฉ์œผ๋กœ Llamafied ๋ชจ๋ธ์ด ํ•„์š”ํ•˜๋‹ค๋ฉด ์•„๋ž˜ ์Šคํฌ๋ฆฝํŠธ๋ฅผ ์‹คํ–‰ํ•ด์„œ ์‚ฌ์šฉํ•ด์ฃผ์‹œ๋ฉด ๊ฐ์‚ฌํ•˜๊ฒ ์Šต๋‹ˆ๋‹ค.
7
 
 
 
8
  ```python
9
  import torch
10
  import gc
 
17
  """Clear memory by deleting a model and calling the garbage collector."""
18
  del model
19
  gc.collect()
 
20
  if torch.cuda.is_available():
21
  torch.cuda.empty_cache()
22