๋ณธ๋ฌธ์œผ๋กœ ๊ฑด๋„ˆ๋›ฐ๊ธฐ
buildradar
Sign in

Haiyang-W/TokenFormer

@Haiyang-W

[ICLR2025 Spotlight๐Ÿ”ฅ] TokenFormer ๊ณต์‹ ๊ตฌํ˜„: ํ† ํฐํ™”๋œ ๋ชจ๋ธ ํŒŒ๋ผ๋ฏธํ„ฐ๋กœ Transformer ์Šค์ผ€์ผ๋ง ์žฌ๊ณ 

โ†— GitHub์—์„œ ์—ด๊ธฐ
์Šคํƒ€
594
ํฌํฌ
43
์–ธ์–ด
Python
๋ผ์ด์„ ์Šค
Apache-2.0
๋งˆ์ง€๋ง‰ ํ‘ธ์‹œ
2๋…„ ์ „
Pythonllmtransformerfoundation-modelsarchitectureattention-mechanismscaling-methods

๊ด€๋ จ ์ธํ…” (0)

์•„์ง ๊ด€๋ จ ์ธํ…”์ด ์—†์Šต๋‹ˆ๋‹ค

์ด ์ €์žฅ์†Œ๋Š” radar๊ฐ€ ์ถ”์ ํ•˜๋Š” ์–ด๋–ค ์†Œ์Šค์—๋„ ์•„์ง ๋“ฑ์žฅํ•˜์ง€ ์•Š์•˜์Šต๋‹ˆ๋‹ค. ์ˆ˜์ง‘๊ธฐ๋Š” ์˜ˆ์•ฝ์— ๋”ฐ๋ผ ์‹คํ–‰๋ฉ๋‹ˆ๋‹คโ€”โ€”์ด ์ €์žฅ์†Œ๋ฅผ ๋‹ค๋ฃจ๊ฒŒ ๋˜๋ฉด ๋‹ค์‹œ ํ™•์ธํ•˜์„ธ์š”.