Explore Tencent's Hunyuan-Large, a 389B parameter MoE model with 52B active parameters. Discover its top benchmarks, technical innovations, and real-world applications
Perhaps it would also be useful to have a name for models that release their weights […]
open-weight?
I think the companies mostly stopped releasing the training data after a lot of them got sued for copyright infringement. I believe Meta’s first LLaMA still came with a complete list of datasets that went in. And I forgot the name if the project but the community actually recreated it due to the licensing of the official model at that time that only allowed research. But things changed since then. Meta opened up a lot. Training got more extensive and is still prohibitively expensive (maybe even more so). And the landscape got riddled with legal issues, compared to the very early days where it was mostly research with less attention by everyone.
Could this lead to increased difficulties in releasing open-source models? By keeping their models closed-source, companies may avoid potential copyright infringement issues that could arise from making their everything publicly available
open-weight?
I think the companies mostly stopped releasing the training data after a lot of them got sued for copyright infringement. I believe Meta’s first LLaMA still came with a complete list of datasets that went in. And I forgot the name if the project but the community actually recreated it due to the licensing of the official model at that time that only allowed research. But things changed since then. Meta opened up a lot. Training got more extensive and is still prohibitively expensive (maybe even more so). And the landscape got riddled with legal issues, compared to the very early days where it was mostly research with less attention by everyone.
Could this lead to increased difficulties in releasing open-source models? By keeping their models closed-source, companies may avoid potential copyright infringement issues that could arise from making their everything publicly available