Clone via HTTPS
Фото: Тарас Литвиненко / РИА Новости
，更多细节参见搜狗输入法
Any of the following in a line of their own are supported also:
Последние новости
Logging the memory, it seems like it starts the forward pass, memory starts increasing on GPU 0, then OOMs. I wonder if it’s trying to be smart and planning ahead and dequantizing multiple layers at a time. Dequantizing each layer uses ~36 GB of memory so if it was doing this that could cause it to use too much memory. Maybe if we put each layer on alternating GPU’s it could help.