# Metadata Source URL:: https://arxiv.org/pdf/2303.10845.pdf Topics:: #ai, #llm --- # PANGU-Σ: TOWARDS TRILLION PARAMETER LANGUAGE MODEL WITH SPARSE HETEROGENEOUS COMPUTING ## Highlights