Beyond the Polar Wall: Global Remainder Tracking and Side-a Normalization for Bit-Perfect Orientation in 1-bit LLMs

Key Points

• The aim is to explore methods for achieving bit-perfect orientation in 1-bit large language models (LLMs).
• Developed global remainder tracking methodology
• Implemented side-a normalization techniques
• Tested with various algorithm configurations
• Achieved improved orientation accuracy
• Showed enhanced performance in algorithm efficiency
• Validated normalization effectiveness through experiments