GitHub

custom_quantization_int8_example.py

self.register_buffer("weight", torch.zeros((out_features, in_features), dtype=torch.int8)) self.register_buffer("weight_scale", torch.zeros((out_features, 1), dtype ...
LinkedIn

Model Quantization and the Rise of Edge AI

In today’s fast-evolving landscape of artificial intelligence, the deployment of machine learning models on edge devices—smartphones, IoT sensors, embedded systems, and more—has become increasingly ...
Nature

A dichotomy color quantization algorithm for the HSI color space

Color quantization is used to obtain an image with the same number of pixels as the original but represented using fewer colors. Most existing color quantization algorithms are based on the Red Green ...
Nature

Ensemble probabilistic quantization encoding for information preservation of numerical variables in convolutional neural networks

One-hot encoding is a prevalent method used to convert numeric variables into categorical variables. But one-hot encoding omits crucial quantitative data, which compromises the performance of ...
IEEE

Enhanced Vector Quantization for Embedded Machine Learning: A Post-Training Approach With Incremental Clustering

Abstract: TinyML enables the deployment of Machine Learning (ML) models on resource-constrained devices, addressing a growing need for efficient, low-power AI solutions. However, significant ...
IEEE

Securing Federated Diffusion Model With Dynamic Quantization for Generative AI Services in Multiple-Access Artificial Intelligence of Things

Abstract: Generative diffusion models (GDMs) have emerged as potent tools for generating high-quality, creative content across various media, including audio, images, videos, and 3-D models. Their ...
Microsoft

Autoregressive Speech Synthesis without Vector Quantization

We present MELLE, a novel continuous-valued tokens based language modeling approach for text to speech synthesis (TTS). MELLE autoregressively generates continuous mel-spectrogram frames directly from ...