Table of Contents
Fetching ...

Reducing ADC Front-end Costs During Training of On-sensor Printed Multilayer Perceptrons

Florentia Afentaki, Paula Carolina Lozano Duarte, Georgios Zervakis, Mehdi B. Tahoori

TL;DR

This work targets the high area and power burden of ADCs in on-sensor printed MLP classifiers by introducing bespoke pruned flash ADCs per sensor input. It combines a Python-based partial-ADC area proxy with NSGA-II optimization and quantization-aware training to prune unnecessary representation levels while maintaining accuracy, formalized through per-input level masks and $2^N$ level budgets. The approach achieves substantial hardware reductions, reporting an average $11.2\times$ ADC area reduction and $13.2\times$ power reduction with under $5\%$ accuracy loss, outperforming state-of-the-art area-efficient designs when ADC costs are included. This ADC-aware training framework enhances practical viability of ultra-low-cost, on-sensor printed ML systems and can be applied on top of other MLP approximation strategies.

Abstract

Printed electronics technology offers a cost-effectiveand fully-customizable solution to computational needs beyondthe capabilities of traditional silicon technologies, offering ad-vantages such as on-demand manufacturing and conformal, low-cost hardware. However, the low-resolution fabrication of printedelectronics, which results in large feature sizes, poses a challengefor integrating complex designs like those of machine learn-ing (ML) classification systems. Current literature optimizes onlythe Multilayer Perceptron (MLP) circuit within the classificationsystem, while the cost of analog-to-digital converters (ADCs)is overlooked. Printed applications frequently require on-sensorprocessing, yet while the digital classifier has been extensivelyoptimized, the analog-to-digital interfacing, specifically the ADCs,dominates the total area and energy consumption. In this work,we target digital printed MLP classifiers and we propose thedesign of customized ADCs per MLP's input which involvesminimizing the distinct represented numbers for each input,simplifying thus the ADC's circuitry. Incorporating this ADCoptimization in the MLP training, enables eliminating ADC levelsand the respective comparators, while still maintaining highclassification accuracy. Our approach achieves 11.2x lower ADCarea for less than 5% accuracy drop across varying MLPs.

Reducing ADC Front-end Costs During Training of On-sensor Printed Multilayer Perceptrons

TL;DR

This work targets the high area and power burden of ADCs in on-sensor printed MLP classifiers by introducing bespoke pruned flash ADCs per sensor input. It combines a Python-based partial-ADC area proxy with NSGA-II optimization and quantization-aware training to prune unnecessary representation levels while maintaining accuracy, formalized through per-input level masks and level budgets. The approach achieves substantial hardware reductions, reporting an average ADC area reduction and power reduction with under accuracy loss, outperforming state-of-the-art area-efficient designs when ADC costs are included. This ADC-aware training framework enhances practical viability of ultra-low-cost, on-sensor printed ML systems and can be applied on top of other MLP approximation strategies.

Abstract

Printed electronics technology offers a cost-effectiveand fully-customizable solution to computational needs beyondthe capabilities of traditional silicon technologies, offering ad-vantages such as on-demand manufacturing and conformal, low-cost hardware. However, the low-resolution fabrication of printedelectronics, which results in large feature sizes, poses a challengefor integrating complex designs like those of machine learn-ing (ML) classification systems. Current literature optimizes onlythe Multilayer Perceptron (MLP) circuit within the classificationsystem, while the cost of analog-to-digital converters (ADCs)is overlooked. Printed applications frequently require on-sensorprocessing, yet while the digital classifier has been extensivelyoptimized, the analog-to-digital interfacing, specifically the ADCs,dominates the total area and energy consumption. In this work,we target digital printed MLP classifiers and we propose thedesign of customized ADCs per MLP's input which involvesminimizing the distinct represented numbers for each input,simplifying thus the ADC's circuitry. Incorporating this ADCoptimization in the MLP training, enables eliminating ADC levelsand the respective comparators, while still maintaining highclassification accuracy. Our approach achieves 11.2x lower ADCarea for less than 5% accuracy drop across varying MLPs.

Paper Structure

This paper contains 9 sections, 4 figures, 1 table.

Figures (4)

  • Figure 1: Area and Power Evaluation of the printed classification system in Afentaki:ICCAD23:hollistic.
  • Figure 2: A high-level overview of the proposed ADC-aware methodology.
  • Figure 3: Schematic of: a) conventional 3-bit Flash ADC and b) an example of an equivalent bespoke pruned ADC
  • Figure 4: Accuracy vs normalized area Pareto space of the ADCs.