AI-Driven HBM Uptake Is Power-Sensitive [Byline]

High-bandwidth memory (HBM) has become the artificial-intelligence memory of choice, and as HBM3 goes into volume production, more attention is being paid to power consumption in the wake of 2023’s generative AI boom.

The increasing demand for memory bandwidth from AI is directly correlated to increasing HBM bandwidth.Performance needs, memory bandwidth and memory sizes are growing exponentially, putting higher expectations and pressure on the next generation of HBM.

While bandwidth per watt as it relates to HBM is not particularly new, he said, energy consumption by data centers has been on the rise. These rapidly increasing power costs mean that bandwidth per watt is becoming a more important metric for enterprises who need to monitor operational costs—even more so with the increasing focus on sustainability initiatives.

The high costs associated with HBM and the price tag of the memory itself means the total cost of ownership becomes the deciding factor when determining if this uber-power memory is necessary for application. The process for customers to decide which memory they need starts with technical requirements like density, performance and power.

Read my full story for EE Times.

Gary Hilson is a freelance writer with a focus on B2B technology, including information technology, cybersecurity, and semiconductors.

Thwarting counterfeit electronics is tough and requires scale [Byline]

Counterfeit electronics are at best an annoyance to consumers and, at worst, a threat to national security.

Whether it’s an outright fake or a gray market device, the prevalence of counterfeit electronics is fueled by demand that’s not being met by the available supply. When there’s a high demand that’s not being fully met, there’s more room for outright counterfeit chips, as well as gray market items, which might be a genuine chip that’s packaged as new when it has in fact been used somewhere else for several years.

Putting gray market chips into systems is like turning back the speedometer of a car to make it appear there’s mileage on it, but it obscures the wear and tear that could have serious implications on the system it’s being used in.

Read my full story at Fierce Electronics.

Gary Hilson is a freelance writer with a focus on B2B technology, including information technology, cybersecurity, and semiconductors.

AI is enhancing diverse computer vision technologies [Byline]

Autonomous vehicles have been driving advances in vision technology, but vendors are targeting other practical applications because broad adoption of self-driving vehicles appears to be taking longer than expected.

Virtual reality (VR) and augmented reality (AR) both have need of improved cameras and sensors for practical use cases, while the trend toward “uncaging robots” for industrial applications such as warehouse fulfillment and manufacturing requires smarter vision technology, which spans 2D cameras to 4D LiDAR.

Layering artificial intelligence (AI), machine learning, and neural networks onto computer vision technologies further expands the many applications for a wide range of sensors and cameras.

Read my full story at Fierce Electronics.

Gary Hilson is a freelance writer with a focus on B2B technology, including information technology, cybersecurity, and semiconductors.