Code
Python Could Reset the AI Inference Playing Field
When it comes to neural network training, Python is the language of choice. …
inference
AI
Feeding The Datacenter Inference Beast A Heavy Diet Of FPGAs
Any workload that has a complex dataflow with intricate data needs and a requirement for low latency should probably at least consider an FPGA for the job. …
Compute
Inside Facebook’s Future Rack And Microserver Iron
The hyperscalers and cloud builders have been setting the pace for innovation in the server arena for the past decade or so, particularly and publicly since Facebook set up the Open Compute Project in April 2011 and ramping up as Microsoft joined up in early 2014 and basically created a whole new server innovation stream that was unique from – and largely incompatible with – the designs put out by Facebook. …
AI
MLPerf Inference Results Offer Glimpse into AI Chip Performance
There is much at stake in the world of datacenter inference and while the market has not yet decided its winners, there are finally some new metrics in the bucket to aid decision-making. …
AI
Nvidia Shows Off Tech Chops With RC18 Inference Chip
It would be convenient for everyone – chip makers and those who are running machine learning workloads – if training and inference could be done on the same device. …
AI
Habana Takes Training And Inference Down Different Paths
Processor hardware for machine learning is in their early stages but it already taking different paths. …
AI
Will Analog AI Make Mythic a Unicorn?
There are two trends converging in AI inference and so far, only a small number of companies are enmeshed. …
AI
AI Chip Startup Puts Inference Cards on the Table
In the deep learning inferencing game, there are plenty of chipmakers, large and small, developing custom-built ASICs aimed at this application set. …
AI
Where The FPGA Hits The Server Road For Inference Acceleration
There are an increasing number of ways to do machine learning inference in the datacenter, but one of the increasingly popular means of running inference workloads is the combination of traditional CPUs acting as a host for FPGAs that run the bulk of the inferring. …
AI
Teasing Out The Bang For The Buck Of Inference Engines
There is a battle heating up in the datacenter, and there are tens of billions of dollars at stake as chip makers chase the burgeoning market for engines that do machine learning inference. …