Mythic has developed a truly unique AI compute platform that enables smart camera systems, intelligent appliances, brilliant robotics, and more. Our platform enables AI designers to deploy in form factors that were previously out of reach, which is the result of unmatched performance and energy efficiency. Key features include:
- Lowest latency: Single frame delay by running batch size of 1
- Highest performance per watt: >4 TOPS/Watt
- Hyper scalability: Low-power single-chip to high-performance rack systems
- Ease of use: Major platform support (e.g., TensorFlow) and topology-agnostic performance
Mythic products are based on a unique tile-based AI compute architecture that features three fundamental hardware technologies – Compute-in-Memory, Dataflow Architecture, and Analog Computing. For AI developers, the Mythic SDK streamlines the preparation of trained neural networks for edge and low-latency datacenter deployments, and also performs automatic optimization and compilation of dataflow graphs for our unique architecture.
The Mythic IPU features an array of tiles that blend familiar concepts and breakthrough new technology to deliver unmatched performance, power, and flexibility. Each tile in a Mythic IPU has a large analog compute array to store bulky neural network weights, local SRAM memory for data being passed between the neural network nodes, a single-instruction multiple-data (SIMD) unit for processing operations not handled by the analog compute array, and a nano-processor for controlling the sequencing and operation of the tile. The tiles are interconnected with an efficient on-chip router network, which facilitates the dataflow from one tile to the next. On the edge of the IPU, we have off-chip connections to either other Mythic chips or to the host system.
The Mythic SDK includes the necessary tools to bridge the gap between popular training frameworks like TensorFlow and Pytorch and highly constrained edge and datacenter deployments on the Mythic IPU that must optimize for cost, power, and performance. The Mythic Optimization Suite solves a significant customer pain point by automatically converting the neural network to an 8-bit representation, while preserving accuracy in the analog compute domain. The Mythic Graph Compiler automatically generates machine code for our IPU, so developers do not have to worry about low-level implementation or optimization. Mythic host drivers are pain-free and light-weight, with support planned for most popular embedded and server operating systems.
For a more in-depth look into Mythic technology, check out our blogs:
Software Engineering at Mythic