Written by Zekang Zheng; Translated by Yanjun Hu, Jiali Shen PReLU is an activation function that is frequently used in InsightFace. It has two operating modes: PReLU(1) and PReLU(channels). For the latter, PReLU is equivalent to a binary broadcast operation. …

Welcome to use OneFlow v0.7.0. We would love to hear your feedback! Highlights This release has the following highlights: Provides a Tensor that can be executed in multi-nodes multi-GPUs scenarios: Global Tensor. It is an easy-to-use solution for distributed execution. It makes it easier to implement various distributed parallel strategies and…

Written by Xiaoyu Zhang; Translated by Xiaozhen Liu, Chenyang Xu, Yakun Zhou This article focuses on what is happening behind the execution of a Tensor in the deep learning framework OneFlow. It takes the operator `oneflow.relu` as an example to introduce the Interpreter and VM mechanisms that need to be…

Written by Xiaoyu Zhang; Translated by Xiaozhen Liu, Chenyang Xu, Yakun Zhou This article introduces OneFlow’s operator AutoTest framework to analyze how OneFlow perform the operator alignment task when we develop operators. This AutoTest Framework can also be easily ported to other deep learning training frameworks. The code is here. 1. Traditional Operator Alignment …

Written by Jing Qiao, Chi, Yao; Translated by Xiaozhen Liu, Chenyang Xu, Yakun Zhou In the previous article, we introduced the basic concept of flow control and reviewed the history of credit-based flow control. …

Written by Jing Qiao, Chi, Yao; Translated by Xiaozhen Liu, Chenyang Xu, Yakun Zhou Backpressure mechanism, also known as credit-based flow control, is a classic scheme for network communication flow control problems. Its predecessor is the TCP sliding window. This idea is particularly simple and effective. As we will see…

Written by Xiaoyu Zhang; Translated by Xiaozhen Liu, Chenyang Xu, Yakun Zhou This article describes how OneFlow works with MLIR, how to add a graph-level Pass to OneFlow IR, how OneFlow Operations automatically become MLIR Operations, and why OneFlow IR can use MLIR to accelerate computations. For more details, please…

Written by Juncheng Liu; Translated by Xiaozhen Liu, Chenyang Xu In this article, the engineer of OneFlow shares the way of setting grid_size and block_size when writing CUDA kernels. In general, we might see the following code that launches a CUDA kernel: cuda_kernel is the identifier of the global…

Welcome to use OneFlow v0.6.0, we would love to hear feedback! This version mainly updates three parts: framework, model, and OneFlow-ONNX. Hightlights include: Performance optimization in static graphs, dynamic graphs, operators, memory occupation, etc A larger number of common operators Improvements in static graphs and ConsistentTensor Serving functionality as Nvidia…