Lists of Articles Posted in 2021

List 1: Framework Analysis

Keywords: OneFlow, GPT-3

OneFlow Made Training GPT-3 Easier (Part 1)

Correct Level of Abstraction for Distributed Deep Learning Frameworks (Part2)

Runtime of OneFlow Based On Boxing and Actor Model (Part 3)

The Limitations of Existing Deep Learning Frameworks: Resource Dependency

The Limitations of Existing Deep Learning Frameworks: Data Movement

The Limitations of Existing Deep Learning Frameworks: Dynamic Scheduling

List 2: Industry View

Keywords: AI Industry, Software System

Combating Software System Complexity: Entities Should Not Be Multiplied Unnecessarily

Combating Software System Complexity: Conceptual Integrity and Uniform Metaphor

Combating Software System Complexity: Appropriate Abstraction Layer

On AI Industrialization Dilemma and the Inspiration from Database Standardization

How to Go beyond Data Parallelism and Model Parallelism: Starting from GShard

What an Optimal Point-to-Point Communication Library Should Be? (Part 1)

What an Optimal Point-to-Point Communication Library Should Be? (Part 2)

List 3: Technique Sharing

Keywords: PyTorch, CUDA, Operator Optimization

Quantization Aware Training of Deep Learning Frameworks and the Implementation in OneFlow

Adding Expand and Repeat Ops into OneFlow

Adding Unfold and Fold Ops into OneFlow

Automatic Type Promotion in OneFlow

How to Implement a Permute/Transpose Op 6 Times Faster Than PyTorch?

Error Handling in OneFlow: Maybe

How to Implement an Efficient Softmax CUDA Kernel — OneFlow Performance Optimization

How to Implement an Efficient LayerNorm CUDA Kernel — OneFlow Performance Optimization

OneFlow’s Optimization of CUDA Elementwise Template Library: Practical, Efficient, and Extensible

--

--

--

OneFlow is a performance-centered and open-source deep learning framework.

Love podcasts or audiobooks? Learn on the go with our new app.

Recommended from Medium

So, What’s the Real Difference Between AI and Automation?

Artificial Intelligence Institute in Chandigarh

The Role of AI in Legal Tech Today

Astro brings AI to email, and now Calendar too

Will the Metaverse end Privacy?

AI and Customer Care: The Future is Here

Congress Wants to Protect You From Biased Algorithms, Deepfakes, and Other Bad AI

What is AI and Machine Learning?

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store
OneFlow

OneFlow

OneFlow is a performance-centered and open-source deep learning framework.

More from Medium

The History of Credit-based Flow Control (Part 1)

Google’s New Patent Helps Drivers Keep Attention While Driving

Graphs Theory and Algorithms

Contributing to LibTorch: recent architectures and “vanilla” training pipeline