Lists of Articles Posted in 2021

List 1: Framework Analysis

Keywords: OneFlow, GPT-3

OneFlow Made Training GPT-3 Easier (Part 1)

Correct Level of Abstraction for Distributed Deep Learning Frameworks (Part2)

Runtime of OneFlow Based On Boxing and Actor Model (Part 3)

The Limitations of Existing Deep Learning Frameworks: Resource Dependency

The Limitations of Existing Deep Learning Frameworks: Data Movement

The Limitations of Existing Deep Learning Frameworks: Dynamic Scheduling

List 2: Industry View

Keywords: AI Industry, Software System

Combating Software System Complexity: Entities Should Not Be Multiplied Unnecessarily

Combating Software System Complexity: Conceptual Integrity and Uniform Metaphor

Combating Software System Complexity: Appropriate Abstraction Layer

On AI Industrialization Dilemma and the Inspiration from Database Standardization

How to Go beyond Data Parallelism and Model Parallelism: Starting from GShard

What an Optimal Point-to-Point Communication Library Should Be? (Part 1)

What an Optimal Point-to-Point Communication Library Should Be? (Part 2)

List 3: Technique Sharing

Keywords: PyTorch, CUDA, Operator Optimization

Quantization Aware Training of Deep Learning Frameworks and the Implementation in OneFlow

Adding Expand and Repeat Ops into OneFlow

Adding Unfold and Fold Ops into OneFlow

Automatic Type Promotion in OneFlow

How to Implement a Permute/Transpose Op 6 Times Faster Than PyTorch?

Error Handling in OneFlow: Maybe

How to Implement an Efficient Softmax CUDA Kernel — OneFlow Performance Optimization

How to Implement an Efficient LayerNorm CUDA Kernel — OneFlow Performance Optimization

OneFlow’s Optimization of CUDA Elementwise Template Library: Practical, Efficient, and Extensible

--

--

--

OneFlow is a performance-centered and open-source deep learning framework.

Love podcasts or audiobooks? Learn on the go with our new app.

Recommended from Medium

How to win a Turing Test (the Loebner prize)

EU AI Regulation Needs Balance to Protect Startups, Promote Innovation

This is insane: OpenAI’s GPT-3 Can Convert Verbal Prompts into Code

Where technology and the future of healthcare converge

Highlighting our community’s impact on global health

Image of a small ambulance resting on a bench : global healthcare

Road to Game Dev: Giving AI Eyes

Anticipating …REGRET !!!

List of 5 Best Chatbots in India Across Different Sectors — EmpathyBots

List of 6 Best Chatbots in India Across Different Sectors

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store
OneFlow

OneFlow

OneFlow is a performance-centered and open-source deep learning framework.

More from Medium

The History of Credit-based Flow Control (Part 1)

How does AI impact self-driving cars?

Computer vision for in-vitro fertilization (IVF)

Transformer’s Training Details