Skip to content

Ju Yang

Ph.D. / Machine Learning Practitioner in New York

Menu

  • About me
  • Blog
Search
  • LinkedIn
  • YouTube

Posts from May 2020

Connect the Dots, MLSys

Distributed model training II: Parameter Server and AllReduce

Written by Ju on May 20th, 2020September 21st, 2020. Leave a comment

In the previous post, I talked about using MapReduce and Spark for distributed model training. In this post, I will talk about parameter server and how it is used in distributed model training. 

Read the article Distributed model training II: Parameter Server and AllReduce
Connect the Dots, MLSys

Distributed model training I: MapReduce and Spark

Written by Ju on May 7th, 2020September 21st, 2020. 1 Comment

In the previous post, I introduced challenges in machine learning systems with big data and complex models. In this post, I will discuss distributed systems in the era of big data. 

Read the article Distributed model training I: MapReduce and Spark
Connect the Dots, MLSys

Think big: ML systems in the era of big data

Written by Ju on May 1st, 2020September 21st, 2020. Leave a comment

Let’s start with linear regression. Using established libraries such as scikit-learn, it is almost trivial to train a linear regression model. We can easily run the model training with a few hundred Megabytes of data on our laptop with a build-in CPU.

Now let’s think big.

Read the article Think big: ML systems in the era of big data

Disclaimer

All posts represent my personal experience only. Opinions expressed are solely my own and do not express the views or opinions of any organization or group.

Recent Posts

  • Act like a leader
  • 【职场分享】如何培养主人翁意识How to take ownership
  • 【职场分享】如何让自己有话可说 / How to be a good verbal communicator at work
  • 【职场分享】程序员如何出活 / How to deliver fast as an IC
  • 【职场分享】新人如何打基础 / How to lay the foundation for a new job

Archives

  • October 2022
  • September 2022
  • December 2021
  • October 2021
  • June 2021
  • December 2020
  • November 2020
  • October 2020
  • August 2020
  • July 2020
  • June 2020
  • May 2020
  • January 2020
  • September 2019
  • August 2019
  • July 2019
  • May 2019
  • April 2019
  • March 2019
  • February 2019
  • November 2018
  • October 2018
  • March 2018
  • September 2017
  • August 2017
  • July 2017
  • March 2017

Categories

  • Career
  • Chinese
  • Connect the Dots
  • DataScience
  • Design Patterns
  • Life
  • MLSys
  • Season1
  • Season2
  • Tech
Proudly powered by WordPress | Theme: Simone by mor10.com