Skip to content

Ju Yang

Ph.D. / Machine Learning Practitioner in New York

Menu

  • About me
  • Blog
  • LinkedIn
  • YouTube
Search

Posts from May 2020

Connect the Dots, MLSys

Distributed model training II: Parameter Server and AllReduce

Written by Ju on May 20th, 2020September 21st, 2020. Leave a comment

In the previous post, I talked about using MapReduce and Spark for distributed model training. In this post, I will talk about parameter server and how it is used in distributed model training. 

(more…)

Read the article Distributed model training II: Parameter Server and AllReduce
Connect the Dots, MLSys

Distributed model training I: MapReduce and Spark

Written by Ju on May 7th, 2020September 21st, 2020. 1 Comment

In the previous post, I introduced challenges in machine learning systems with big data and complex models. In this post, I will discuss distributed systems in the era of big data. 

(more…)

Read the article Distributed model training I: MapReduce and Spark
Connect the Dots, MLSys

Think big: ML systems in the era of big data

Written by Ju on May 1st, 2020September 11th, 2023. Leave a comment

Let’s start with linear regression. Using established libraries such as scikit-learn, it is almost trivial to train a linear regression model. We can easily run the model training with a few hundred Megabytes of data on our laptop with a build-in CPU.

Now let’s think big.

(more…)

Read the article Think big: ML systems in the era of big data

Disclaimer

All posts represent my personal experience only. Opinions expressed are solely my own and do not express the views or opinions of any organization or group.

Recent Posts

  • 【职场分享】资深工程师的挑战和策略 Challenges and Strategies of Being a Staff Engineer
  • 【职场分享】如何成为资深工程师 how to become a staff engineer
  • Act like a leader
  • 【职场分享】如何培养主人翁意识How to take ownership
  • 【职场分享】如何让自己有话可说 / How to be a good verbal communicator at work

Archives

  • September 2024
  • March 2024
  • October 2022
  • September 2022
  • December 2021
  • October 2021
  • June 2021
  • December 2020
  • November 2020
  • October 2020
  • August 2020
  • July 2020
  • June 2020
  • May 2020
  • January 2020
  • September 2019
  • August 2019
  • July 2019
  • May 2019
  • April 2019
  • March 2019
  • February 2019
  • November 2018
  • October 2018
  • March 2018
  • September 2017
  • August 2017
  • July 2017
  • March 2017

Categories

  • Career
  • Chinese
  • Connect the Dots
  • DataScience
  • Design Patterns
  • Life
  • MLSys
  • Season1
  • Season2
  • Tech
Proudly powered by WordPress | Theme: Simone by Carolina