How to Design Youtube (Part II)

How to Design Youtube (Part II) This is the second post about how to design Youtube. Well continue our discussion from the first one  and please check it if you havent read. In the last post, we mainly talked about database and storage. This week, well cover much more topics, including scalability, web server, cache and security. Scale the database There are tons of problems to fix once the product has millions or even billions of users. Scalability is one of the most important issues to solve. Basically, storing all the data into a single database is not only inefficient but infeasible. So how would you scale the database for Youtube? We can follow a lot of general rules when scaling the database. The most common approach is to scale only when you need it. In other words, its not recommended to do all the work like partition your database at day one, because its almost for sure that at the point you really need to scale, the whole infrastructure and product have been changed dramatically. So the idea is to start from a single server. Later on, you may go to a single master with multiple read slaves (master/slave model). And at some point, youll have to partition the database and settle on a sharding approach. For instance, you can split the database by users location and when a request comes, youll route the request to the corresponding database. For Youtube, we can further optimize it. The most important feature of Youtube is the video. Therefore, we can prioritize traffic by splitting the data into two clusters: a video cluster and a general cluster. We can give a lot of resources to the video cluster and other social network features will be routed to the less capable cluster. A more general idea here is that when solving scalability issue, you should first identify the bottleneck and then optimize it. In this case, the bottleneck is watching videos. Cache I will not talk much about cache for this topic as weve covered this in details in our previous post Design a Cache System. But several points are worth to mention here. First of all, when talking about cache, most peoples reaction is about server cache. In fact, front end cache is equally important. If you want to make your website fast and has low latency, you cant avoid setting cache for the front end. This is a very common technique when building a website interface. Secondly, as we briefly discussed in the previous post, caching wont do a lot of good in terms of serving videos. This is mainly because majority usage of Youtube comes from those long tail videos and itll be extremely expensive to set cache for all videos. So the general idea here is that if you are building a long tail product like this, dont place too much bet on the cache. Security There are a lot of things that can be discussed security in Youtube. Id like to cover one interesting topic here view hacking. Under each Youtube video, it shows the view count, which indicates how popular the video is. People can programmatically send requests to hack the view count, so how should we protect it? The most straightforward approach is to if a particular IP issues too many requests, just block it. Or we can even restrict the number of view count per IP. The system can also check information like browser agent and users past history, which potentially can block a lot of hacks. People may use services like Tor to hide IP, and sites like Mechanical Turk allows you to pay people to click the video with very low cost. However, hacking the system is harder than most people think. For instance, a video with high view count but low engagement is very suspicious. With a large number of video Youtube has, its not hard to extract patterns of real view count. In order to hack the system, you need to provide reasonable engagement metrics like share count, comment count, view time, etc.. And its almost impossible to fake all of them. Web server Many people overlook web server as it doesnt have too many things to discuss in terms of system design, However, for large systems like Youtube, there are many things you need to consider. Id like to share a couple techniques Youtube has used. Youtube server was built in Python initially, which allows rapid flexible development and deployment. You might notice that many startups choose Python as their server language as its much faster to iterate. Python sometimes has the performance issue, but there are many C extensions that allow you to optimize critical section, which is exactly how Youtube works. To scale the web server, you can simply have multiple replicas and build a load-balancer on top of them. The server is mainly responsible for handling user requests and return response. It should have few heavy logics and everything else should be built into separate servers. For instance, recommendation should be a separate component to let Python server fetches data from. Summary In this post, we try to cover as many different topics as possible and each of them can be discussed deeper in a separate post. There are still many things Id like to talk about in the future, but readers can think about them and discuss in the comments. For instance, Youtube recommendation is a very big topic and it drives user engagement metrics dramatically. How would you build the recommendation system? In addition, how do you identify trending videos of the day and recommend to the relevant audience? By the way, if you want to have more guidance from experienced interviewers, you can check Gainlo that allows you to have mock interview with engineers from Google, Facebook ,etc..