网站网络流量的极限,你考虑过么?大CC | 大CC



网站网络流量的极限,你考虑过么?大CC | 大CC

WEB服务的网络流量不是很大的话,这个话题不用考虑,直接用交换机连接,准备一个路由器就够用了;但流量如果达到1Gbps时,就会遇到不少问题;

网络服务有以下几个分界点:
1.流量超过1Gbps
2.子网超过500台主机
3.全球化

流量超过1Gbps

超过1Gbps时,这就达到PC路由器的极限;
Hatena使用的标准硬件,实测结果表明,其界限大致是30万包/秒;按照平均包长度为300字节换算,也就是1Gbps;而千兆以太网的界限也是1Gbps,从内核性能上来看,性能才极限也是30万包/秒;
对策:使用多个PC路由器 / 或是使用成品路由器(cisco)

同一子网超过500台主机

将500台以上主机放在一个子网内,就会出现许多问题,丢包现象频繁;
500台主机的极限,具体说是交换机的ARP表到极限;
同时,广播包的流量导致丢包;
在同一子网内放置大量主机的话,广播包也会逐渐增加,而接收广播包就会消耗CPU资源;
eg:极端情况:在主机过多的子网内,插上网线,就能观察到CPU负载上升;
对策:
网络架构的层次化:
三层架构:最小的为访问层(access area)【100-200台】、上面为分发层(Distribution Area)【1000台】、最上面为核心层(core Area)或OSPF(Open shortest path first)【全体几万台左右】

全球化 �C 一个数据中心的极限

当站点具有足够的影响力时,用户就来自全球各地;跨太平洋的访问,额外的开销是巨大的;这时,一个数据中心就成为了瓶颈;
对策:使用CDN、推荐Amazon cloudfront服务器;将访问频率高的文件上传到Amazon S3(Amazon simple storage service);


Read full article from 网站网络流量的极限,你考虑过么?大CC | 大CC


No comments:

Post a Comment

Labels

Algorithm (219) Lucene (130) LeetCode (97) Database (36) Data Structure (33) text mining (28) Solr (27) java (27) Mathematical Algorithm (26) Difficult Algorithm (25) Logic Thinking (23) Puzzles (23) Bit Algorithms (22) Math (21) List (20) Dynamic Programming (19) Linux (19) Tree (18) Machine Learning (15) EPI (11) Queue (11) Smart Algorithm (11) Operating System (9) Java Basic (8) Recursive Algorithm (8) Stack (8) Eclipse (7) Scala (7) Tika (7) J2EE (6) Monitoring (6) Trie (6) Concurrency (5) Geometry Algorithm (5) Greedy Algorithm (5) Mahout (5) MySQL (5) xpost (5) C (4) Interview (4) Vi (4) regular expression (4) to-do (4) C++ (3) Chrome (3) Divide and Conquer (3) Graph Algorithm (3) Permutation (3) Powershell (3) Random (3) Segment Tree (3) UIMA (3) Union-Find (3) Video (3) Virtualization (3) Windows (3) XML (3) Advanced Data Structure (2) Android (2) Bash (2) Classic Algorithm (2) Debugging (2) Design Pattern (2) Google (2) Hadoop (2) Java Collections (2) Markov Chains (2) Probabilities (2) Shell (2) Site (2) Web Development (2) Workplace (2) angularjs (2) .Net (1) Amazon Interview (1) Android Studio (1) Array (1) Boilerpipe (1) Book Notes (1) ChromeOS (1) Chromebook (1) Codility (1) Desgin (1) Design (1) Divide and Conqure (1) GAE (1) Google Interview (1) Great Stuff (1) Hash (1) High Tech Companies (1) Improving (1) LifeTips (1) Maven (1) Network (1) Performance (1) Programming (1) Resources (1) Sampling (1) Sed (1) Smart Thinking (1) Sort (1) Spark (1) Stanford NLP (1) System Design (1) Trove (1) VIP (1) tools (1)

Popular Posts