Tag Archives: microsoft

Are all HTTP objects created equal?

Posted on by
1
You already know that we like to take close look at our traffic to improve our large and growing network. We also share our findings in the global data flow report. This time we analyzed HTTP objects flowing through our network.

DiViNetworksHTTPObjectsTrafficBySourceThe graph shows the percentage of overall HTTP objects flowing downstream in our network. Reminder – our network delivers international data capacity from 15 major Internet exchange points to over 100 ISPs in regions where capacity is expensive.

It’s interesting to compare the HTTP objects mix to the capacity volume mix, as we presented in September 2012.

The winner of the HTTP objects contest – Facebook, reaches 4-6th when it comes to volumes. CDNs such as Limelight and Edgecast, contributing significant volumes, apparently do that with much larger objects, hence do not appear on the HTTP objects map.
Dropbox, on the other hand, is an HTTP pump but at relatively low throughput volumes. My guess – HTTP graph provides early hints to the rise of new content pumps. As Dropbox free storage quota grows, we will see more and more traffic from their AS.
Want another hint? I was very surprised to hear today that Amazon’s traffic is balanced. Yes, their incoming traffic is as big as their outgoing. How come? Perhaps it has to do with Dropbox stored on Amazon’s S3.

How did we get access to data flows of 100 ISPs worldwide?

Posted on by
1

Our Global Data Flow Report became very popular, with hundreds of downloads and shares. We received many questions about the report and its observations. The #1 question had to do with the way we gained access to the data.

Our DiViCloud network serves ISPs worldwide with virtual capacity. DiViCloud comprises of PoPs (points of presence) located at major Internet junctions.

Close to 100 ISPs are served by the DiViCloud network. 100% of the international downstream traffic to the served ISPs passes through these PoPs. As traffic passes through the PoPs, the software in the PoPs collects traffic statistics. These statistics serve as the raw data for the current report.

The information gathered includes: Originating AS (autonomous system), Destination AS, Traffic volume and Bit-stream repetition. We analyzed this raw information to obtain the analyses in the report, such as the one below.

Please share you observations or questions about the Global Data Flow Report.

CDN Contribution to Int’l Traffic in Different Regions

How much redundant traffic is left over by CDNs and Caching?

Posted on by
Reply

Fascinating to note that even in the presence of local CDNs and local Caching, international traffic still includes very high redundant traffic, passing over and over again on those expensive links.

International traffic repetition-rate by AS in ISPs with and without local caching

To gain access to the complete Global Data Flow Report – September 2012 please click here.

Related Infographic:

How repetitive is the Internet? (Infographic)

Adding S.E.Asia and Carrier Traffic to our Global Data Flow Report

Posted on by
1
We recently released a first glimpse to our Global Data Flow report. Located at major Internet junctions, the DiViCloud network oversees masses of traffic in different locations, providing us with insights about traffic patterns and sources. Below is an updated graph, which includes information about traffic in S.E.Asia, as well as traffic originating from major local and global carriers.

CDN and Carrier contribution to ISP’s traffic, as measured by DiViCloud network in: LATAM, Africa, Europe, S.E.Asia and CIS.

Follow our LinkedIn or you can go here and fill out a form to be notified when the report is available.

Global CDN traffic contribution in LATAM, CIS, Africa and Europe

Posted on by
1

We recently announced our Global Data Flow report, analyzing the flow of mass data in our growing DiViCloud network. We are busy finding our way in the masses of information accumulated in our PoPs, so in the meanwhile I wanted to give you a glimpse.

Global CDNs (content distribution networks) play a primary role in traffic flowing into ISP networks, comprising around 40% of the overall traffic volume. The figure below depicts the CDN mixture in various territories.

CDN Traffic Contribution DiViCloud

CDN contribution to ISP’s traffic as measured in the DiViCloud network

The Global Data Flow report will include, inter alia, the contribution of global CDNs  by territory, network, time-of-day and other factors. We will also analyze other sources of content, their logical and geographical flow, as well as overlaps and differences between ISPs in different territories.

Follow our LinkedIn or you can go here and fill out a form to be notified when the report is available.

Infographic – To be or not to be Unique?

Posted on by
Reply

We did a little bit of research to find out if our web surfing habits are really unique like we would all like to believe, or, are we all viewing the same content?

Click on the infographic (you may want to zoom in), and you’ll find out  that 50% of the data traffic has already passed the network – even in a short window of 6 hours. Isn’t that a waste of expensive bandwidth?

In Yair‘s post “we are all individuals,” it was explained that with as little as 150GB of storage at the network edges, most of this redundant data can be saved without any deterioration in service.