Posts tagged ‘internet’
Mapping Wikipedia
I was reading reddit the other day and stumbled upon the fact that wikipedia has an API. Neat I thought, and having some free time since my exams are now over I figured I would play around a bit with it. When I browse wikipedia I often click from link to link, and have come to the conclusion that all articles are 6 degrees of separation. For example I can go from Ubuntu to Tesco to Japan to G8 to United States to George W. Bush bet you never knew Ubuntu was connected to George W. Bush. I once wrote a map of the internet program that people seemed to like to download and modify so in that spirit I wrote wikimap.py to map wikipedia. wikimap.py Requires pygraphviz (Install using sudo aptitude install python-pygraphviz). To use the program simply run the program and give it the wiki page name for example “python wikimap.py Norman_Graham” Note that Ubuntu is Ubuntu_(Linux_distribution) and you can find the full name in the address bar of your browser. For more complicated maps use wikimap.py –help for full usage info.
Here are a few examples that I created with wikimap.py
And a really large one being viewed in inkscape.
More examples including the dot files can be found at http://www.files.earobinson.org/wiki/. But there are a few features I would like to add:
- Generating the graph using python-pygraphviz currently takes a really long time and I would like to be able to do it faster
- Page links currently include templates, I would like to only use links in the body of the text
- It would be nice if the software cached previously seen connections. (But then I need to detect updates to that page)
If anyone has a nice simple soultion to any of those problems leave a comment. Also if you are able to generate any neat images I would love to see them.
Map of The Internet
The other day I stumbled upon Chris Harrison’s internet map, the only problem I found with his map is that I wanted to know exactly which country each network connection was in. So using the DIMES public data repository, and 1site1moment’s country boarders I have mapped the internet for myself.
 |
| From Public |
Feel free to download the source code and come up with your own internet map, I would love to see what other people can come up with.
UPDATE 01: Image is back up, If the source code link wont work for you email me and I will send you a copy. Feel free to host this anywhere you like just post a link back to this site.
UPDATE 02: Source code can now also be found here.
UPDATE 03: Would love to see what other people can do with this.
