Saturday, April 12, 2014

Network Visualization NameGenWeb+UCINest + NetDraw

NameGenWeb

A Facebook application that allows you to download a file that can be visualized with a number of network visualization programs.

UCINet

Takes .dl date from NameGenWeb.

NetDraw

Takes .dl files from UCINet and draws them.

Macros and Notepad++

Here's how to run a macro on a .dl file in Notepad++ to show the central node of the social network graph.
Add another number to the node count (n=) at the top of the file.
Copy all single names to end of the list.
Press the record button. Put cursor at end of first person in the new list's last name. Press the down arrow, then hit end, then space and the person's first and last name in CamelCase, no spaces. Hit stop.
Go to Run, and then Run Macro Multiple Times. Choose "Until End of File". You should have your name in the file.
Add the new name, CamelCased, to the first part of the list.

How_to_Download_Facebook_a_Social_Graph_with_NameGenWeb

http://cyborganthropology.com/How_to_Download_Facebook_a_Social_Graph_with_NameGenWeb

Visualizing Facebook Data – A Short Tutorial

Instructions

1. Open up Internet Explorer and log into Facebook.
3. Allow the application to use your data, if it asks.
4. The page should look like the image below.


5. Click on the UCInet link (it's in purple).
6. You should see the following page. Don't touch your computer or browser while this process completes. It shouldn't take more than 5-7 minutes. Wait until it says “Thank you for waiting”, “Your network is now available”.

7. Either download the file or right click where it says “this link” and “Save Target As...” to save the file to your Desktop or My Documents folder.
8. If you see something that looks like this, then go to File, Save As, and save the file to your Desktop or My Documents folder.

9. Write an E-mail to caseorganic@gmail.com with the file attached. I'll send you back a full resolution image of your network.
10. Or follow the following instructions:
Download NetDraw from UCINet. Take the .dl from NameGenWeb and open it with NetDraw. Use K Core analysis to group the clusters of people together. You should get an image that looks like the following:
Unlabeled Social Network Graph with K Cores
A k-core is a maximal group of actors, all of whom are connected to some number (k) of other members of the group. To be included in a k-plex, an actor must be tied to all but k other actors in the group. The k-core approach is more relaxed, allowing actors to join the group if they are connected to k members, regardless of how many other members they may not be connected to. By varying the value of k (that is, how many members of the group do you have to be connected to), different pictures can emerge. K-cores can be (and usually are) more inclusive than k-plexes. And, as k becomes smaller, group sizes will increase.[1]


The uses of NetDraw are broad and intense. You can read more about them at the UCINet learning center.

About UCINet

UCINET is a social network analysis program developed by Steve Borgatti, Martin Everett and Lin Freeman. The program is distributed by Analytic Technologies. UCINET works in tandem with freeware program called NETDRAW for visualizing networks. NETDRAW is installed automatically with UCINET.

Using Netvizz and Gephi to analyze a Facebook network


http://caseorganic.com/blog/2010/12/tools-for-visualizing-facebook-social-graphs/


Here’s what the output looks like: http://www.flickr.com/photos/49155467@N06/4583993987/sizes/o/

Made with My Online Social Network app for Facebook, and visualized with GUESS.

There’s an excellent Slideshare presentation:
Facebook network analysis using Gephi
Following an announcement on Sept 30 2009, Nexus friend grapher shut down permanently on Oct 7 2009. Nexus generated over 500,000 friend graphs for 84,000 users. It was shut it down because it’s creators no longer had time to maintain or operate it.
The Nexus site suggested a few possible alternatives: Social Graph, TouchGraph Photos, NameGenWeb (data only), Friend Wheel, Facebook friends Constellation. For Twitter, MentionMap.
Only one of these works for Facebook, and that’s Friendwheel. Unlike the others, it doesn’t group users in a way that shows the social gravity between users.
I was able to find another alternative, My Online Social Network app on Facebook, visualized with GUESS.
It also doesn’t work. I was able to find Flickr photos of the output from owners, and I asked them what happened to their apps. No responses yet.

Netvizz

I found Netvizz, which generates GDF files for GUESS and Gephi. http://apps.facebook.com/netvizz/
This is the only thing close to working, but when I run it, I get:
netvizz v0.3
Fatal error: Uncaught exception ‘FacebookRestClientException’ with message ‘This API call could not be completed due to resource limits’ in /var/www/fbapi/netvizz/php/facebookapi_php5_restlib.php:3374 Stack trace: #0 /var/www/fbapi/netvizz/php/facebookapi_php5_restlib.php(1723): FacebookRestClient->call_method(‘facebook.users….’, Array) #1 /var/www/fbapi/netvizz/index.php(124): FacebookRestClient->users_getInfo(’13467,13903,124…’, Array) #2 {main} thrown in /var/www/fbapi/netvizz/php/facebookapi_php5_restlib.php on line 3374
I checked the resource limitations, and it is built to handle networks of up to 4500 connections. I only have 900.
The interface lets you see which of your friends know each other. At any given time it will show one of your friends as the selected node (in bold), and any mutual friends as additional nodes. Lines between nodes represent friendships. Clicking a node will select it and you and the new person’s mutual friends will appear. Finally, the colour of the circles represents gender for now: yellow is female, purple is male, and grey is unknown.
Guess what? It doesn’t work either.
Also, a lot of the source code became part of the Constellation Framework graph visualization library so the creator can’t release it. Although he mentioned on his blog that he was hoping to do another Facebook visualization using Framework and make the source for customizations available, nothing has shown up on his site.

Now what?

Here’s my question: does anyone know of any other solid ways to visualize Facebook network data? If not, is anyone interested in getting the Nexus code back up and running? It’s available and generates the best visualizations I’ve seen out there.
Nexus source code: Nexus-2009-10-14.tar.bz2 (see MUST-README.txt, DEPLOYMENT.txt files)
It’s written in Python and JavaScript, but the code quality is “PHP era” (no test coverage, tightly coupled, other problems). The site creators mention that it will take two days to get a Nexus instance running. If you do not know Python or cannot use a shell on Linux, it will not work for you.

Yes there are. See http://anth.ro/1vT

Google App Engine?

https://developers.google.com/appengine/docs/whatisgoogleappengine

Google App Engine is a Platform as a Service (PaaS) offering that lets you build and run applications on Google’s infrastructure. App Engine applications are easy to build, easy to maintain, and easy to scale as your traffic and data storage needs change. With App Engine, there are no servers for you to maintain. You simply upload your application and it’s ready to go.

The App Engine runtime environment

Google App Engine supports apps written in a variety of programming languages.
  • Java: Using App Engine’s Java runtime environment, you can build your application using standard Java technologies.
  • Python: App Engine features a fast Python interpreter and standard Python libraries.
  • PHP: App Engine uses Google's Cloud Platform services under the hood when you call standard PHP functions.
  • Go: App Engine features a Go runtime environment that runs natively compiled Go code.
Google App Engine makes it easy to build and deploy an application that runs reliably even under heavy load and with large amounts of data. It includes the following features:
  • Persistent storage with queries, sorting, and transactions.
  • Automatic scaling and load balancing.
  • Asynchronous task queues for performing work outside the scope of a request.
  • Scheduled tasks for triggering events at specified times or regular intervals.
  • Integration with other Google cloud services and APIs.
Applications run in a secure, sandboxed environment, allowing App Engine to distribute requests across multiple servers, and scaling servers to meet traffic demands. Your application runs within its own secure, reliable environment that is independent of the hardware, operating system, or physical location of the server. For a full list of features, see our Features page.

YASIV

Yasiv tool - http://blog.yasiv.com/

...

Visualizing communities of reddit.com 

How exactly does it work?

I get information about all subreddits (communities) from reddit.com/reddits and store it in Google App Engine. 


yasiv for facebook: 
http://www.yasiv.com/facebook


http://www.yasiv.com/youtube#/Search?q=zappa