From Boids to Documents – Part 2
Posted: July 20, 2012 Filed under: Human and Computer Interaction, Research | Tags: App, Boids, C++, HCI, Independent Elements, Publication, Research, Visualization, WinAPI 2 Comments »If you haven’t read Part 1 head there!.
This year we started the development on this new version of the boids program. The idea: each element is a document, and they can be grouped by similarity.
In order to create such a thing now we needed a parser module that read documents like PDF files and create a data structure that provides the similarity between each of them. That was done entirely by a partner while I was focusing in the visualization itself.
As the paper describes the idea was to create a 4th rule to the Boids Algorithm that basically will direct the element to get nearer other similar elements. There are several ways to do this and they are described on the publication. We applied that idea along a modified algorithm designed by myself that easily takes the similarity values into cohesion like behavior. The results were pretty impressive after some tweaking on the other rules.
The new version supports full navigation and selection of individual elements. The title of the document can be seen while a selection is made.
To provide more insight to the user on the visualization we developed a coloring code were the user simply selects a keyword and the documents that contain that keyword would be highlighted with a user selected color. Going beyond that, the user could select an element to show the title of that particular document and even open it from that interface.
We also added freeform movement and other interactions that let the user move around the 3D space.
Boids 2.0 supports coloring of up to two keywords, so the documents that contain a particular them are highlighted, if they contain both keywords they show a mixed color. All these features can be configured by the user in real time.
In other words, we developed a whole different way to browse documents and the application served as a proof of concept for a different take on visualizing documents. And we didn’t stop there.
Tune in next time to know how we added Kinect support to the whole thing!.
From Boids to Documents – Part 1
Posted: July 19, 2012 Filed under: Human and Computer Interaction, Research | Tags: Boids, C++, HCI, Independent Elements, OpenGL, Stereoscopy, Visualization, WinAPI 2 Comments »Here’s some information on the projects as promised.
On Summer 2010 I was approached by my HCI instructor, I have already told him about my interest in the area and that I feel good to go and start working on some projects. My instructor expertise relies on Data and Scientific Visualization and he had something beign cooked at the moment. A fellow student was working in a independent agents program that visualizes several objects in a 3D space with a very dynamic behavior inspired by nature: they tend to group and navigate in this space just like flocks of birds, swarm of insects and banks of fishes do, and they can react to their environment in different ways.
This “Boids” algorithm is very popular and is used in several graphical applications like videogames and movies due to its approximation to the real behavior of these animals without necessarily simulating the way nature does, all with very simple algorithm that is not heavy computationally speaking. Being it for real time or pre rendered presentations the technique really outstanding.
Sort of like that, get the idea?
Well, I jumped into the project and did some optimization to the code and developed some interactions that were needed to further use the application in experimental setups, later we added 3D stereo to it using active shutter glasses, and let me tell you, watching thousands of elements floating out of the screen can be pretty amazing.
Screenshot of First version of the Boids Program rendering 5000 elements
The previous picture shows about five thousand elements forming groups on 3D space. You could put other objects that can be either attract (food) or repel (predators) the boids, and you will see them reacting exactly as animals with similar behavior will do. Everything was done using C++, WinAPI and OpenGL. Project was finished and ready to go.
Fast-forward to 2012, a theoretical research was going on based on this technique: What if each element metaphorically represented a document? Well yes it would be a mess, but what if we can actually sort them out by some factor of similarity? No we are talking; we could visualize big structures of documents grouped together in clusters according to its similarity.
That’s what the newest paper is all about, and I’ll tell you how we developed a prototype in the next post.