Critics in a community - VAST Challenge 2008 discussion
Yesterday was my first day, and also the first time at the VisWeek conference. Needless to say I was a bit overwhelmed by everything going on around, landing in a hotel surrounded by people I was in awe of (some of them are real humans), not knowing anybody and feeling like a Lilliputian amongst giants.
In the evening there was a discussion session about the VAST Challenge from all the participating teams (73 in total). This was the event I was most looking forward to, and the event I was hoping to get to meet some interesting people and make some new friends in the InfoVis community. So we sat down for the discussion and after a brief introduction the participants started making their comments. Comments from the participants started flying out like submachine gun fire, and the analogy isn't entirely out of place. It seemed that all anybody from the audience had to say was criticise the organisers.
I remember that when I was tackling the challenge, I found the dataset interesting, challenging and appreciated the work involved in generating it. Sitting there amongst the audience hearing all these negative things being thrown at the organisers, I almost felt that they were offending me. I went home thinking what a bunch of proud, arrogant, people. Is this the community I want to make part of?
I woke up this morning and I was still thinking about this. (It's 6am when I'm writing this). This morning though, maybe because of the caffeine dose, I started rationalizing. I thought, well, maybe a community needs critics. Maybe to improve something and make it better next year, there have to be people who criticise. Some of the criticism was valid, when you think of it rationally and leave your personal emotions behind. Needless to say though that some of the criticism was not constructive at all and was only a big dick wiggling exercise.
Thinking about it, I think critics do play a role in a community. Their suggestions can help improve the product each year, and I think that the VAST Challenge is a living proof of this, considering the great progress the challenge made since it started.
Having said this, being constructive, offering suggestions, and adding some sugar coating around the negative comments, doesn't hurt either. Your professional peers were involved in this work, so having some tact and showing appreciation is due. I'm sure that the vast majority of the people do appreciate but letting this appreciation be known is no harm.
Hopefully someday I will be up there doing something for the community, and I will be the one who gets criticised. When that day comes I hope to remember this first experience, and realise that criticism can be important for improving even though it can hurt. There are also people who do appreciate the work and think it's great, but usually these are the quiet ones.
1164. infosthetics on 10/20/2008
Hmmm, I do remember my first Infovis Conference panel as a research student. Unfortunately, the experience was quite similar to yours. The topic was about the state of the visualization field, and why none of the discoveries in the field were applied in commercial or publicly available applications. Anyway, I haven't found an academic community that is so self-critical, to the extent of self-destructive. I am still trying to get used to it :)...
(Did not like the requirement to sign up for this blog, by the way)
1165. Mike Black on 10/21/2008
On Monday (yesterday) in the grand challenge discussion a member of the audience made a point that the InfoVis community should get over its Inferiority Complex and it's Ego Trip. It was met by nervous laughter and (hopefully) some introspection. Good point.
I agree with you, it's a bother to have to register to post comments. I think more people would if there wasn't that need. Unfortunately that's a requirement of the platform I'm being hosted on. Thanks for taking time to register and comment though.


