Thursday, June 26, 2008

Narrative Theater Design Conception

To review, the Narrative Theater is the IntelliMedia lab's latest and greatest project which we are (I am) kicking off this summer.  The first stage of the project is to construct software that will allow students to write short stories (maybe size constrained?) into a simple text editor, press a button, and see their stories realized in movie form using 3D game engine technology.  There should be multimodal character behavior and interaction, discourse-based camera control, text-based and voice-over narration (how we'll do this one I have no clue).

My original conception was to attempt to effectively render a story in a very "expert" way from the story that a student writes.  This was a seriously imposing task because of the sheer size of the space of stories students could come up with.  But rather than fret about the challenges of properly rendering the story in some wonderfully cinematic way from students' texts, why not treat our limited understanding and rendering capacity as a "feature".  Rather than offering students the promise of well rendered movies based on their stories, why not quietly encourage them to test the capacity of our system and see what they can get it to render.  In this way, students will be iteratively refining their stories to explore the system rather than refining their stories to simply make their stories better.  In that way, we need to have a tight, rapid feedback loop that will encourage iterative writing and revising.  Movie rendering needs to happen quickly.  We also need to provide them with hints as to how they can get results so that they don't just get tired of playing with the system.  More so, there should be mechanisms for students to record, bookmark and SHARE their stories+movies with their classmates.  In this way, we can foster semi-collaborative exploration of the story space.  Students could see what other students are writing and the effects of their writing on the resulting visual representation.

I am now much more excited (aka less intimidated) about this project, because it removes some of the burden of having comprehensive understanding and rendering technologies (which are probably currently impractical, even in the restricted domain).  Rather than try to take on too much, lets leverage the strengths of the problem and existing technological shortcomings to our advantage.


Monday, June 16, 2008

Booting Up

I am starting this blog as a means of recording thoughts and experiences as I doggedly pursue my PhD in Computer Science.  I am working with Dr. James Lester in his IntelliMedia Center for Intelligent Systems at North Carolina State University, with a focus on intelligent narrative systems for education.  My larger interest is intelligent human computer interaction, and games is an almost perfect test bed for research in this area.

I have just finished reading one of Michael Mateas's and Andrew Stern's older papers, titled: Towards Integrating Plot and Character for Interactive Drama.  It's a nice collection of thoughts from  back in Facade 's earliest days, and it serves as a nice overview of their reasoning behind several of the architectural decisions that they made while creating Facade.  There is a particularly nice discussion about the issue of strongly autonomous characters, the computational implications of their strong autonomy in interactive narrative, and why they steered away from this direction.  It systematically and succinctly describes many of the theoretical challenges that they faced in designing a "complete" interactive drama.  I think these thoughts can be particularly helpful as I conceive of a more interactive narrative version of Crystal Island.  It would also be a good early paper for a course in interactive narrative.

I am currently juggling a couple of balls in trying to decide what direction to take my virtual character work for my written prelim exam while coupling it into an overall vision for the new projects within our lab.  In particular, I am thinking about our new CreativeIT funded project, the Narrative Theater.  But more on that later. . .