| 
  • If you are citizen of an European Union member nation, you may not use this service unless you are at least 16 years old.

  • Whenever you search in PBworks, Dokkio Sidebar (from the makers of PBworks) will run the same search in your Drive, Dropbox, OneDrive, Gmail, and Slack. Now you can find what you're looking for wherever it lives. Try Dokkio Sidebar for free.

View
 

Projects

This version was saved 12 years, 7 months ago View current version     Page history
Saved by Jim Davies
on April 17, 2010 at 6:48:53 am
 
Visual Imagination Modeling
--------------------------
When I say I walked my dog this morning, you can picture what that looks like, even though I have told you nothing about where it was, what kind of dog I have, etc. People bring lots of knowledge to bear on their visual imaginations. How is this knowledge used to create imaginings?
This project's long-term goal is to create a computer-program model of human imagination.
In the short term, I am using the results of psychological experiments and data from image information to create a demo. This demo should be able to take simple inputs (e.g. a cat and a house) and create a visual image that has those elements in them, in a way that has some psychological plausibility. Visuo, Detectors, and the Image Oracle are sub-projects.
Detectors:
We have built several programs that report on spatial characteristics and relationships in peekaboom data (e.g., above, occluding). The detectors output a fuzzy belief value between 0 and 1, representing how true the agent believes the relationship to be in the input image. There are several directions we are going with this work:
     Publishing the Detectors:
        We want to publish AI papers based on the detectors as cognitive models. (Connor Smith)
        We also want to publish psychological studies that compare them to human data. (Kensi Dickinson, Michael Forceno)   
      Image Retrieval:
         We are building an image search engine that retrieves from the peekaboom dataset images that have the input description (e.g., bird over tree). (Connor)
      Integration with Visuo:
          Visuo will use the fuzzy belief values output by the detectors as input in its training phase to encode the meaning of prepositions. (Connor, Sterling, Jonathan)
Visuo:
Visuo is a cognitive model of estimation of quantitative magnitudes (e.g., height, size). It takes in data in the training phase. In the visualization phase it uses analogy to estimate magnitudes of things it has never experienced before. Some papers have been published on this work already.
    Integration with Image Oracle:
          The image oracle outputs distance and angle data that Visuo will take as input. (Sterling, Cesar, Jonathan)
    Integration with Detectors:
           See detectors description.
     Natural Language Interface:
           Trying to replicate the work of Wordseye, so that complex paragraphs can be turned into Visuo input (David Dodds)
Image Oracle: 
 
The Lake Cognitive Architecture
-------------------------------
Cognitive models are computer programs made to imitate how people think. Many are special-purpose, for one cognitive task. My dissertation was a cognitive model. A cognitive architecture, in contrast, is a piece of software that you use to create models. So it's got a memory system, attention, etc., that 1) help you create specific models with it, and 2) constrain the model you create so it's forced to be realistic. There are only about 15 in the world.
 
 

 

Comments (0)

You don't have permission to comment on this page.