Gocen
A developing handheld optical device which can read and play handwritten musical scores in real-time - via DigInfo:
The Gocen is a device which scans and plays handwritten sheet music in real time. It is being developed by a group at the Tokyo Metropolitan University led by Assistant Professor Tetsuaki Baba.
“First, the system looks at the stave, then at the notes, then at the position of the notes, to determine the high notes. In addition, it directly reads words such as piano or guitar. The computer automatically recognizes them, and changes the instrument. Also, for example, if this melody is in F minor, rather than C major, when the system reads the letters Fm, it has the ability to add four flats.”
The sheet music image is analyzed using the OpenCV library in combination with a unique algorithm. While the play head is above a note it will continue to sound that key, and in the case of stringed instruments, if you move it up and down it can make the pitch fluctuate. Also, the size of the notes determines the volume level and it can handle chords as well.
More at DigInfo here
Computer IDs Culprits with Tattoo Recognition
Computer visual recognition software in development to identify people by their unique marks - via Live Science:
The face might be the obvious place to start for Facebook, homeland security and other groups interested in automatically identifying people in photos. Indeed, face recognition is one of the biggest areas of research in identification and security. Adding in tattoos and other marks, however, gives law enforcement an edge in using evidence where the suspect’s face isn’t clear.
“Let’s talk about standard police-type action,” said Terrance Boult, a computer science professor at the University of Colorado at Colorado Springs and a co-founder of a security startup, Securics Inc. In many police investigations, officers have to contend with grainy, low-quality photos that a bystander might have taken on his phone, or that a store camera captured, he said. “Those photos are often so bad that face recognition wouldn’t come even close” to finding a match in a photo database, such as the FBI’s, he said.
To help with these difficult matches, Boult and his colleagues wrote a computer program that examines the tattoos, scars, moles or other skin markings in a new photo, then finds likely matches in a photo database. The program is able to find similar tattoos that are not exactly the same, but which might help identify gang members who get coordinating ink. And it is able to make matches based on eyewitness descriptions that a cop might type into the program.
Kittydar
Face recognition tech for cats (written in javascript) - online demo allows you to drag a cat photo to be analysed:
Kittydar is short for kitty radar. Kittydar takes an image (canvas) and tells you the locations of all the cats in the image …
Kittydar is best at detecting upright cats that are facing forward.
You can test the demo here - if you want to know more from a programming level, there is more at it’s Github page here
Avatar mirrors users facial expressions in real-time using a standard webcam
Via DigInfo News:
A Keio University group, led by Associate Professor Yasue Mitsukura, has developed a method for measuring which way a person is facing and how their expression changes. This system achieves high speed and high precision, using an ordinary PC and a USB camera.
“We think this system could be used by CG animation hobbyists, in Web dialog systems that show a character instead of the person’s face, and for making characters move in real time at events. Because the system uses just one PC and one camera, it can be applied in many situations very easily.”
Live Subtitles
Art installation from 2005 by Gareth Long used speech-recognition software to capture what people were saying around the piece, and were printed onto paper as well as projected onto a screen.
A transcript of one of the captures is available here, although it is very repetitive and almost abstract it has a visual pattern quality as you scroll through.
Hye Yeon Nam - Please Smile (Robotic Installation, 2011)


Interactive installation featuring five skeleton arms, whose hands react in unison based on facial gestures - if you smile and wave ‘hello’, all hands wave back …
“Please smile” is an exhibit involving five robotic skeleton arms that change their gestures depending on a viewer’s facial expressions. Audiences interact with “Please smile” in three different ways. When no human falls within the view of the camera, the five robotic skeleton arms choose the default position, which is bending their elbows and wrists near the wall. When a human steps within the view of the camera, the arms point at the human and follow his/her movements. Then when someone smiles in front of it, the five arms wave their hands.
More information can be found here
Choco Printer
Machine analyses your image, and draws your face on a biscuit with chocolate.
Kinect finally fulfills its Minority Report destiny (video) via Engadget
Not to denigrate the numerous fine hacks that Kinect’s undergone since its launch, but it’s always nice to see the professionals come in and shake things up a little. A crew from MIT’s brain labs has put together a hand detection system on Microsoft’s ultra-versatile cam, which is sophisticated enough to recognize the position of both your palms and fingers. Just as a demonstration, they’ve tied that good stuff up to a little picture-scrolling UI, and you won’t be surprised to hear that it’s the closest thing to Minority Report’s interactive gesture-based interface that we’ve seen yet. And it’s all achieved with a freaking console peripheral.
[Link]
Hand gestures that trick facial recognition software