Dining Band @ NY Tech Meetup = internet fame

Zainab, Omar, Youssef and Matthew did an amazing job presenting the MOUSE Corps Legacy Project: Dining Band at NY Tech Meetup on Tuesday – in front of 500+ tech innovators.   Their demo totally inspired the NYTM community:

Watch their demo here: http://bit.ly/158V6Fa

Thank you to NY Tech Meetup for inviting us – and we can’t wait to show you our student’s new assistive/adaptive tech prototypes in partnership with United Cerebral Palsy!

Women’s workshop at Clear

I learnt a lot for the workshop with the female workers at Clear. It was interesting because I got to found out the secrets of how a company that works a lot behind the scenes, but is never given credit in front of the audiences work. Clear goes through a long chain of process, with each different group working together. I find that very interesting because that long process is only one tiny step to a product for a company to be sold to the audiences that likes the advertisement. However, one thing I was wondering about during the workshop was what do they do if they’ve finished gathering a final idea for company A’s new product and Company A doesn’t reply back. I was thinking they might just go on with another idea for Company B and wait for Company A to reply on their idea.

During this workshop, we had each had a chance of talking to the female workers at Clear about our Legacy projects. I was talking to a lady named Hayley and she said her brother was color-blind and he was in college. She said he sometimes had so much trouble with deciding what to wear because of his disability and because of that he would even send her pictures of himself wear the clothing and askign her opinion on how it is. From this conversation, I got a strong feeling that if the Fashionator were to be finished and finalized, many people would be able to benefit from it and the original goal, to help the blind and the visually-impaired, would be reached to the greatest extend.

I’m so glad I was able to go to this meeting. I learned a lot of useful information and I’m glad I can finally be able to decide what my major(s) are and what can I do for my future as well as the world.

MOUSE Corps Legacy Projects win at the Emoti-Con Festival!

Big congrats to the Dining Band Legacy Project team for winning the top prize at this year’s Emoti-Con Festival!

article from MOUSE.org:

MOUSE, a national nonprofit organization that empowers and inspires underserved youth, is pleased to announce its students being recognized for their innovative projects at the 4th Annual Emoti-Con! 2012 Digital Media and Technology Challenge! Emoti-Con! brings together middle and high school students from across New York City to share their passions in technology, present their digital creations, and network with peers and industry professionals.

“Emoti-Con! is an extremely unique opportunity to showcase the work of a new generation of innovators and thinkers, who are passionate about sharing their perspectives and making a positive change in the world through digital media and technology,” said Marc Lesser, Education Director, MOUSE.

More than 150 students presented their technology projects at Emoti-Con! 2012, through their involvement with other NYC-based nonprofit organizations including DreamYard, The Museum for African Art, The Parsons Scholars Program, Girls Write Now, Global Kids, WNYC Radio Rookies, MOUSE, New York Public Library, and Institute of Play.

Sixty students and educators attended from MOUSE, presenting a wide range of technology and digital media projects involving 3D printing and design, anti-bullying games and videos, and technology to assist the visually impaired or those with special needs.

Youth projects were judged in the following categories: Best Pitch, Most Innovative, Most Potential for Social Impact, Most Entertaining and Favorite Project. Students from MOUSE were honored to be recognized with three of these five awards. Judged by their peers, the Emoti-Con! 2012 winning projects were:

  • Best Pitch and Favorite Project: The Dining Band, designed and developed by MOUSE high school students, this project provides a location and temperature sensor wrist band to assist the blind or visually impaired while eating
  • Most Innovative: T.A.P. Project, created by the P256Q MOUSE Squad, includes a series of assistive technology inventions that offer easy solutions to everyday tasks involving fine motor skills
  • Most Potential for Social Impact: A multimedia documentary about “stop and frisk” produced by a high school student through his participation in WNYC Radio Rookies
  • Most Entertaining: A space-themed video game built on Scratch and Arduino, designed and programmed by a 6th grader during an after school program with Institute of Play

Emoti-Con! is designed, organized and led by youth that are guided by a steering committee of educators and youth professionals from Global Kids, MOUSE, New York Public Library and Parsons The New School for Design. These organizations, as well as those that brought youth to present projects, are all members of Hive Learning Network NYC, a network of 39 nonprofit organizations dedicated to creating new digital learning opportunities for youth.

“Emoti-Con! illustrates what’s possible when organizations and youth from across the city come together to celebrate their passion for creating, building, making and learning using digital media and technology,” said Chris Lawrence, Director of Hive Learning Network NYC. “The entire process – from developing their projects to meeting with successful media and technology professionals – offers youth a transformative learning and entrepreneurial experience and reveals real pathways towards college and career readiness.”

About MOUSE
MOUSE empowers underserved youth to learn, lead and create with technology, preparing them with skills essential for their academic and career success. Founded in New York City in 1997, MOUSE is a dynamic nonprofit organization having a positive and lasting impact on students in more than 350 locations in the United States, including in New York, California, Chicago and Texas, as well as a global presence in more than 50 countries. To learn more about MOUSE, visit http://www.mouse.org.

About Hive Learning Network
NYC: Hive Learning Network NYC is a Mozilla project that was founded through The MacArthur Foundation’s Digital Media & Learning initiative to fuel collaborations between cultural organizations and create new learning pathways and innovative education practices together. Hive NYC is comprised of thirty-nine nonprofit organizations—museums, libraries, media and other youth-facing organizations—that create opportunities for youth to explore their intellectual and skill-based interests using digital media and other technologies. Network members have access to funding to support this work through The Hive Digital Media Learning Fund in The New York Community Trust. For more information please visit http://www.explorecreateshare.org. Also visit http://www.facebook.com/EmotiConNYC ¬or Twitter @EmotiCon_NYC.

Extra Tech Mentor Meeting w/ Joe

-We began the meeting with soldering the battery to the switch
-We learned more about how the arduino code works from Joe
*boolean- Can only be one or two states i.e. true or false, on or off, yes or no
-3 Short Pulses: On
-1 Long Pulse: Off

  • 5 Short Pulses: Close
  • The distance sensor numbers jumped around a lot so we are now join to sample 30 numbers and average them to get a more accurate and reliable sensor.

-We are trying and modifying different enclosures for the final product
-We have made our enclosures and finished our final patches of code
-The Dining Band Prototype is COMPLETE!!!

3rd Mentor Meeting w. Joe (Final Prototype)


-We previously ordered a temperature sensor from China and it had arrived
-Joe worked on the vibration motor and he edited the code
-We are attaching the pin via soldering to the mini arduino so that we can program it
-We are attaching two female header pins to the mini arduino
-We are using a protoboard to hold the circuit
-We are attaching two male header pins to the protoboard
-We are going to need to control the vibration motor through a transistor on an arduino
-We are going to convert USB to FTDI
-We are assembling our final circuit
-We are going to connect the middle pin of the transistor to a digital pin (d4) to control the vibration motor
-We are going to attach the vibration motor to the VCC (Positive)
-We are going to connect the distance sensor to the circuit
Blue-Positive
Black-Ground
Red-Digital Pin
-Solder Analog Distance sensor to A0

  • We are going to check if the distance sensor is programmable

-The On/Off button is attached to a digital pin (d7)
-We are going add an LED to the On/Off button so as to debug it and for us to know if the prototype is on eating mode or not
-10 ohm resistors (for the button)
-We are connecting the LED to a digital pin (d11)
-We created an enclosure for the prototype
-We are now connecting the distance sensor
-We are going to code so that arduino can be programmed to test the temperature sensor
testing. mission completed.
-We are going to attach the temperature sensor to the circuit
-Solder temperature sensor to A2
-We are to use hot glue to insulate the back of the sensors
-The sensor calculates temperature in Celsius

  • We are going to put the circuit in the enclosure (FINAL STEP)

Prototyping the SmartChair

If you guys want to check out more of the pictures we have of the development of the SmartChair feel free to check them out at http://www.flickr.com/photos/chase_0704/sets/72157629841017393. There are tons of pictures from the hardware to the field tests.

 

Today we are currently making adjustments to the way the wires are placed on the SmartChair and I am working on fixing up the code, I want to be able to have the SmartChair say a command but prevent the command from being constantly repeated, if we have time today hopefully we will also re-record the audio files to sound more natural and friendlier.

Prototyping the SmartChair

We didn’t know what the problem was before Joe arrived, we couldn’t get the wave shield to access the SD card, but when Joe told us that we didn’t read the instructions correctly, it was a very upsetting roadblock. We forgot to solder four wires, now that it works we came across another problem with some files not playing, which was quickly fixed by shortening the file names of the files. Another problem that arose was a software error, the code had an extra portion of the code that told the wave shield to skip a file, that was quickly fixed by removing about 3 lines of code. We are also going to instead of soldering the wires onto the circuit we are going to add female headers just in case we want to rearrange the wires at a later time. For the LV-MaxSonar- EZ1, we want to give multiple warnings so when the sensor outputs around 210 it will give the first warning and when it outputs 160 it will give a second warning. We also tested the Prototype outside, the sensors worked outside, people parted their way for the person on the wheelchair, which made testing the sensors so much easier. Our prototype is starting to come together however we still have the data values correct because we don’t want the same sound reiterating constantly

Here’s our code for the project, including all drafts and test Arduino sketches! Don’t forget that you need to install the WaveHC library from Adafruit before you try to run this code.

Awesome job today!!

The Problem that Arose Today (SmartChair)

We wanted to test the wave shield with a new SD card, but the code wouldn’t flash properly on the arduino. We tried everything from correcting the code to downloading the scripts from the official wave shield website. Hopefully our tech mentor will save the day!

Here is the errors that arose prior to flashing:

_smartChair_02.cpp:1:23: error: FatReader.h: No such file or directory
_smartChair_02.cpp:2:22: error: SdReader.h: No such file or directory
_smartChair_02.cpp:4:22: error: WaveUtil.h: No such file or directory
_smartChair_02.cpp:5:20: error: WaveHC.h: No such file or directory
_smartChair_02:6: error: ‘SdReader’ does not name a type
_smartChair_02:7: error: ‘FatVolume’ does not name a type
_smartChair_02:8: error: ‘FatReader’ does not name a type
_smartChair_02:9: error: ‘FatReader’ does not name a type
_smartChair_02:11: error: ‘WaveHC’ does not name a type
_smartChair_02.cpp: In function ‘void sdErrorCheck()’:
_smartChair_02:42: error: ‘card’ was not declared in this scope
_smartChair_02:43: error: ‘putstring’ was not declared in this scope
_smartChair_02:44: error: ‘card’ was not declared in this scope
_smartChair_02.cpp: In function ‘void setup()’:
_smartChair_02:55: error: ‘putstring_nl’ was not declared in this scope
_smartChair_02:59: error: ‘putstring’ was not declared in this scope
_smartChair_02:78: error: ‘card’ was not declared in this scope
_smartChair_02:85: error: ‘card’ was not declared in this scope
_smartChair_02:90: error: ‘vol’ was not declared in this scope
_smartChair_02:103: error: ‘vol’ was not declared in this scope
_smartChair_02:106: error: ‘root’ was not declared in this scope
_smartChair_02.cpp: In function ‘void playcomplete(char*)’:
_smartChair_02:247: error: ‘wave’ was not declared in this scope
_smartChair_02.cpp: In function ‘void playfile(char*)’:
_smartChair_02:255: error: ‘wave’ was not declared in this scope
_smartChair_02:259: error: ‘f’ was not declared in this scope
_smartChair_02:259: error: ‘root’ was not declared in this scope
_smartChair_02:260: error: ‘putstring’ was not declared in this scope
_smartChair_02:265: error: ‘wave’ was not declared in this scope
_smartChair_02:265: error: ‘f’ was not declared in this scope
_smartChair_02:266: error: ‘putstring_nl’ was not declared in this scope
_smartChair_02:271: error: ‘wave’ was not declared in this scope

Fashionator Updates

-First prototype of last screen done, and online in Scratch website
-Play with scratch and add sounds to the last screen
-Add more pictures and edit them to different sections of one outfits
-Next meeting: Wednesday, April 18, 2012 4:00PM

Our Goals for the SmartChair

User Exp
Approaching moving or stationery objects but doesn’t say if its moving because it doesn’t matter
Warns user to prevent from going out into the street
Warns distance of the curb from the current location of the User
Tells the distance of the building from the User
Wheel-alignment sensor
User input(a button that will potentially tell the User which direction they are going)
ON/OFF SWITCH

Side Goals:
Tells the user which side the curb would be
Tell the user how long they have before they hit the object or curb

We also finished the code and recordings for the user portion of the project, we ran into a little trouble with the circuit working, we think it could be because we used a SDHC card instead of a SD card, tomorrow we are going to test it with a regular SD card, if it is the circuit itself, Joe will be our savior and make a second working circuit!

Here is the code that Joe worked on

#include
#include
#include
#include “WaveUtil.h”
#include “WaveHC.h”

SdReader card; // This object holds the information for the card
FatVolume vol; // This holds the information for the partition on the card
FatReader root; // This holds the information for the filesystem on the card
FatReader f; // This holds the information for the file we’re play

WaveHC wave; // This is the only wave (audio) object, since we will only play one at a time

#define DEBOUNCE 5 // button debouncer

// here is where we define the buttons that we’ll use. button “1” is the first, button “6” is the 6th, etc
byte buttons[] = {
3,4,5,6,7,8};
// This handy macro lets us determine how big the array up above is, by checking the size
#define NUMBUTTONS sizeof(buttons)
// we will track if a button is just pressed, just released, or ‘pressed’ (the current state
volatile byte pressed[NUMBUTTONS], justpressed[NUMBUTTONS], justreleased[NUMBUTTONS];

int currTrack = 0;

// this handy function will return the number of bytes currently free in RAM, great for debugging!
int freeRam(void)
{
extern int __bss_end;
extern int *__brkval;
int free_memory;
if((int)__brkval == 0) {
free_memory = ((int)&free_memory) – ((int)&__bss_end);
}
else {
free_memory = ((int)&free_memory) – ((int)__brkval);
}
return free_memory;
}

void sdErrorCheck(void)
{
if (!card.errorCode()) return;
putstring(“\n\rSD I/O error: “);
Serial.print(card.errorCode(), HEX);
putstring(“, “);
Serial.println(card.errorData(), HEX);
while(1);
}

void setup() {
byte i;

// set up serial port
Serial.begin(9600);
putstring_nl(“WaveHC with “);
Serial.print(NUMBUTTONS, DEC);
putstring_nl(“buttons”);

putstring(“Free RAM: “); // This can help with debugging, running out of RAM is bad
Serial.println(freeRam()); // if this is under 150 bytes it may spell trouble!

// Set the output pins for the DAC control. This pins are defined in the library
pinMode(2, OUTPUT);
pinMode(3, OUTPUT);
pinMode(4, OUTPUT);
pinMode(5, OUTPUT);

// pin13 LED
pinMode(13, OUTPUT);

// Make input & enable pull-up resistors on switch pins
for (i=0; i< NUMBUTTONS; i++) {
pinMode(buttons[i], INPUT);
digitalWrite(buttons[i], HIGH);
}

// if (!card.init(true)) { //play with 4 MHz spi if 8MHz isn't working for you
if (!card.init()) { //play with 8 MHz spi (default faster!)
putstring_nl("Card init. failed!"); // Something went wrong, lets print out why
sdErrorCheck();
while(1); // then 'halt' – do nothing!
}

// enable optimize read – some cards may timeout. Disable if you're having problems
card.partialBlockRead(true);

// Now we will look for a FAT partition!
uint8_t part;
for (part = 0; part < 5; part++) { // we have up to 5 slots to look in
if (vol.init(card, part))
break; // we found one, lets bail
}
if (part == 5) { // if we ended up not finding one :(
putstring_nl("No valid FAT partition!");
sdErrorCheck(); // Something went wrong, lets print out why
while(1); // then 'halt' – do nothing!
}

// Lets tell the user about what we found
putstring("Using partition ");
Serial.print(part, DEC);
putstring(", type is FAT");
Serial.println(vol.fatType(),DEC); // FAT16 or FAT32?

// Try to open the root directory
if (!root.openRoot(vol)) {
putstring_nl("Can't open root dir!"); // Something went wrong,
while(1); // then 'halt' – do nothing!
}

// Whew! We got past the tough parts.
putstring_nl("Ready!");

TCCR2A = 0;
TCCR2B = 1<<CS22 | 1<<CS21 | 1<<CS20;

//Timer2 Overflow Interrupt Enable
TIMSK2 |= 1<<TOIE2;

playcomplete("hello.WAV");
}

SIGNAL(TIMER2_OVF_vect) {
check_switches();
}

void check_switches()
{
static byte previousstate[NUMBUTTONS];
static byte currentstate[NUMBUTTONS];
byte index;

for (index = 0; index 10){
currTrack = 0;
}
}

// Plays a full file from beginning to end with no pause.
void playcomplete(char *name) {
// call our helper to find and play this name
playfile(name);
while (wave.isplaying) {
// do nothing while its playing
}
// now its done playing
}

void playfile(char *name) {
// see if the wave object is currently doing something
if (wave.isplaying) {// already playing something, so stop it!
wave.stop(); // stop it
}
// look in the root directory and open the file
if (!f.open(root, name)) {
putstring(“Couldn’t open file “);
Serial.print(name);
return;
}
// OK read the file and turn it into a wave object
if (!wave.create(f)) {
putstring_nl(“Not a valid WAV”);
return;
}

// ok time to play! start playback
wave.play();
}

Our First Tech Mentor Meeting(Smart Chair)

We are discussing how we would want the SmartChair to function. We are comparing different types of sensors for each task we want our prototype to accomplish. We are dividing the functionalities of the chair in inputs and outputs. The questions that arrise is “What types of input is needed?” “How will we output this data?” “What data will the User need?”. Our tech mentor, Joe Saavedra, explained to us the input/ sensors that we will be most likely be using:
Accelerometer
Infra Red Sensor
Magnetometer(aka Compass)
Sonar Sensor(Ultra Sonic)
The output would be through audio communications, as well as tactile vibrations to aid in the user’s communication with the SmartChair
Our team is hopefully going to start tinkering with our prototype by the next tech meeting which will be on Monday April 9 at 2PM

Yesterday we met our tech mentor at mouse…

Yesterday we met our tech mentor at mouse HQ. Since our legacy project is a application our mentor was a programmer that graduated from NYU. We told him about our legacy project. we told him about our prototype and he liked it. He asked a couple a questions concerning the prototype and he asked if we had the software to start off the project and we did not. So he introduced us to a program called Processing. (www.processing.org).it is a program that utilizes Java script code. After that we grabed some macs and we started to learn about it. For the people that were not there we used go to the website and click on learning, after that what you would click on is basic and click getting started then the rest should be easy.

Fashionator updates

1. A blind/visually impaired person need to attend a certain occasion, but they don’t know the thing to wear that will allow them to blend in easily.
2. We will work from the final screen — “Outfit of the Day” backwards
3. In this screen, will have the exact location of each outfit that was chosen
4. As the user scans their clothing into closet, the app will know where the clothes are
5. The scanned clothing, will be like one picture per piece of clothing

The changes that we made to our prototype…

The changes that we made to our prototype today were adding a textual and audio tutorial option in before the welcome screen, detailing what will be said on each screen and when each button is touched, and laying out the four main features of our app. The tutorial lays out how to use each feature of our app, and details a back button that will always be available in the right uppermost corner. The audio that will be included on each screen is described on our poster with bullet points. During these two larger feats, we were able to discern what the four main features of our app are, namely Map/Directions, Street Landmarks, Find Public Transit, and Backtrack.
Prototype
Tutorial Prototype

Today we met at MOUSE after the …

Today, we met at MOUSE after the “Dans le Noir” trip and worked on our projects. Our prototype consisted of a physical project that consists of a plastic chair. This simple design is the base of how we plan our finished product to look. Originally we planned to have our product to be a full wheelchair with the circuits built into it, but then we realize it would be too expensive for the average consumer. We then decided to change it to an attachement to the wheelchair, so we could cut out the production cost. Our new design are cameras, sonar sensors, and GPS connected to a battery working with each other.

Prototype
blueprint

Prototype Updates (Fashionator)

prototyping

-Major sections:
1. Sign in
2. Closet/Choosing outfit
-Mission statement + tutorial FOR first-time users, one time ONLY (in the tutorial mention where all the main buttons would be located and how to use the application. make sure that when you scan you make sure that you turn your flash on or if you dont have flash then make your room as bright as possible.)
-Back button on top left corner (ALWAYS)
-Next button on bottom right corner (ALWAYS)
-Audio Statements for each screen, purpose: tell the user what are the going to click on
-loading page of app – “Welcome to The Fashionator”
-Scan – “For better qualities of the pictures taken, please make your room brighter or turn on the flash of your camera on”
-Closet – bottom middle of screen – “click the button on the bottom middle of the screen to start choosing your outfit.”
-Occasion – “Choose the occasion you need attend today. If you choose casual, click next to go on to the Themes page.”

Prototyping (Dining Challenge)

We decided that instead of a napkin to scan the food and identify the food we decided to think about other things
We decided on a watch last week but this week we identified some problems with the watch.
-The watch would be super costly and is almost impossible to make
-The watch doesn’t connect to the internet
We decided that since everyones has a phone then we could make an app instead which would be software
The part of the challenge that cuts the food into bite size pieces for the user could be the hardware part.
Consider: Cost and Accessibility
App functions:
-Identify the food
-Communicate with the user
-Deflects the hand from touching the food because you already know where the food is
Not Sure: App or attachment to the phone
Attachment scans the food
App Identifies the location of the food
Process: Camera watch —-> Phone —–> Internet ——>Phone
CONCLUSION: Its a watch that detects distance (sensor) from the plate and takes a picture of the food, the picture is sent to the phone which sends it to the the app which identifies the food and sends it back to the user immediately by vibrating
Sensor > Phone > Watch >Vibrate


Today we interviewed visually impaired adult & students…

Today we interviewed visually impaired adult & students to critique our designs

one of the ideas that we came up with was creating a small tutorial about our app in order to make sure users are not confused about how different our app works.

Another idea that came up while interviewing someone was making sure that our app would work while the device was out of service area.

Summary of Notes:
While we were at Selis Menor, we interviewed 3 people. One of them was the senior computer instructor and when asked about our idea, she replied that she had tried similar apps but was disappointed each time because the way they communicated was not weird; for example, the app might tell her to go left 5 miles, and turn right 3 miles. She recommended that we use a headset or blue tooth so that she doesn’t disturb other people. Next, we interviewed 3 people: Corena, Justin, and Tiani. Corena and Tiani were part of an after-school program offered by Selis Menor while Justin was their supervisor. They told us that they liked our idea, but that we might want to think about the names of specific places, such as a deli. Finally, we talked to Dawn, the diretor of workforce development for youth. She recommended that the concept of constantly updating progress may annoy the users, so it should be a feature that enables the feature to turn it on or off.

Prototype Interviews at Selis Manor

Suggestions: Talking cable boxes*
Thoughts: Think about people that aren’t only visually impaired but have arthritis or any other disabilities. Think about the fact that not everyone might be able to use the knife and we might have to teach some people.
Ideas:

  • An attachment that tells the expiration date on your food
  • The napkin scanner for the plate should probably be under the plate and not over the plate
  • The knife should not be sharp and should be a foldable template.
  • A watch that you wear with a scanner. You put the fork in the food and the watch scans it. It has the same functions has the nakin idea but in the form of watch. The watch works with the fork!!!!!!

Changes:
We could have a watch instead of the napkin because the napkin has lots of faults.

Updates for Fashionator

The app will have:
1-Tell specific location of clothes(in closet)
2-Touch-screen OR manual(buttons) OR voice activated
3-In different languages
4-Storage in Phone Memory? Compress the pictures to reduce space usage
5-Exact description of chosen clothing
6-it is up to the users to find their clothes, we will only suggest the best option.
6.color identifier