Motion Tracking with Arduino+Pixy: Adventure Time Hero's Gauntlet

[Billy the Hero]

This is part of my Adventure Time Hero Gauntlet unwearable prop build, but since it’s such a more complicated process than simply casting and molding a gauntlet, I will keep track of its development separately.

So currently the project involves a single animatronic eye in the middle of a gauntlet. The eye has movement on 2 axis controlled by two futaba s3003 servos, and two eyelids controlled by just one servo. I've gotten it hooked up to connecting rods that run down the shaft of the hollow gauntlet and into the 11x11 inch display base, where all of my electronics reside. Like the breadboard, my Arduino Uno, and a Pixy cmucam5.

But now comes the trickiest part. I know how to work with Arduino, I know C++, but it's certainly my first time working with visual tracking, much less Pixy. Heck, I don't even know what my code will look like yet. Will post updates and my development code.

 

[propmaster2000]

Wow,
This seems like a pretty ambitious project.
How do you plan to use the Pixy visual tracking? Will it move the entire gauntlet?
Just wondering.

.

 

[nomuse]

Whoah. I think I'd back away from Arduino myself on visual tracking. There are such incredible libraries for shape/facial/tracking available on the Pi now (or so I read -- I haven't delved far enough into Pi to play with that sort of stuff.)

 

[Billy the Hero]

Wow,
This seems like a pretty ambitious project.
How do you plan to use the Pixy visual tracking? Will it move the entire gauntlet?
Just wondering.

.

For the Mark 1, its eye and eyelid will move. Pixy allows me to track specific colors.

Whoah. I think I'd back away from Arduino myself on visual tracking. There are such incredible libraries for shape/facial/tracking available on the Pi now (or so I read -- I haven't delved far enough into Pi to play with that sort of stuff.)

Well, exactly, I don't know much about that either. I researched everything and Pixy seemed to be the most open ended.

 

[propmaster2000]

Have you some idea as to how your 2 axis eye mech. and eyelid mech. will function?
Are you going the 3D printing route or custom fabricated (old school) route to the build?

.

 

[Billy the Hero]

Have you some idea as to how your 2 axis eye mech. and eyelid mech. will function?
Are you going the 3D printing route or custom fabricated (old school) route to the build?

.

It's custom fabricated. The mechanism for the eye is entirely vertical: I have a servo attached vertically to a connecting rod (which moves to eye side to side), and on top of the same connecting rod, inside the eyeball, is a servo that moves the eye up and down.

The servo for the eyelid is connected to belts that moces the upper and lower eyelid up/down.

If I can, I'd definitely like to 3D print this stuff eventually.

 

[propmaster2000]

Cool,
Can't wait to see your progress