Iron Man HUD project (idea gathering) now w/video example
xl97
Master Member
Question for everyone:
How are people going to be mounting the camera to/in their helmets?
I see the hacksmith has his camera next to his display, which in turn uses the eye socket in the faceplate.
But thinking on this.. how will the 'eye' circuit (LEDS) integrate with this then?
In my mind.. having an led lens/screen in front (normal Iron Man led eye stuff).. will hinder/block the camera?
Thoughts?
I believe the display stuff is all solved now.... but I want to think a bit more about the camera mounting stuff..
All feedback is appreciated.
Thanks!!
How are people going to be mounting the camera to/in their helmets?
I see the hacksmith has his camera next to his display, which in turn uses the eye socket in the faceplate.
But thinking on this.. how will the 'eye' circuit (LEDS) integrate with this then?
In my mind.. having an led lens/screen in front (normal Iron Man led eye stuff).. will hinder/block the camera?
Thoughts?
I believe the display stuff is all solved now.... but I want to think a bit more about the camera mounting stuff..
All feedback is appreciated.
Thanks!!
IronDan27
Active Member
On my helmet I was thinking about mounting the camera in the chin in the area circled. There always seems to be dead space there so I figured that would be a good place to put it plus then it is centered in the helmet and not off to the side and both eyes can then just light up. I have looked at Sandbagger's thread and he put the camera between the eyes.
Attachments
xl97
Master Member
(thats for the reply!)..
Cool!
I dont have a decent helmet myself.. (crappy ones.. that I used for 'rough' size/space testing)
I have 2-3 or buckets.. and none of them are worth the effort to finish (or even start) LOL..
If that is the general consensus here.. then I wont worry about the 'camera' part.. and leave that up to each user to mount where and how they see fit.
I'll continue along the display portion.. and get some of the same 'displays' that The Hacksmith used..
It DEFINITELY adds to the cost of the project/kit... but I dont think anyone thought this was going to be a dirt cheap kit anyways..
I'll order the display thing this weekend.. and follow the same breakdown.
What I'm NOT sure about for the hacksmith version... is his even capable of doing overlays? or getting real time data display on the screen? I know he mentions Python... but not clear what its being used for?
I also see he either used (or provided) an OS (for the RPi).. called FRIDAY? but I'm not clear what it is used for? or what benefit it has? pre-configured OS.. but for what? (enabling a PiCam?) I'm ut what else his 'OS' does outside of default RPi OS install.. and maybe enabled camera by default?
Cool!
I dont have a decent helmet myself.. (crappy ones.. that I used for 'rough' size/space testing)
I have 2-3 or buckets.. and none of them are worth the effort to finish (or even start) LOL..
If that is the general consensus here.. then I wont worry about the 'camera' part.. and leave that up to each user to mount where and how they see fit.
I'll continue along the display portion.. and get some of the same 'displays' that The Hacksmith used..
It DEFINITELY adds to the cost of the project/kit... but I dont think anyone thought this was going to be a dirt cheap kit anyways..
I'll order the display thing this weekend.. and follow the same breakdown.
What I'm NOT sure about for the hacksmith version... is his even capable of doing overlays? or getting real time data display on the screen? I know he mentions Python... but not clear what its being used for?
I also see he either used (or provided) an OS (for the RPi).. called FRIDAY? but I'm not clear what it is used for? or what benefit it has? pre-configured OS.. but for what? (enabling a PiCam?) I'm ut what else his 'OS' does outside of default RPi OS install.. and maybe enabled camera by default?
DrCyanide
Active Member
I've seen some costumes put it in the chin, and I've seen Sandbagger's one between the eyes. The chin is easier to hide, but your head movements will feel a little odd. Between the eyes is very noticeable, but probably more natural to line up with.
If you're willing to connect two cameras you might be able to hide them in the cheek cutouts or on the ear covers. That would give you 3D vision, but it might take a little while to adjust to it.
There is no "FRIDAY" or "JARVIS" dedicated OS, that was primarily to replicate the scene from Age of Ultron. The Pi uses Micro SD cards too, so they were just labeling the Micro SD -> SD converters... which is kinda pointless. If they do end up using two separate Micro SD cards, then it'll be to quickly swap between default settings without having to break out the Bluetooth keyboard. (Edit: at 13:10 or so he mentions that it's the "SD card called Friday", not an OS)
While this version didn't have any overlays, if you can draw it on the Raspberry Pi's video out then it would show up on the screen. And the Raspberry Pi is just a small Linux computer, so yes, you'd be able to use it for HUD features.
If you're willing to connect two cameras you might be able to hide them in the cheek cutouts or on the ear covers. That would give you 3D vision, but it might take a little while to adjust to it.
There is no "FRIDAY" or "JARVIS" dedicated OS, that was primarily to replicate the scene from Age of Ultron. The Pi uses Micro SD cards too, so they were just labeling the Micro SD -> SD converters... which is kinda pointless. If they do end up using two separate Micro SD cards, then it'll be to quickly swap between default settings without having to break out the Bluetooth keyboard. (Edit: at 13:10 or so he mentions that it's the "SD card called Friday", not an OS)
While this version didn't have any overlays, if you can draw it on the Raspberry Pi's video out then it would show up on the screen. And the Raspberry Pi is just a small Linux computer, so yes, you'd be able to use it for HUD features.
xl97
Master Member
oh.. I know there is no 'legit' Jarvis/Friday OS.... I'm referring to what they called THEIR OS/SD card... they have a link to the image for the SD card.. so that is where my questions come from... WHY? Whats on this RPi 'image' that is special? (admittedly.. I dont fully get his approach, but he said he has never used an RPi before.. so I'm not clear on where Python comes into play for him here? Seems like a default RPi image.. with camera enabled by default?
This image they link to: (Friday 'image' for 16GB SD card)
Dropbox - Friday OS - Simplify your life
I guess I could download it and throw it one of my extra Pi's and see what it actually 'does'..
I'm not an expert as RPi stuff (only a handful of project using them)... more of an Arduino based guy TBH.. (more experience there for sure)..
So I'm not sure how one would 'draw' on the RPi's video output?? (maybe its easy? doesnt seem very intuitive to me however)...
I am curios to know if:
1.) a Pi Zero would work for my application/approach
2.) if I can use the same SD card? (as I have a ton of work/mods to get things working as they are)
IronDan27
its all good! without interest like yours... and feedback.. the project would be dead! so.. you -are- a crucial part of the process!.
Straight hardware costs.. are NOT that much.. but all the time/code..etc..etc need to be added in as well.
Maybe we'll work something out for the 'core helpers' here is they want a DEMO kit and core costs to help solidify things ion the end if there is interest (before a legit kit goes for sale)
Initial kits will only have 1 eye... (to keep costs down still).. afterwards an HDMI splitter cable can probably used to have another 'eye' added to the bucket
******! I need a project manager!! LOL
This image they link to: (Friday 'image' for 16GB SD card)
Dropbox - Friday OS - Simplify your life
I guess I could download it and throw it one of my extra Pi's and see what it actually 'does'..
I'm not an expert as RPi stuff (only a handful of project using them)... more of an Arduino based guy TBH.. (more experience there for sure)..
So I'm not sure how one would 'draw' on the RPi's video output?? (maybe its easy? doesnt seem very intuitive to me however)...
I am curios to know if:
1.) a Pi Zero would work for my application/approach
2.) if I can use the same SD card? (as I have a ton of work/mods to get things working as they are)
IronDan27
its all good! without interest like yours... and feedback.. the project would be dead! so.. you -are- a crucial part of the process!.
Straight hardware costs.. are NOT that much.. but all the time/code..etc..etc need to be added in as well.
Maybe we'll work something out for the 'core helpers' here is they want a DEMO kit and core costs to help solidify things ion the end if there is interest (before a legit kit goes for sale)
Initial kits will only have 1 eye... (to keep costs down still).. afterwards an HDMI splitter cable can probably used to have another 'eye' added to the bucket
******! I need a project manager!! LOL
DrCyanide
Active Member
If you need to use the hardware pins on the Raspberry Pi then most people use Python (apparently the only way to access the GPIO pins is with a language called Scratch, which is targeted towards kids/people who don't want to code). It could be they're future proofing by using that, or it could be that they're using a Python program to handle their key presses to toggle back and forth between full-screen camera and normal desktop.
You'd "draw" by making a full screen application that has a background "image" that's the video feed and a foreground "image" that's whatever data you're projecting. You could probably even run your Adobe Flash version, so long as you can make it full screen.
You'd "draw" by making a full screen application that has a background "image" that's the video feed and a foreground "image" that's whatever data you're projecting. You could probably even run your Adobe Flash version, so long as you can make it full screen.
xl97
Master Member
Ahh... DUH!
I wasnt even thinking about the GPIO's!! LOL (I guess hes just setting up for possibly future stuff.. since he has no real time anything or overlays to display things).
I know "I" can do overlays... (and as you state, I am using Adobe Flash do handle suck things).. but he is not.. which is why I was asking about his approach or your comment of 'drawing' over the RPi video output.
In my project it is NOT the RPi controlling the camera... hence the ability to do whatever I want to the 'video feed' (ie: overlays, real-time data)
It seems to work with his ZERO.. (I wasnt clear since it said only 720p.. but I -thought- RPi output 1080p?)
I'm also not clear on the resolution of the display itself? (as I have read different comments on it)..
I wasnt even thinking about the GPIO's!! LOL (I guess hes just setting up for possibly future stuff.. since he has no real time anything or overlays to display things).
I know "I" can do overlays... (and as you state, I am using Adobe Flash do handle suck things).. but he is not.. which is why I was asking about his approach or your comment of 'drawing' over the RPi video output.
In my project it is NOT the RPi controlling the camera... hence the ability to do whatever I want to the 'video feed' (ie: overlays, real-time data)
It seems to work with his ZERO.. (I wasnt clear since it said only 720p.. but I -thought- RPi output 1080p?)
I'm also not clear on the resolution of the display itself? (as I have read different comments on it)..
xl97
Master Member
First display piece should be here next week!
Im curious and excited to see how it all pans out. What I may have to tweak for the GUI/UX....etc..
This is the final (big) piece of my puzzle here... but if it worked for 'The Hacksmith'.. I'm guessing it wont be an issue here?
I do have concerns about the kit only being 1 eye? an issue for people? (or a better option to only have 1 eye?)
I need to go back and re-visit my to-do list...
I know I had some camera stuff/params I wanted to check out..
Im curious and excited to see how it all pans out. What I may have to tweak for the GUI/UX....etc..
This is the final (big) piece of my puzzle here... but if it worked for 'The Hacksmith'.. I'm guessing it wont be an issue here?
I do have concerns about the kit only being 1 eye? an issue for people? (or a better option to only have 1 eye?)
I need to go back and re-visit my to-do list...
I know I had some camera stuff/params I wanted to check out..
xl97
Master Member
Me too! LOL
I'm a little concerned how much the price for not only 1 'eye'.. but '2' would be on the final costs!..
While I spent some time searching.. (and haggling) for a decent price on '1' VuFine eye piece....
I dont know if those can be had for the same prices in the future..
it could be easily be double (for 1 eye) .. or triple (for both eyes).. if/when it comes to source these for the final kits/products..
To-Do's:
* VuFine teardown/implementation
* Re-visit camera quality/color/brightness settings
* work up example/demo circuits to mimic external modules (repulsors/arc reactor) to show real-time data/updates on HUD screen
* Re-do or team up with another member to re-work the current visuals/theme (they are decent enough... but could probably be better/more techy looking)
All in all.. not too much work left to be done (most time/work I believe will be spent 'fine tuning' instead of the bulk of getting the project up and running as a PoC)
I'm a little concerned how much the price for not only 1 'eye'.. but '2' would be on the final costs!..
While I spent some time searching.. (and haggling) for a decent price on '1' VuFine eye piece....
I dont know if those can be had for the same prices in the future..
it could be easily be double (for 1 eye) .. or triple (for both eyes).. if/when it comes to source these for the final kits/products..
To-Do's:
* VuFine teardown/implementation
* Re-visit camera quality/color/brightness settings
* work up example/demo circuits to mimic external modules (repulsors/arc reactor) to show real-time data/updates on HUD screen
* Re-do or team up with another member to re-work the current visuals/theme (they are decent enough... but could probably be better/more techy looking)
All in all.. not too much work left to be done (most time/work I believe will be spent 'fine tuning' instead of the bulk of getting the project up and running as a PoC)
xl97
Master Member
Display came in today!
I did a quick test..
Its pretty dang cool! Things really are crisp (for the most part)... and its pretty high resolution as well!..
my original design/theme.. was for 480x320 I think? so it was pretty small.. but (little too dark camera feed still [never played with that yet]) everything else was bright and sharp and readable...
I think the one eye might be enough? (not sure how two would feel...but I'd like to try eventually!) LOL
if the RPi could connect to wifi (would be too hard to send out kits to pre-configure)...
this could get/read/post to all sorts of social media (IG, twitter..etc)..
(not dependent on wifi.. but with a little more hardware, it could even get/send texts as well.... not sure about voice)..
the only problem is space, on where to hide/tuck everything at this point! haha..
these displays litlerally saved the project.. and saved me form originally trying to source pieces separately..
some sort of mounting plate/bracket that allows for positioning (perhaps my set screws or something for up/down/left right & tilt?)
but I'm pretty sure they will fit into anyone's faceplate.. the whole display with housing/enclosure is only .80 in deep (thats less than your nose sticks out!)
I did a quick test..
Its pretty dang cool! Things really are crisp (for the most part)... and its pretty high resolution as well!..
my original design/theme.. was for 480x320 I think? so it was pretty small.. but (little too dark camera feed still [never played with that yet]) everything else was bright and sharp and readable...
I think the one eye might be enough? (not sure how two would feel...but I'd like to try eventually!) LOL
if the RPi could connect to wifi (would be too hard to send out kits to pre-configure)...
this could get/read/post to all sorts of social media (IG, twitter..etc)..
(not dependent on wifi.. but with a little more hardware, it could even get/send texts as well.... not sure about voice)..
the only problem is space, on where to hide/tuck everything at this point! haha..
these displays litlerally saved the project.. and saved me form originally trying to source pieces separately..
some sort of mounting plate/bracket that allows for positioning (perhaps my set screws or something for up/down/left right & tilt?)
but I'm pretty sure they will fit into anyone's faceplate.. the whole display with housing/enclosure is only .80 in deep (thats less than your nose sticks out!)
xl97
Master Member
I wish!
I have been busy with the holidays and family members being in town most of the month..
I also have 3 other electronics projects going on for other members here..... that I need to wrap up.
(Arc Reactor, Pulse Rifle and minor custom project)
Once that is done.. I will be back on it.
Thanks for showing interest though... its probably the one MAIN thing that keeps me going.
I have been busy with the holidays and family members being in town most of the month..
I also have 3 other electronics projects going on for other members here..... that I need to wrap up.
(Arc Reactor, Pulse Rifle and minor custom project)
Once that is done.. I will be back on it.
Thanks for showing interest though... its probably the one MAIN thing that keeps me going.
cdenim
New Member
So... been following this thread as i am a big fan of xl97's work and really want to see this become a reality for us ironman cosplayers sick and tired of stepping on people at cons and conventions bc we can't see very good through the face shields led eyes. Now, be it as i co-own a motorcycle dealership I just realized something. Several companies have come out with AR helmets that for the most part, already do most of what we want our mark whatever helmets to do. One in particular, LiveMap: Motorcycle smart helmet with Augmented Reality navigation, offers an in-helmet AR screen just a few milometers away from the wearers eye. it projects things like a map for route guidance, speed, paired to your phone with incoming call info, can access alexa, siri, ect.... and overlays the image like any AR right in the center of the wearers forward looking point of view. As well as a back up camera so we know it will display a camera feed. . Anyway, I was reading through this post again and thought this might be helpful..
Similar threads
