Very cool stuff, I've long thought there must be some fancy ways to get extra information for better image resolution by taking advantage of the other cameras.
That said, I must also say that most of the side-by-side comparison photos shown here are somewhat impressive, and in some cases, the photosynthesis one just looks worse to my untrained eye.
_______________
I'll choose to take this as evidence of the fact that you're tacking a very difficult problem, and you're also being honest in your comparisons and not cherry-picking too aggressively.
As dole alluded to below, I have been going back and forth in balancing the quality of the example pictures with the data load. I've pushed an update to the site now that weighs much more towards quality for this exact reason! But you're right, I don't want to hide the fact that not all results are perfect.
very cool app, a few questions: why does the color "temp" of the image change between traditional iphone photography vs your app? it appears to both warm and cool the images. Also why is the contrast decreased, specifically in the library/book store example?
I guess I will break the general hypocrisy and be the one to say this can be replicated with AI. Fable almost one-shotted it.
The devil is in the details. I ended up tinkering quite a bit because Samsung's software decides for you wether to use the real 3x camera or do a digital zoom (which defeats the purpose). Long story short I got a prototype working, but only when shooting outdoor with good day light. No I will not share it or publish it. The result was terrible for a close up portrait. It works beautifully for outdoor shots of plants/trees.
Here is the catch : when you share your detailed shot by WhatsApp (for example), it gets compressed and you lose those precious details.
This was actually a purported feature of the Pixel 3 camera. Google said it would be constantly taking photos and the different information captured as your hand moved slightly could be used to create higher information density photos. It didn't work very well at that point but the idea was cool!
I like the idea of this app and the website is well done. Subscription isn't for me, but for folks who take a lot of photos and need this sort of thing, I can see it. Free tier could offer a few more photos per month.
It’s weird, because the center of the image will be more detailed, so how are they dealing with the “grid of pixels” that is on the display. Are they doubling up the wide angle.
“Easy-to-understand framing
The brackets over the viewfinder indicate the area covered by the more detailed lens. Frame your subject inside them to capture the best detail.“
Reminds me of the old 3d cameras that took two photos at once through 2 lenses (on film)
Recently, Samsung introduced the ISOCELL platform which allows to select the area which will be recorded at higher resolution compared to other regions.
There can be all sorts of different applications build around such as extracting higher resolution of text regions, etc [2].
Of course, the lens needs to support this resolution but I think that will be default in the mid-term future.
I am co fused, 50% of photos look better in standard zoom and 50% of them look better woth photosynthesis. This is like an anti campaign for the app hinting "in the end it doesn't really matter"
To be honest, I wouldn't be surprised if Apple isn't already doing this and just doesn't say so explicitly. There is a crazy amount of image processing going on behind the scenes in each smartphone photo. Would be interesting to compare a photo taken with the native camera app and photosynthesis to compare. I'm assuming your demo images on your site are the raw and processed images from your app that don't go through Apple's "secret sauce" processing pipeline.
I think this is actually how oneplus phones have taken 'night' mode photos for a very long time in their default camera app, it takes multiple exposures and uses the movement sensor in the phone to pick several which were taken with the least hand jitter, and then stacks them into the final result.
My hesitations on this are it stores data in a proprietary format that I may not be able to export to another common format if the product disappears in a few years.
For something personal like photos and the memories they capture, that's not ideal for me.
While the app is still with us, I'm not sure how much it will cost me to export to my photos to my photo library each month.
68 comments
[ 0.26 ms ] story [ 10.9 ms ] threadThat said, I must also say that most of the side-by-side comparison photos shown here are somewhat impressive, and in some cases, the photosynthesis one just looks worse to my untrained eye.
_______________
I'll choose to take this as evidence of the fact that you're tacking a very difficult problem, and you're also being honest in your comparisons and not cherry-picking too aggressively.
The devil is in the details. I ended up tinkering quite a bit because Samsung's software decides for you wether to use the real 3x camera or do a digital zoom (which defeats the purpose). Long story short I got a prototype working, but only when shooting outdoor with good day light. No I will not share it or publish it. The result was terrible for a close up portrait. It works beautifully for outdoor shots of plants/trees.
Here is the catch : when you share your detailed shot by WhatsApp (for example), it gets compressed and you lose those precious details.
A very cool project nonetheless.
I immediately signed up. (And offered to help bring users to this thing.)
“Easy-to-understand framing The brackets over the viewfinder indicate the area covered by the more detailed lens. Frame your subject inside them to capture the best detail.“
Reminds me of the old 3d cameras that took two photos at once through 2 lenses (on film)
https://www.ebay.com/itm/206409326865?chn=ps&_trkparms=ispr%...
Recently, Samsung introduced the ISOCELL platform which allows to select the area which will be recorded at higher resolution compared to other regions.
There can be all sorts of different applications build around such as extracting higher resolution of text regions, etc [2].
Of course, the lens needs to support this resolution but I think that will be default in the mid-term future.
[1]: https://en.wikipedia.org/wiki/Foveated_imaging
[2]: https://dl.acm.org/doi/10.1145/3799902.3811218
For something personal like photos and the memories they capture, that's not ideal for me.
While the app is still with us, I'm not sure how much it will cost me to export to my photos to my photo library each month.
What do the multiple lenses do then, if not this? Like,I presumed that was the point.
Are they LITERALLY just decoration for me to make fun of?