They can, but you have to do it yourself instead of leaving it to the phone. For a specific foto it’s ok, but I doubt any one wants to sit after each day to process the photos one took during the day
Regardless of how people are feeling about Apples products, any news is better than no news so I'm sure their not to hurt by the media having mixed reviews. They operate their own way regardless of media. I'm sure if the demand for the products slowed down they may stop producing yearly incremental changes but enough people are out there upgrading from older models (I have an 11 pro and this years 16 looks very tempting to me for example). Perspective.
Smartphone cameras for the past ~8 years have been using multiple frames to improve noise performance, resolution and dynamic range. Sometimes as many as 128 frames are stacked, over many seconds, especially in low light. Gyro and optical flow data is also used to help align frames, and noise models to decide how to blend them (and avoid ghosting when things are changing in the frame).
How exactly does one fit 128 frames of lossless data from a 12 megapixel sensor into an 18 megabyte file?
Or is ProRAW not as RAW or as lossless as the name would imply?
Maybe it’s just one frame per file? Also, you could probably achieve some pretty good compression with multiple frames because the frames are probably very correlated, right?
So if it's one Raw sensor frame, it will be noisy, and you won't get any of the computational photography benefits. It will end up looking like a photo from a 10 year old phone.
You will get a little compression storing multiple frames, but not much, because the photon shot noise is independent for each frame - and in lossless images, the noise (which does not compress according to information theory) often has more entropy than the ideal image (which compresses well).
Or you could store one post-processed frame, after you have combined 128 frames and done the computational photography stuff. But at that point, it isn't exactly raw data anymore.
"So if it's one Raw sensor frame, it will be noisy,"
That is not why noise is created in digital photographs. And Noise or Grain in a photograph is not always a negative.
"Noise in photography is the arbitrary alteration of brightness and color in an image. The onset of this random variation generates what is called “noise”or “grain”, which is basically formed by irregular pixels misrepresenting the luminance and tonality of the photograph. These pixels are visible to the eye due to their large size."
A signal RAW image does not have to have noise. Noise can be created by incorrect exposure and low light.
>Or you could store one post-processed frame, after you have combined 128 frames and done the computational photography stuff. But at that point, it isn't exactly raw data anymore.
Yes, and Apple should not be calling any images it captures from an iPhone "RAW".
> A signal RAW image does not have to have noise. Noise can be created by incorrect exposure and low light.
You always have noise. It's more noticeable in low light, but it never goes away. It's due to physics - there's real world noise in photons hitting the sensors and read noise in the A/D converters behind them. That's long before the image is captured into any format - RAW doesn't help you here.
There is always noise. In fact, in absolute terms, there is more of it as the amount of light increases. It just increases more slowly than the signal, so the signal-to-noise ratio increases.
> Are there any cameras out there that output real raw data from the senors?
I suspect not, because the data output rate from a high end sensor can easily be 32 Gbps, and I don't think any phones have fast enough flash storage to write data at 32Gbps.
You have to process the data in mostly-realtime or lose the data. Storing it isn't an option.
Full sized cameras do use a buffer to deal with burst activity, take series if shots - process - save to slower storage. Also, modern cameras start switching to CFexpress/SDExpress (which are NVMe)
> Version 8.0 was announced on 19 May 2020, with support for two PCIe lanes with an additional row of contacts and PCIe 4.0 transfer rates, for a maximum bandwidth of 3,938 MB/s
Full-sized mirror/mirrorless cameras do that. Sensor is HUGE, optics is very fine and huge as well. Due to how universe works, you can't get similar results with tiny sensor and optics
> noise (which does not compress according to information theory)
That's true in theory/isolation, but in practice we know the noise has much lower maximum amplitude than the original image. I.e. if you take a difference between two frames, almost all of it will require less bits per pixel than the signal. (And that allows compression in practice)
ProRAW is definitely not RAW, the amount of white balance correction you can do is far more limited. It think it's closer to capturing the different HDR layers to allow the dynamic range to be tweaked more in post.
Ex-Semi-Professional Photographer here...Yes, I think Apple is very misleading, if not being fraudulent, saying you can shoot in "RAW" format.
"RAW files contain uncompressed and unprocessed image data, allowing photographers to capture practically every detail they see in their viewfinder. The RAW file format stores the largest amount of detail out of any raster file type, which photographers can then edit, compress, and convert into other formats. Learn more about the benefits, drawbacks, and best ways to work with a RAW image."
If Apple is giving you JPEG-XL they are compressing the file, so it is not RAW.JPEG-XL is lossless compression.
> If Apple is giving you JPEG-XL they are compressing the file, so it is not RAW.JPEG-XL is lossless compression.
Are you unaware that most DNG files are compressed using Lossless JPEG? Including ones that are storing raw sensor data rather than debayered data like ProRaw?
You can shoot real RAW with the iPhone hardware, just not with the system camera app. If you use something like Halide or Photon Camera, they have proper RAW options that give you a traditional noisy RAW.
“Noisy RAW”? What? It gives you a RAW file. Period. But this proves my point that Apple does not capture a RAW file, it is pretty highly processed. I want to do my editing, and I want to compress it my self if i want.
Apple does offer the ability to capture a lossless RAW file with raw sensor data, just not with their app. It’s exposed through their API for 3rd party apps to use. It’s harder to get a good result in low light or high contrast scenarios from a single exposure of such a small sensor, but many people prefer it to the processed ProRAW files.
The ProRAW format that the default app offers has a different use case: it combines the automatic advanced processing of multiple exposures into a file format that offers more flexibility for post processing than a standard photo does. With the new lossy compression option it gets more attractive for some users that are willing to trade in some quality for space. I don’t see the problem in offering that option next to the lossless compression.
Lossless compression is something I’m not going to argue about, as there is literally nothing lost by doing that and many professional cameras do the same thing, though with different algorithms. Well, unless your argument is that it’s not yet compatible with many photo editors, because that’s a fair point.
As an ex-professional photographer , you should be very aware that RAW does not mean uncompressed or lossless.
Many professional cameras offer lossy and lossless compressed RAW, and have for over a decade now and most are processed to some degree before it’s even written.
RAW hasn’t meant literally raw in a very long time.
Even the regular lossless RAW setting can sometimes be "not quite RAW" when the camera dynamically lowers the bitrate it captures at. My camera does anywhere between 12 bits and 14 bits RAW depending on the shooting settings. Many newer cameras have baked-in NR that cannot be disabled (e.g. Canon R5), even on the lossless RAW setting
ProRAW is just DNG with some additional metadata, and DNG can store actual raw sensor data, but Apple stores the semi-processed image after debayering and multi-exposure stacking yeah. The benefit is that it's 12-bit linear data so you get a decent amount to work with, and their automatic tonemapping is stored as metadata so it can be non-destructively tweaked or disabled in post.
Based on article [1], ProRAW is a half way between plain RAW output from sensor and baked in jpeg. It uses computed multiple-frame result, but stores more data, allowing you to recover details from shadows and do other things you typically use RAW for. Debayering is performed (nobody cares about that anyway), multiple frames are combined but higher bit-depth is preserved (12-bit instead of 8-bit), it also contains separate "tone map" which describes HDR gains (for each pixel?). Disclaimer, zero experience with ProRAW, just glanced at that article, but used RAW on DSLR in the past.
37 comments
[ 2.7 ms ] story [ 47.5 ms ] threadHow exactly does one fit 128 frames of lossless data from a 12 megapixel sensor into an 18 megabyte file?
Or is ProRAW not as RAW or as lossless as the name would imply?
You will get a little compression storing multiple frames, but not much, because the photon shot noise is independent for each frame - and in lossless images, the noise (which does not compress according to information theory) often has more entropy than the ideal image (which compresses well).
Or you could store one post-processed frame, after you have combined 128 frames and done the computational photography stuff. But at that point, it isn't exactly raw data anymore.
That is not why noise is created in digital photographs. And Noise or Grain in a photograph is not always a negative.
"Noise in photography is the arbitrary alteration of brightness and color in an image. The onset of this random variation generates what is called “noise”or “grain”, which is basically formed by irregular pixels misrepresenting the luminance and tonality of the photograph. These pixels are visible to the eye due to their large size."
A signal RAW image does not have to have noise. Noise can be created by incorrect exposure and low light.
>Or you could store one post-processed frame, after you have combined 128 frames and done the computational photography stuff. But at that point, it isn't exactly raw data anymore.
Yes, and Apple should not be calling any images it captures from an iPhone "RAW".
You always have noise. It's more noticeable in low light, but it never goes away. It's due to physics - there's real world noise in photons hitting the sensors and read noise in the A/D converters behind them. That's long before the image is captured into any format - RAW doesn't help you here.
There's quite a bit of analog and digital post processing and I doubt you can bypass all of it
I suspect not, because the data output rate from a high end sensor can easily be 32 Gbps, and I don't think any phones have fast enough flash storage to write data at 32Gbps.
You have to process the data in mostly-realtime or lose the data. Storing it isn't an option.
Full sized cameras do use a buffer to deal with burst activity, take series if shots - process - save to slower storage. Also, modern cameras start switching to CFexpress/SDExpress (which are NVMe)
> Version 8.0 was announced on 19 May 2020, with support for two PCIe lanes with an additional row of contacts and PCIe 4.0 transfer rates, for a maximum bandwidth of 3,938 MB/s
That's true in theory/isolation, but in practice we know the noise has much lower maximum amplitude than the original image. I.e. if you take a difference between two frames, almost all of it will require less bits per pixel than the signal. (And that allows compression in practice)
"RAW files contain uncompressed and unprocessed image data, allowing photographers to capture practically every detail they see in their viewfinder. The RAW file format stores the largest amount of detail out of any raster file type, which photographers can then edit, compress, and convert into other formats. Learn more about the benefits, drawbacks, and best ways to work with a RAW image."
If Apple is giving you JPEG-XL they are compressing the file, so it is not RAW.JPEG-XL is lossless compression.
Are you unaware that most DNG files are compressed using Lossless JPEG? Including ones that are storing raw sensor data rather than debayered data like ProRaw?
And I am talking about apple in this thread.
The ProRAW format that the default app offers has a different use case: it combines the automatic advanced processing of multiple exposures into a file format that offers more flexibility for post processing than a standard photo does. With the new lossy compression option it gets more attractive for some users that are willing to trade in some quality for space. I don’t see the problem in offering that option next to the lossless compression.
Lossless compression is something I’m not going to argue about, as there is literally nothing lost by doing that and many professional cameras do the same thing, though with different algorithms. Well, unless your argument is that it’s not yet compatible with many photo editors, because that’s a fair point.
Many professional cameras offer lossy and lossless compressed RAW, and have for over a decade now and most are processed to some degree before it’s even written.
RAW hasn’t meant literally raw in a very long time.
[1] https://medium.com/halide/understanding-proraw-4eed556d4c54