If the automakers manage to put the camera inside the car body, it probably would be a lot less likely to break. It might even be cheaper to fix - a rear mirror assembly has quite some moving parts and need to be painted to match the car
Small old bump will never "knock a wire loose". This is serious industrial level equipment that must handle rain, snow and other shitty conditions including vibrations of a wide frequency range. And all that at least for the warranty period of a vehicle.
> And all that at least for the warranty period of a vehicle.
You got me till this point, and you prove we should be cautious about such tech. I live in one of the richest cities in the world (certainly one of most expensive), and the amount of 10+ year old cars is huge. Go to country side, and they become majority, with many clocking 15+ years.
For physical mirror to fail, you need to break it or completely lose it, and then its obvious whats the situation. Electronics have more components that can fail, and as an IT guy, I know what can will eventually fail (ie how many digital cameras work flawlessly after 10 years of daily use?). Last thing I need is to have an potentially unreliable critical safety feature in the car.
I used to drive an old 1979 - that car had few electronic conveniences, but left me sitting on the side of the road more than once. It had also developed a problem where it couldn't idle for more than a few minutes because the engine would stall (mixture to rich, maybe?). My current oldest car is a 2003, it has electronic fuel injection, as well as a number of other electric conveniences - remote control mirror, power seat, cd changer, etc. I've only done routine maintenance and replaced a leaking engine seal, and that car has been 100% reliable and has never left me sit.
My much newer 2007 car has a lot more electronics (more airbags, automatic breaking, adaptive cruise control), but so far, still has had no problem, but it's only 3 years old (bought in 2016), so time will tell.
There are numerous studies that show that cars nowadays are dramatically more reliable, both in when and how they fail. There are always going to be maintenance parts but I really can't imagine that cameras are getting loose wires. Besides it's literally two screws and a clip to replace these. They are cheaper to replace than mirrors.
If the electrical wiring was shoddy enough to come unstuck with a minor road bump, I'd be more concerned about the rest of the wires in the ECU messing up, over a camera. This never happens
I spent about $400 to replace a side-view mirror that had stopped working, it was no longer adjustable.
The rear-view camera on our car is 3 years old and hasn't broken yet, but it took 7 years for the side mirror to stop working on the other car, so I guess time will tell, but the camera seems much simpler (and the camera doesn't need to stick out from the car like a traditional mirror so should be less prone to accidental breakage)
I'd say no to that, aside from the reliability and KISS aspects of this, there is one thing cameras won't be able to do properly: parallax. In tight parking spaces or near curbs I will often move around in the car so that I can see obstacles without having to adjust the mirrors.
They could parallax though, so that doesn't seem like the best argument.
They could also use complex optics like "plain lens" with a "fish-eye border", or highlight obstacles by boosting colour contrast or adding in non-visual sensor data.
If cameras are that much better we should be getting vehicles that use both (which we do for rear-view but not side-mirrors AFAIK).
> They could parallax though, so that doesn't seem like the best argument.
I've never seen parallax emulated with head tracking that didn't have piss-poor latency issues. Not to mention poorly configured kalman filters that seem to always do too little or too much smoothing. These systems are fine for cute tech demos but don't belong in safety-critical applications involving multiple tons of steel moving at 100+km/h.
Before replacing mirrors in cars, why not start with making a TV "window" that actually works. Prove the technology in a real world application that isn't safety critical, then we can talk. If it's ready for use on highways, then it should be easy to mount a TV on a wall and provide a convincing experience of actually looking out a window.
This. A “transparent” A-pillar (the bit separating your windshield from driver’s side window) would be a good start, and if it worked well, it’s a feature I’d pay extra for.
Absolutely. Big thick A pillars have increased survivability in crashes (embedded airbags, stronger structure) but that doesn't come for free - they cause some accidents (hiding bikers, also cars when pulling out of junctions).
I'd love to see a transparent A pillar but I can imagine the parallax issues (talked about in other comments here) would make them a bit weird.
That was interesting, thanks. Good to see how much of its safety features are now common (blind spot assist, adaptive cruise control etc.) And, given this thread, amusing that the wikipedia article doesn't pick up on the A pillars.
I've never seen head tracking applications at all, and I'm not surprised that they're underwhelming, but I hope the state of practice gets better because it would be really cool to have an AR setup where metadata is projected onto the windshield and windows such that it lines up with the driver's perspective.
Imagine a thousand foot tall semi-transparent google maps pin, resting lightly on the head of the person you're picking up, visible for hundreds of miles but only to those who are interested.
The sci-fi tech I've wanted for years is a liquid crystal windshield that blacks out a small circle over the sun from the driver's perspective while leaving the rest of the windshield clear. Driving west in the evening or east in the morning, I wager a lot of people have had this idea at some point.
I have no idea if it will ever become feasible, but I sure hope it does.
This. Not just the sun, but more annoyingly, opposing headlights in the night. Technologies to avoid blinding opposing drivers are not adequate. We could do with technology to assist those who are on the affected side.
Transparent material that becomes opaque to bright light (something like gamma < 1, gain < 1) in the direction of the light. So each point of the material is transparent or opaque depending on the viewing angle and respective directed light flow through it.
>If cameras are that much better we should be getting vehicles that use both (which we do for rear-view but not side-mirrors AFAIK).
The 2015 Honda CR-V has a camera under the right mirror. When you turn your right blinker on, the screen switches to that view with an overlay for car lengths. It's kinda handy, but I probably wouldn't pay much more marginally for that feature.
Honda is awesome! The only other car manufacturer I would buy from beside them is probably Toyota. That being said... Please don't let them touch ANY of the software... The head unit in my car is a UI/UX disaster, if you try to use it in any capacity while driving its definitely worse then just texting and driving. The only saving grace of the Honda head unit is that they finally started implementing Android Auto in them. Also, the Lane Keep Assist and Anti-Collision features leave a lot to be desired.
Yikes. Terribly distracting controls and sounds like significant challenges with safety features (lane keep and anti-collision). What makes Honda "awesome", in your opinion? I'm wondering what is ranking higher than these safety concerns you mention?
I've owned a Plymouth Voyager, Toyota Tercel, Mercedes c280, Mercedes ml320, a Ford Focus, and a Jeep Wrangler in the past. Hands down the Honda is the most reliable and cheap to maintain car of any I have owned(other then perhaps the Toyota Tercel). My Honda Fit was $18,000 new and had features that were only standard on $25,000+ cars. Things like android auto, CVT transmission with flappy paddle shifters, moon roof, lane keep assist and anti-collision. Sure those systems have some problems, but I like still having them. I fully expect this car to last me 250,000+ miles.
I say it is time for a forward sideways-looking camera for exiting corners or sharp crossings. I do not know if this exists but I have missed it a number of times.
That reminds me of a small project where the British Army gave a budget to some soldiers to add "accessories" to a main battle tank - one of the things they did was add sideways looking cameras at the end of the main gun so they could use it to see round corners.
The Ford Edge has had the option since 2015. Looks like the Explorer got it the next year. The Subaru Ascent has it for 2019. I'm sure there are others that didn't come up in the first couple pages of my search results.
So many problems in such a small package! Security and privacy aside (sic!), I'm not convinced this would help safety: people are notoriously bad at interpreting images from multiple points of view in realtime.
My 2013 Volvo can be fitted with exactly these as an original part by the dealer (it seems they were not available with the original order); the module is placed into the Volvo logo, and the driver sees a split image in the infotainment display.
But like the Audi A8 it's not exactly a cheap car; maybe it will be available in more cars in a few years (or once some patent expires?).
The point being that a camera could just film the entire surroundings and show you that picture, instead of exactly what you are able to see through the mirror reflection- i.e. you're constantly seeing your entire blind spot, not just the part the mirror is showing you for your head location.
I think that parallax aside, the benefit of cameras is that a much wider angle can be represented. Much like current reverse-cameras in vehicles, the camera can capture wide/ultra-wide angles of 120-170 degrees. This lets you see everything without craning for parallax. Guidelines can be overlaid for curb/parking situations on demand. Additionally, many auto companies are already augmenting their backup cameras with 360-degree stitched top-down views, which are excellent for curb-centering, etc.
The point is, switching to cameras has aerodynamic efficiencies. Mirrors are currently a necessary cost that cameras could replace to improve drag coefficients, improve fuel economy/range, etc. OP's concern was that the cameras would not provide sufficient substitution for the mirror's features. I'm arguing that wide field of view solves that problem.
So could another camera in the car that watches the drivers head and adjusts the view based on movements. It could also be better too as you can now be comfortable and not contorted to get a proper view(even better than adjusting the mirror). It could also be disabled to provide a stead view. With a touch screen we could stay focused on a target too.
If you are removing mirrors to improve aerodynamic efficiency that's the same as making a 1 gallon gas tank and saying the car will have better performance because it has a better power to weight ratio.
True in theory, but actual practicality near zero.
We aren't racing formula1 cars on the highway, so a mirror isn't really slowing you down that much and creating drag. Especially when you think about how much surface area it occupies versus the actual car itself.
”They can account for as much as three to six percent of the total aerodynamic drag of a car. That may not sound like a lot, but it adds up. Over the course of 200,000 miles, that could cost you as much as $2,000. A study of big trucks (with really humongous mirrors) found they can add a whopping 10 percent to drag.“
That's accounting for the higher end of the 3-6% drag. Also speed is critical, because the aerodynamic effect is exponential with speed so unless you are traveling above 80mph it's barely impacting anything. Sure if you are on the Autobahn it will be higher at 100mph+ but this is a bit of an optimistic guess on their part.
Also, these car mirrors after 200,000 miles will still work. I don't know if the car "video" mirrors will be operational after 200,000 miles so the cost of replacing them can easily out run the "fuel savings" that you would expect.
Lastly, there is something that car manufacturers lose when they move away from the physical world. The parallax effect is one that others have pointed out as a key benefit that would be lost, the fact that I can get a rain spot on my mirror and still see clearly, but if there is water on my rear parking camera I see nothing is something else that needs to be considered.
Progress is great, but at some point you realize you are actually degrading the experience not improving it. The Tesla has a great big iPad to control the car, but guess what, it is super distracting, because there are no physical knobs to touch so anytime you change a setting you are forced to look down. Because there are no physical knobs your finger can not rest on anything so as you are driving on the road any bump or jolt moves your finger which makes it much harder to hit the key you want. This leads to more distraction.
Just because you can doesn't always mean you should.
This isn't well informed -- Mirrors are a substantial source of increased drag. Something like 5% of the air resistance of a vehicle comes from the outside mirrors -- over the life of a car, that's worth several hundred gallons of gas, and across the population of cars, several billions of dollars in savings to consumers. I fret about the longevity of the technical solutions (mirrors on cars from the 60s work as well today as they did when they were installed) but it could be a huge boon.
Wouldn’t removing the front mirrors cause helmholtz resonance[1], aka annoying “window drums”, when the front window is rolled down? If you’ve ever driven with only the rear windows down you’ll know what I’m talking about.
I drive buses for a living. Believe me, when reversing some 15 meter monster into a parking slot, I trust and use my mirrors more than I do the very fancy rear-view camera.
A mirror I have a lifetime experience worth of knowing what is, no perceivable extra layer of processing required. A camera, not quite so, although of course it's a nice enough extra to have.
Sure, mastering the basic controls should be the first step, before ceding control to augmented systems.
However, I have yet to see a mirror that will see behind the back bumper: this has already prevented a host of dangerous situations for me ("person was there, then went somewhere, where the heck are they, oh: for some reason admiring my back bumper and the pretty light that the reverse lights give out").
If "I have a lifetime of experience with this so thats how it should stay" was humanities criteria for accepting new technology we'd still be bashing the neighboring tribes heads in with rocks tied to sticks.
I recently rented a Peugeot SUV in France and the reverse top-down view was awesome - I had to back out of a 50ft (er, 15m) narrow winding driveway and the top-down helped me to do it in a minute instead of 15 min.
Most new cars have parking sensors of some kind. Synthetic 360 vision camera systems are starting to become common on luxury cars and even available on some more down-market models...and those provide way more visibility than any mirror ever will.
A fancy enough camera system can give you a wide FOV and accurate distance indicators to everything on screen.
Parallax is one way we estimate distances, technology can do a lot better than "move head side to side to get a rough idea."
Now getting people used to wide FOV, that may be challenging. Find an FPS that lets you set the FOV to anything you want, set it to 180. After a couple of minutes you can get used to it. Beyond 180 it is hard! But even 190 or so is doable after a bit of practice.
Not sure how the general public would do with that though! (At what point has a high enough % of the general public played FPSs that such a UI could be gotten away with?)
I would say, what is also lacking are resolution, dynamic range, and latency. Regarding the latter, even if it's a closed circuit analog system with no digital buffering, there is still frame refresh to consider.
At night, if the display isn't dark enough, it will act as a light source, interfering with the driver's night vision. Black has to be black, and dark objects that would be visible with the naked eye via mirror had better be visible with the camera.
Yeah, throwing money at it could realistically bring this from just-around-the-corner FM to Actual Machines. Not quite there for COTS equipment yet, for cost-saving reasons (fast processing needs beefy HW, which is expensive in itself, needs higher and smoother power, cooling, etc.).
This seems like one of those things that'd be easier to reason about if the bigger picture weren't about to change (in this case, due to self-driving cars).
I mean, if not for self-driving cars, then we could reason that camera technology will ultimately progress to the point where it'd be vastly superior to traditional mirrors and culturally adopted, reducing this to a question of when/how to do the transition.
But with self-driving cars on the horizon, it's harder to justify revamping human driving techniques since the payoff period would be pretty short.
Which isn't to shoot down the idea; I mean, it sounds neat. Just, it's not as obviously justified as it would've been if we could've reasonably assumed that human-driven cars would still be a thing in 100 years from now.
Yeah, we could make an argument for a hybrid system that provides cameras for human-drivers that might be later repurposed for autonomous-drivers.
I dunno how practical that might be, though. I mean, while I agree that mature self-driving technologies should be able to work with semi-arbitrary sensors, early self-driving systems -- the sort that'll tend to co-exist with human drivers -- would seem to benefit from purpose-specific camera systems, optimized for the benefit of the self-driving system without compromises/complexity to enable dual-use.
Based on the current trend of corporations trying to log and monetize everything, it's not a far stretch to suppose that data from the cameras (and metadata e.g. GPS location) could end up being used for all sorts of things from affecting Insurance - both premiums and payouts, issuing fines for speeding, or parking in prohibited zones or for too long, or even targeted advertising because you happen to visit a particular store, restaurant or other attraction with any regularity.
Some Insurance companies already offer subsidies for "safe drivers" who consent to being tracked [0]... the rest is just natural progression.
My only question is: why? I mean, those are going to be so much more expensive to produce, less reliable and harder to replace. There are some upsides regarding overall visibility, but I think that it's one of those cases in which the ups don't make up for the downs.
Improved fuel economy, improved visibility (especially at night), blind spot coverage, better visual warnings. It isn't really going to be too much more expensive considering cars nowadays already have rear view cameras/screens and all sorts of sensors.
I'm not against all those cameras, nor am I rejecting evolution. I just think that traditional mirrors are doing the job well enough for this to be a question now.
Is it safe to assume that you've never used a car with cameras? I'd be very interested in a camera feed from my front bumper when I'm pulling out on a difficult bend, for example.
I've never driven one without regular mirrors, which is the point here. I'm not saying that it's not a nice extra to have, but it shouldn't replace anything.
Why would a tiny digital camera be more expensive than an entire mirror assembly? My side mirror is full of servos but my backup camera is all solid state.
On trucks/vans rented at Home Depot cameras have already replaced rear view mirrors. The video screen was mounted in the standard rear view mirror position.
Personally, I loved the cameras.
Similarly, I’m able to park faster when I rent cars with cameras. Over the past few years, I’ve perceived that contemporary cars are designed with visual sight lines & ability to see the end of the trunk greatly reduced. Cars almost seem to assume a camera will be available.
Cameras are tremendously better at night, if night vision is available.
We recently got a van with a "360 camera" (the screen in the center console can display an image that appears to be coming from a camera 10ft/3m above the van). When I first heard it described I figured it was a gimmick I'd never use, but I've been very wrong about that. I'm able to park much more smoothly thanks to cameras (even something at simple as centering the vehicle in spot becomes much faster when you can look in one place, rather than back and forth between mirrors).
It has been available on a ton of cars over the past half-decade. It's starting to become a standard feature now. Even the sub $16K Nissan Versa Note has it standard.
In this case it's a Pacifica Plug-in Hybrid. It gets ~30 miles on the battery which more than covers our around-town driving (we average 2,500 miles between fill ups), and it feels like driving a spaceship...
I would think a screen mounted in the standard rearview mirror position would be essentially unusable on the road (as opposed to parking) by anyone who needs reading glasses, as not even bifocal glasses or contact lenses would work with a screen in that position. it would seem one would need a display producing a distant virtual image, like a heads-up display.
"Over the past few years, I’ve perceived that contemporary cars are designed with visual sight lines & ability to see the end of the trunk greatly reduced. Cars almost seem to assume a camera will be available."
That design change preceded camera coverage. I believe you're looking at structural safety there. Making a car that can be collided with in almost any direction safely is not easy. Some window was lost.
In my small SUV, looking out the rear window at night is useless -- literally nothing you want to see is illuminated with the rear lights in a way that's visible out the rear window.
With the camera, on the other hand, the view is great.
There is one thing missing. I have a child mirror on my back seat that I can see from my rear-view mirror. Kind of hard see that when the camera is pretty much looking at the outside.
As a parent, it is in my experience much safer to be able to flip the rear view mirror into "night mode" and have a view of what the kids are arguing about than to have to turn back even momentarily to interact with them.
Self driving cars are the future. However, it may be a lot better transition (both to gain public trust and to improve the technology) to gradually make cars do more things and evolve the vehicle through incremental steps. This definitely is a logical next step.
One thing I've seen in reviews of the system being sold in the Auto eTron is that it's much harder to get a good idea of speed and depth on the rear view camera screens. I really wonder whether this can really be overcome. It'll be interesting to see whether this will become as common as touch screens have become.
My Bolt has a camera rear-view mirror that can be turned on or left off in favor of the traditional mirror. We never use it. Turning the mirror into a screen means you have to focus on the screen rather than the distance when using it; that makes it slower and more uncomfortable to switch between looking forward and back. At least for geezers with older eyes like mine...
We Just bought a RAV4 with a camera as a central console rear view mirror witch you can flip on or off.
It sounds like a great idea but the amount of time it takes your eyes to refocus when moving from the road to the camera makes it a safety hazard. And painful on the eyes.
I am very much concerned about focal accommodation. This becomes particularly important when driving at higher speeds. The sheer fact that my eyes do not need to adjust focus when looking into rear view mirrors (in comparison to cameras/screens) saves me critical milliseconds when overtaking a car or before making a turn.
Of course, this becomes irrelevant when we are talking about parking.
And, in addition, one can use one's stereoscopic vision with a mirror. Even if that does not provide much information about vehicle distance and speed (though it feels to me as though it does), a screen gives false stereoscopic information.
What is the trade-off between safety/functionality and aerodynamics? How would replacing car mirrors affect mileage in a typical vehicle, say a Honda Accord?
This is one of those safety features with redundancy on mind that we could actually double down on it. Instead of replacing side mirrors with cameras how about we have cameras embedded in each mirror, let's say infrared/normal and night-vision so you could chose which camera to look at on screen or outside at the mirror for best assessment of your surroundings.
I'd be really concerned about failure modes here. Like with rear-view cameras, it's not uncommon in heavy snow for it to be obscured. That's not much of an issue when you still have traditional read-view & side-view mirrors to rely on.
So I can imagine cameras further supplementing mirrors, but not replacing them. At least not for human-driven cars. Self-driving cars are another issue, but I'm also willing to bet there's robust failure detection among sensors, lidar, and cameras, and the car would safely shutdown in the presence of an issue.
One of our cars doesn't have heated mirrors. It's not uncommon for the mirrors to be unusable during the winter, especially in the morning and after any amount of ice accumulation.
We can barely get people to clean the snow off their cars before driving on highways. Not sure the tech is the real problem with snow rain, and other weather.
I drive a lot in heavy snow. Mirrors have to be clean and unobstructed to work. During winter, before I get into my car in the morning, I have to clean the mirrors. The rear view mirror is often compromised by my rear window being gunked up, overwhelming the wiper.
So as for failure modes, nah, not terribly worried.
The test driver in the video said it was probably that way for regulatory/safety reasons and sometimes needed when the sun is shining too brightly on the camera. But it's better if someone is sitting in the backseat as well as giving you a wider view than the rear window + mirror alone could.
Yeah let's not forget that mirrors are supplemental to begin with and already can fail. The failure mode is that you have to look around you more. As long as a manufacturer can't use this as an excuse to add more blind spots I don't see a huge difference.
> I'd be really concerned about failure modes here.
I'm so happy failure is being addressed. Because to me (as a former engineer) this is one of the most important factors. In addition to failure due to snow, what about it just breaking? A small rock or crack is not going to greatly obscure a mirror's view. More annoying, but you can still get most information. A smaller lens does have the advantage of a smaller target area but more potential for complete failure. It is also more complex and with more complexity there are more modes of failure.
For example: I used to drive an old truck. The mirror adjustments just did not work, but I could manually move them. Dead simple and the purpose of the device is still achieved even when something broke in the device's chain. With a camera you have the screen (which can seriously affect your night vision! I'm EXTREMELY annoyed about this in my current car), every point of connection from screen to camera (software and hardware), the camera, and the lens. I'm under the impression that not much can go wrong here in the product chain and you still have a functioning device.
BUT the camera does have clear advantages! You can use IR so you can see at night. No glare. Better angles. Software that can do object detection and help you avoid accidents. It is a matter of trade off. Typically in machines that can easily lead to fatality we tend to me more risk adverse.
I see people driving around constantly with fogged up mirrors or have a broken mirror hanging off the side of their car, or snow packed around every window with only a small area cleared out on the windshield. So I'm not super convinced that failure modes are all that important, at least to your average driver.
Just drove a car with multiple sensors and cameras and it wouldn't stop freaking out in the rain. Even while parked in an empty lot. It also slammed the brakes automatically while I was driving. Scared the crap out of me so I immediately turned it off after that incident.
Even without snow, within a day or 2 of being washed, my RVC is unusable when there is any "above ambient" light source shining on it. During the day, that means the sun is anywhere in the 180 degrees behind my car and at night it means anyone has headlights pointed at me.
But given the number of times during snow season, where my backup camera is completely covered or requires me to clean it. I'd trust the mirrors quite a bit more. That said, I wouldn't mind both.
I have the opposite problem in that the backup camera is perfectly visible even when partially obscured and the mirrors become almost useless with ice particles, fog, and water droplets scattering my perception through them.
I'm waiting for someone to propose pointing cameras in all directions and replacing the windshield and windows with screens. It'd let them cut the amount of glass in the vehicle down dramatically, which could have both cost and safety benefits. And it would enable them to remove longstanding visibility issues like blind spots caused by structurally necessary pillars; if the view outside is synthetic, no reason why it couldn't be synthesized in such a way as to provide complete 360-degree visibility.
(Of course, the fight to prove that a car which is essentially a closed container is safe to operate would make the fight to just remove the side mirrors look like a schoolyard scrap.)
Interesting concept. When combined with a self-driving car, you could drive through a particularly unpleasant neighborhood and instead look at views of whatever scenic trip you fancy.
> When combined with a self-driving car, you could drive through a particularly unpleasant neighborhood and instead look at views of whatever scenic trip you fancy.
That is a cool idea, and the recent Mercedes-Benz S-class and others with what they call "360 camera" pretty much has more than enough camera to make this possible however in practice driving around with cameras is pretty awkward, even for parking despite the very cool "3d" effect, I found using mirrors for parking much more practical.
I'm thinking about installing a 360° aftermarket camera in my car. That's because I can't see where my front (esp. the front right side) is with any mirrors. Nose's too low to see the corners.
I've already brushed against other person's car in the dark and lost some sleep over that, waiting for them to contact me (thankfully, they weren't too much upset over it). A 360 camera is certainly not a replacement for mirrors, but looks like an awesome ability to have additional vision.
BTW, I wonder why no one places parking camera display in a way that requires driver to physically turn backwards and see the window as well. Even mirrors don't really provide a proper view, and it's inconvenient (if not unsafe) to turn back and forth.
180 comments
[ 3.4 ms ] story [ 230 ms ] threadYou'd have to have a pretty large jolt to knock a mirror off its housing or mount.
You got me till this point, and you prove we should be cautious about such tech. I live in one of the richest cities in the world (certainly one of most expensive), and the amount of 10+ year old cars is huge. Go to country side, and they become majority, with many clocking 15+ years.
For physical mirror to fail, you need to break it or completely lose it, and then its obvious whats the situation. Electronics have more components that can fail, and as an IT guy, I know what can will eventually fail (ie how many digital cameras work flawlessly after 10 years of daily use?). Last thing I need is to have an potentially unreliable critical safety feature in the car.
I'm also not quite sure that good old mechanical cars fail less than modern vehicles supplied with lots of complicated electronic stuff.
My much newer 2007 car has a lot more electronics (more airbags, automatic breaking, adaptive cruise control), but so far, still has had no problem, but it's only 3 years old (bought in 2016), so time will tell.
The rear-view camera on our car is 3 years old and hasn't broken yet, but it took 7 years for the side mirror to stop working on the other car, so I guess time will tell, but the camera seems much simpler (and the camera doesn't need to stick out from the car like a traditional mirror so should be less prone to accidental breakage)
They could also use complex optics like "plain lens" with a "fish-eye border", or highlight obstacles by boosting colour contrast or adding in non-visual sensor data.
If cameras are that much better we should be getting vehicles that use both (which we do for rear-view but not side-mirrors AFAIK).
I've never seen parallax emulated with head tracking that didn't have piss-poor latency issues. Not to mention poorly configured kalman filters that seem to always do too little or too much smoothing. These systems are fine for cute tech demos but don't belong in safety-critical applications involving multiple tons of steel moving at 100+km/h.
Before replacing mirrors in cars, why not start with making a TV "window" that actually works. Prove the technology in a real world application that isn't safety critical, then we can talk. If it's ready for use on highways, then it should be easy to mount a TV on a wall and provide a convincing experience of actually looking out a window.
I'd love to see a transparent A pillar but I can imagine the parallax issues (talked about in other comments here) would make them a bit weird.
https://en.wikipedia.org/wiki/Volvo_SCC
Imagine a thousand foot tall semi-transparent google maps pin, resting lightly on the head of the person you're picking up, visible for hundreds of miles but only to those who are interested.
I have no idea if it will ever become feasible, but I sure hope it does.
Transparent material that becomes opaque to bright light (something like gamma < 1, gain < 1) in the direction of the light. So each point of the material is transparent or opaque depending on the viewing angle and respective directed light flow through it.
I think such a material could be engineered.
The 2015 Honda CR-V has a camera under the right mirror. When you turn your right blinker on, the screen switches to that view with an overlay for car lengths. It's kinda handy, but I probably wouldn't pay much more marginally for that feature.
https://www.youtube.com/watch?v=pEKq8jmckz0
It's gonna be a long time before mainstream car adopt this though.
Unfortunately, it just cannot be...
Glad it is at least being researched. Thanks for the (very precise) link!
And it had Turbo-Boost (same video with cue-in): https://youtu.be/3KPYIaks1UY?t=81
The Ford Edge has had the option since 2015. Looks like the Explorer got it the next year. The Subaru Ascent has it for 2019. I'm sure there are others that didn't come up in the first couple pages of my search results.
But like the Audi A8 it's not exactly a cheap car; maybe it will be available in more cars in a few years (or once some patent expires?).
Edit: Here is a 52s video/ad for the feature: https://www.youtube.com/watch?v=OkF9Txbeaxg
https://en.wikipedia.org/wiki/Objects_in_mirror_are_closer_t...
Camera's provide more options
True in theory, but actual practicality near zero.
We aren't racing formula1 cars on the highway, so a mirror isn't really slowing you down that much and creating drag. Especially when you think about how much surface area it occupies versus the actual car itself.
”They can account for as much as three to six percent of the total aerodynamic drag of a car. That may not sound like a lot, but it adds up. Over the course of 200,000 miles, that could cost you as much as $2,000. A study of big trucks (with really humongous mirrors) found they can add a whopping 10 percent to drag.“
(0) https://www.cartalk.com/blogs/staff-blog/what-drag-time-get-...
Also, these car mirrors after 200,000 miles will still work. I don't know if the car "video" mirrors will be operational after 200,000 miles so the cost of replacing them can easily out run the "fuel savings" that you would expect.
Lastly, there is something that car manufacturers lose when they move away from the physical world. The parallax effect is one that others have pointed out as a key benefit that would be lost, the fact that I can get a rain spot on my mirror and still see clearly, but if there is water on my rear parking camera I see nothing is something else that needs to be considered.
Progress is great, but at some point you realize you are actually degrading the experience not improving it. The Tesla has a great big iPad to control the car, but guess what, it is super distracting, because there are no physical knobs to touch so anytime you change a setting you are forced to look down. Because there are no physical knobs your finger can not rest on anything so as you are driving on the road any bump or jolt moves your finger which makes it much harder to hit the key you want. This leads to more distraction.
Just because you can doesn't always mean you should.
[1] https://jalopnik.com/why-do-slightly-opened-car-windows-make...
Yes, but with a wide-angle lens camera you can convert to a less distorted view in software. Or stitch together with other views.
A mirror I have a lifetime experience worth of knowing what is, no perceivable extra layer of processing required. A camera, not quite so, although of course it's a nice enough extra to have.
Which nicely explains why young people don’t have the hang ups you have.
However, I have yet to see a mirror that will see behind the back bumper: this has already prevented a host of dangerous situations for me ("person was there, then went somewhere, where the heck are they, oh: for some reason admiring my back bumper and the pretty light that the reverse lights give out").
Parallax is one way we estimate distances, technology can do a lot better than "move head side to side to get a rough idea."
Now getting people used to wide FOV, that may be challenging. Find an FPS that lets you set the FOV to anything you want, set it to 180. After a couple of minutes you can get used to it. Beyond 180 it is hard! But even 190 or so is doable after a bit of practice.
Not sure how the general public would do with that though! (At what point has a high enough % of the general public played FPSs that such a UI could be gotten away with?)
At night, if the display isn't dark enough, it will act as a light source, interfering with the driver's night vision. Black has to be black, and dark objects that would be visible with the naked eye via mirror had better be visible with the camera.
The main issue would probably be cost, but at a technical level having a suitable screen for car mirrors shouldn't be a problem.
I mean, if not for self-driving cars, then we could reason that camera technology will ultimately progress to the point where it'd be vastly superior to traditional mirrors and culturally adopted, reducing this to a question of when/how to do the transition.
But with self-driving cars on the horizon, it's harder to justify revamping human driving techniques since the payoff period would be pretty short.
Which isn't to shoot down the idea; I mean, it sounds neat. Just, it's not as obviously justified as it would've been if we could've reasonably assumed that human-driven cars would still be a thing in 100 years from now.
I dunno how practical that might be, though. I mean, while I agree that mature self-driving technologies should be able to work with semi-arbitrary sensors, early self-driving systems -- the sort that'll tend to co-exist with human drivers -- would seem to benefit from purpose-specific camera systems, optimized for the benefit of the self-driving system without compromises/complexity to enable dual-use.
Some Insurance companies already offer subsidies for "safe drivers" who consent to being tracked [0]... the rest is just natural progression.
[0]: https://www.rac.co.uk/insurance/black-box-insurance
Personally, I loved the cameras.
Similarly, I’m able to park faster when I rent cars with cameras. Over the past few years, I’ve perceived that contemporary cars are designed with visual sight lines & ability to see the end of the trunk greatly reduced. Cars almost seem to assume a camera will be available.
Cameras are tremendously better at night, if night vision is available.
That design change preceded camera coverage. I believe you're looking at structural safety there. Making a car that can be collided with in almost any direction safely is not easy. Some window was lost.
With the camera, on the other hand, the view is great.
If you want to supplement actual mirrors, fine. But replacing them entirely is stupid.
edit: also the title says "could", so it means they won't
We Just bought a RAV4 with a camera as a central console rear view mirror witch you can flip on or off.
It sounds like a great idea but the amount of time it takes your eyes to refocus when moving from the road to the camera makes it a safety hazard. And painful on the eyes.
Nice concept. Fundamentally unusable.
Of course, this becomes irrelevant when we are talking about parking.
So I can imagine cameras further supplementing mirrors, but not replacing them. At least not for human-driven cars. Self-driving cars are another issue, but I'm also willing to bet there's robust failure detection among sensors, lidar, and cameras, and the car would safely shutdown in the presence of an issue.
In heavy snow, this can also happen to mirrors and your rear window. Usually you open the driver door so you can look behind you.
Thankfully, I finally have space in the garage that this winter it won't be an issue.
So as for failure modes, nah, not terribly worried.
https://www.youtube.com/watch?v=1QcJQ_7VFb0
The test driver in the video said it was probably that way for regulatory/safety reasons and sometimes needed when the sun is shining too brightly on the camera. But it's better if someone is sitting in the backseat as well as giving you a wider view than the rear window + mirror alone could.
I like to use darker film in side windows, but it makes hard to use the side mirrors at night, I would love to replace them with cameras.
Things like night mode and anti-glare would be pretty cool as well.
I'm so happy failure is being addressed. Because to me (as a former engineer) this is one of the most important factors. In addition to failure due to snow, what about it just breaking? A small rock or crack is not going to greatly obscure a mirror's view. More annoying, but you can still get most information. A smaller lens does have the advantage of a smaller target area but more potential for complete failure. It is also more complex and with more complexity there are more modes of failure.
For example: I used to drive an old truck. The mirror adjustments just did not work, but I could manually move them. Dead simple and the purpose of the device is still achieved even when something broke in the device's chain. With a camera you have the screen (which can seriously affect your night vision! I'm EXTREMELY annoyed about this in my current car), every point of connection from screen to camera (software and hardware), the camera, and the lens. I'm under the impression that not much can go wrong here in the product chain and you still have a functioning device.
BUT the camera does have clear advantages! You can use IR so you can see at night. No glare. Better angles. Software that can do object detection and help you avoid accidents. It is a matter of trade off. Typically in machines that can easily lead to fatality we tend to me more risk adverse.
Just drove a car with multiple sensors and cameras and it wouldn't stop freaking out in the rain. Even while parked in an empty lot. It also slammed the brakes automatically while I was driving. Scared the crap out of me so I immediately turned it off after that incident.
But given the number of times during snow season, where my backup camera is completely covered or requires me to clean it. I'd trust the mirrors quite a bit more. That said, I wouldn't mind both.
(Of course, the fight to prove that a car which is essentially a closed container is safe to operate would make the fight to just remove the side mirrors look like a schoolyard scrap.)
This sounds awfully dystopian…
https://www.youtube.com/watch?v=UgnR4i_umhE
I've already brushed against other person's car in the dark and lost some sleep over that, waiting for them to contact me (thankfully, they weren't too much upset over it). A 360 camera is certainly not a replacement for mirrors, but looks like an awesome ability to have additional vision.
BTW, I wonder why no one places parking camera display in a way that requires driver to physically turn backwards and see the window as well. Even mirrors don't really provide a proper view, and it's inconvenient (if not unsafe) to turn back and forth.