Ask HN: What is the most impactful thing you've built?

729 points by rafiki6 ↗ HN
I'll start. For me, I think the most impactful thing I've ever built was an internal application for a FX trading desk that eventually went on to handle billions in daily trades.

It didn't use any fancy frameworks, just plain old CRUD on Java.

758 comments

[ 4.5 ms ] story [ 564 ms ] thread
For some people the most impactful thing they have done in life is create something that makes obscene amounts of money. I designed and built nanoshelters.com to help homeless people secure uninterrupted sleep. I should be worth more than most of you 'money is god' programmers but we live in a world that values how you much money you make rather than how you treat other humans.
I appreciate the good you've done for the world, but isn't that last sentence just a little bit ironic?
I won't speak for the parent comment, and this isn't a critique on you, but I think it's more of a reflection on the reader than an ironic take.

Many would read "I should be worth more than..." as "I should have more money than...", but that's exactly what the parent comment is railing against. In the corporate world, and especially in the startup space, money is often the metric that defines worth. In the parent comment's world, I imagine they would rather that not be the case, and by <some other metric> they would be worth more than these startups/"money is god programmers" that are "only" worth money.

It could've been put a bit more nicely by not implying the reader is a 'money is god programmer,' but otherwise it's a valid opinion, I think.

I understood it to mean "most of the people on this site", and I certainly didn't take it personally.

The irony I understood from the comment is that the metric the commenter suggests should be considered more strongly is how one treats others, and they do so in the same breath as talking down on some group of people, which would probably take a few points off of their value as measured by that metric. The irony, in my mind, does not hinge on whether or not they'd be more valuable than the subjects of their missive but rather on the fact that their actions conflict with their value system.

What do you mean by “worth more”?
sleep in ze pod, eat ze bugs
Could you please stop posting unsubstantive and/or flamebait comments to Hacker News? You've unfortunately been doing that repeatedly and we end up having to ban that sort of account. I don't want to ban you.

If you'd please review https://news.ycombinator.com/newsguidelines.html and stick to the rules when posting here, we'd appreciate it.

I take offense at this. I value other humans, I help other humans. Most people do. But I take care of myself and expect other people to mostly do the same.

I think it's telling that you frame your most impactful work in the context of how much better you are than other people, and how the world owes you something other people have because it's an unjust place, and the mindset probably does more harm to you than you'd realize. If you want to help people, do that, focus on that.

If they made obscene amounts of money means that what they did was obscenely useful and valued to many people. Nothing wrong with that.
I guess my most impactful project was a microprocessor-based weather station for siting wind energy systems and fruit frost prediction in the early 1980s. Turned out that one of my stations, being used by a frost predictor, was across the street from a rural drainage ditch in which a young child was discovered face down in the water. The frost predictor faxed temperature profiles for the previous several hours to the hospital, where doctors determined the child could be revived. She was.
That’s amazing.
Interesting that one my the developers on my projects was Dan Wood.
Wow! That's a pretty amazing story. Thank you for sharing.
Thank you! Took me by surprise when my client phoned and said my weather station was on the evening news.
wait... they won't try to revive a child unless they can first prove that said child can be revived? Why not just... try to do it regardless and hope for the best?

Also, as a new parent, my immediate thought is of course "WHO wasn't watching the kid??"

Just a guess, but it might have something to do with whether the brain is able to be saved vs. just the body.
yes but why wouldn't you try regardless of knowing? In the time you spend gathering temp data, you could already be reviving
I imagine they were doing that regardless, but were very happy to learn that there was an actual chance of success.
That, in fact, is how I figured it went. I did not get to see the video, so everything remains speculation.
Because chances are extremely slim:

> Various degrees of hypothermia may be deliberately induced in medicine for purposes of treatment of brain injury, or lowering metabolism so that total brain ischemia can be tolerated for a short time. Deep hypothermic circulatory arrest is a medical technique in which the brain is cooled as low as 10 °C, which allows the heart to be stopped and blood pressure to be lowered to zero, for the treatment of aneurysms and other circulatory problems that do not tolerate arterial pressure or blood flow. The time limit for this technique, as also for accidental arrest in ice water (which internal temperatures may drop to as low as 15 °C), is about one hour.[84]

Also you can't just warm the body back to 38 degrees, it should be carefully brought up AFAIK.

During a centralisation of public school local servers to a data centre, I created a consolidated library enquiry system. It served over 2,000 libraries, had 330 million titles, and had about a million users. It was efficient enough to run off my laptop, if need be.

AFAIK it was one of the top five biggest library systems in the world at the time.

I was asked to add some features that would have been too difficult in the old distributed system. Things like reading competitions, recommended reading lists by age, etc…

I watched the effect of these changes — which took me mere days of effort to implement — and the combined result was that students read about a million additional books they would not have otherwise.

I’ve had a far greater effect on the literacy of our state than any educator by orders of magnitude and hardly anyone in the department of education even knows my name!

This was the project that made realise how huge the effort-to-effect ratio that can be when computers are involved…

Cool story! what languages, frameworks, etc did you use? Or are you about to tell me COBOL? :P
The legacy back-end system being migrated was Clipper + dBase III on DOS, which is reminiscent of COBOL.

The part I added was built with ASP.NET 2.0 on top of Microsoft SQL Server 2005, and was eventually upgraded to 4.0 and 2008 respectively.

The only magic sauce was the use of SQLCLR to embed a few small snippets of C# code into the SQL Server database engine. This allowed the full-text indexing to be specialised for the high level data partitioning. Without this, searches would have taken up to ten seconds. With this custom search the p90 response time was about 15 milliseconds! I believe PostgreSQL is the only other popular database engine out there that allows this level of fine-tuned custom indexing.

p90 for a full-text search on 330 million documents was 15ms?

I know you can tune the hell out of search performance, but that seems a bit too insane for what looks like a relatively unspecialized setup (Standard DB).

Not likely the full book, just title, author and a few other low cardinality fields I'm sure. Also not likely 330 million unique volumes, but total books. This is within reach of a single database with proper indexing.
Can you elaborate a little bit more about how you partitioned it?
I simply added the "library id" as a prefix to almost every table's primary key. Every lookup specified it with an equality filter, so essentially it was thousands of standalone libraries in a single schema.

One hiccup was that when the query cardinality estimator got confused, it would occasionally ignore the partition prefix and do a full scan somewhere, bloating the results by a factor of 2000x! This would cause dramatic slowdowns randomly, and then the DB engine would often cache the inefficient query plan, making things slow until it got rebooted.

This is a very deep rabbit hole to go down. For example, many large cloud vendors have an Iron Rule that relational databases must never be used, because they're concerned precisely about this issue occurring, except at a vastly greater scale.

I could have used actual database partitioning, but I discovered it had undesirable side-effects for some cross-library queries. However, for typical queries this would have "enforced" the use of the partitioning key, side-stepping the problem the cloud vendors have.

Modern versions of SQL Server have all sorts of features to correct or avoid inefficient query plans. E.g.: Query Store can track the "good" and "bad" version of each plan for a query and then after sufficient samples start enforcing the good one. That would have been useful back in 2007 but wasn't available, so I spent about a month doing the same thing but by hand.

This makes the performance a lot more understandable if you're only searching in a single library. I assume that cuts out >99.9% of those 330 million documents.
is this symphony or horizon or spydus or koha? or?
All those commercial systems existed before his (going by his use of SQL 2005).
ah. i was just listing the ones that i could think of that use the concept of a library id.
> This was the project that made realise how huge the effort-to-effect ratio that can be when computers are involved

I love Steve Jobs' metaphor: computers as a bicycle of the mind [0]. Unfortunately, a lot of effort is concentrated on problems that scale to billions of people. There's a lack of attention to problems that would have a big effect for a relatively small number of people. It's a shame, because they're a blast to work on.

[0] https://www.youtube.com/watch?v=L40B08nWoMk

They really are. I think the most rewarding software I ever wrote was my first paid gig, where I automated lap swim scheduling for my local swim club. Took me maybe an hour, got paid more money than I'd make in two days as a lifeguard, and they were thanking ME for it. Turned out I had saved a volunteer upwards of an hour every week. With a shitty little JavaScript program.
The first time I heard that metaphor, I thought that he meant it in the way that bicycles are really fun to ride. I agree with both interpretations.
I have a bunch of small scale ideas that I want to implement. Not necessarily for profit. Any ideas on how to execute?
Pick one that scratches one of your itches, and get started. Release early, keep iterations small. It's easier to keep working on something you actively use.
... and this is how OCLC was created?
> had a far greater effect on the literacy of our state than any educator by orders of magnitude

Nice work, but check your ego mate. Seems your growth hacking would have had zero result if those kids couldn't read to start with, so you could share some credit ;-)

Maybe it wasn't meant that way. If they hadn't had been there then somone else would have been. You can be on the crest of a wave and not be responsible for its power.
By that logic, the people who farm the trees that make the books have more impact than anyone before them, unless you want to consider the people that make the tools, or feed the farmers, etc etc.
Any more info? This is fascinating.
> hardly anyone in the department of education even knows my name!

it's okay sir, we now know you as jiggawatts

Most of the most consequential changes to the reddit feeds a few years ago I was involved in or directly came up with. The most visible was probably the one that started putting discussion-heavy posts on the front page (things like legaladvice, amitheasshole, askreddit, unpopularopinion, etc). It’s weird to think about the resulting butterfly effects that are completely beyond my knowledge and comprehension.
It's crazy how things have changed. Reddit is now heading in the opposite direction. It's a shame, because I think that your approach was the better one.
Impactful?

Designed and deployed credit card readers used in gas pumps back in 1979. (Sold to Gasboy)

Wrote a fine tuner to allow communication between satellites (precursor to TDRSS days). Still used to this day.

Failover of IP in ATM switches (VVRP, PXE, secondary DHCP, secondary DNS, secondary LDAP, secondary NFS). While not invented here, it is still used today as this is a Common setup to this day.

Printer drivers for big, big high-speed Xerox printers on BSD. Still used to this day by big, big high-speed printers.

Also, early IDS products (pre-Snort) at line-speed. Sold to Netscreen.

Easy zero-setup of DSL modem before some BellCore decided to complicate things (thus exploding their field deployment budgets; Southwestern Bell/Qwest enjoyed our profitable zero-setup). Sold to Siemens.

1Gps IDS/IPS before selling it to 3Com/Hewlett-Packard Packard.

Now, I'm dabbling in a few startups (JavaScript HIDS, Silent Connections, replacing the systemd-temp).

Impact? It is more about personal pride but its impacts are still being felt today.

How did you find all these product market fits?

Have you made more than a typical SWE?

It was actually a wandering hyperactive/ADHD mind that often said "why isn't there one" and follows through doggedly to the very end.

It is one of those traits where a mind clicks and said "this is it and how" and surprisingly gets into the most illusive hyperfocus/high-energy mode (without using any drug).

Slow-path network processing (arguably me) was commercially made in Ascom Timeplex in 1982 and someone else leaked it to Cisco (or ripping AT's patent off). I got that from observing how different river bends (re)connect year-after-year while doing trout fishing trips.

Money-wise, I am disabled, got abled, disabled again in different way, re-enabled, now just coasting with my own ideas: JavaScript Host-Based Intrusion Detection/Protection System, being one of them. And an portable AirPod detector (for home/auto/travel) is another idea. And DNSSEC for within private enterprise is almost done.

Money is not my thing but it does help greatly in the pursuit of my ideals (so many hardwares, so many test equips).

How did you get disabled?
A bacterial infection. Differently twice.
Wear a rubber next time.
Kinda hard to do, I do sorta have to breath, ya know.
Just not sure it would have helped much. Think Civil War battlefield infection.
can you please explain what is JavaScript Host-Based Intrusion Detection/Protection System?
It is simple. Too many malicious and privacy-violating JavaScript abounds, especially after being boiled down to seemingly-indecipherable WebAssembly bytecode.

And a typical enterprise NIDS would not be able to see beyond those encrypted packet containing JS over 2-way-signed TLS/SSL, or HTTPv3 (QUIC) (or a few other E2E protocols).

Since JavaScript won't be banned (unlike Adobe Flash/ActionScript, BTW Adobe's JavaScript is still being used within PDF files) anytime soon, this is another example of seeing a void and rushing to fill its need for the betterment of Internet citizens.

Just yesterday, another "this is it and how" moment came to me: this Python PDF guy (and a few PDF experts) got me thinking "this is how to remove or make inert the JavaScript inside PDF": https://news.ycombinator.com/item?id=33646951

Quick and dirty cleanup - convert to, then from postscript.
I absolutely love your thinking. What you propose does is defang the programmability aspect into an inert (but safer) "text-based" form.

But which side should assume the responsibility of this JS-defanging effort into text-based? Client or server? Postal said "be liberal in what you receive and conservative in what you send". So, being conservative (in this respect), server has to be minimalistic (including denial of programmability).

Real problem remains, too much accessibility of programming is being made available to let client-side take it in ... in a gullible way.

And no amount of Sideshow Barker (not a dig on HN's Sideshow Barker) can fix this, until one of the MAANG decides "enough".

Meanwhile, the wild Wild West shall continue.

I do enjoy sharing the fruit of my labor; but I share what money I have as well.

But, I "share" my money with those who provided me and others with things, like farmers, truckers, construction workers, plumbers, electricians, architects, textile workers, drafters, crafts-folks, artists, custodial, medical specialists, government workers, educational specialists, sanitation folks, engineers, engineers, engineers. Did I repeat that? Yes, more engineers.

I'm quite sure you do share your money too (and probably may not know the true extent of your reach).

OMG, Who are you?
(comment deleted)

  user: egberts1
  created: May 5, 2015
  karma: 1337
chefkiss
This: https://www.wikiwand.com/en/The_Farmer%27s_Market . Helped a few thousand people get their meds before we all got arrested. No regrets.
Reading your comment I thought this was going to be a darkweb site for cheap pharma stuff from Canada/Mexico to the U.S., did not expect straight up drugs.
oh wow. you were adamflowers? did you just get out of prison? glad you have no regrets, I can't imagine how much serving that much time must suck.
Why better? More canonical, sure. But honestly, Wikipedia interface is bad: the super long lines are hard to read. Also WikiWand shows the table of contents in the left sidebar, making it always visible and accessible. I find this much nicer than having to go to the top of the page.
I have not used your site, but I think it is awesome you are back! How did you get caught? Are there any privacy tips you have learned from the experience?
I built https://topstonks.com, it was one of the early sources of information during the meme stock craze, and a primary source for several major news outlets.
The 2nd most used analysis tool on NSANet in response to the 9/11 commission report that the agencies weren't sharing data. https://twitter.com/masonrothman/status/1521407937985404928
Did you work with Bill Binney? I had a chance to meet him once and got the impression he was the go-to "get shit done" guy at NSA around that time. IIRC, he mentioned having a group of contractors that worked with him throughout his career and credited them with his success.
Spyspace and the Mitch Hedgeberg Quote Generator pages were a hoot!
Hmm oddly probably my first “real” full time job is where I had the most impact - I was one of two programmers hired for a summer to redesign a stress testing suite for a server hardware vendor, prime95, cuda-burn, etc. integrated into one single python application to collect the data. I stayed there during the school year part time and the next summer I got to hire another dev (my counterpart left to facebook).

We then worked on a baremetal automation system that worked through IPMI to completely automate the burn in process -remotely starting servers as soon as they got their IP registered, PXe booting them to the burn in image, and then kicking off the testing process. We had a way overkill rabbitmq system to collect streaming logs from every server as they ran, and all orchestrated via rethinkdb change feeds. I think it is still the most complex software project I have done. Basically one python file would launch 7 separate python processes, each their own rethinkdb change feed. This predated docker otherwise it probably would have been 7 docker containers haha.

I've worked on numerous medical devices, many startups. From treating cancer, kidney disease, or providing tools for reconstructive surgery.

Nothing hits you in the feels than having customers thanking you for improving their quality of life, or a child thanking you for giving a parent more years of life.

Whats the most exciting medical device technology today? Red light therapy?
Depends how we want to define impact.

Is it - what is the thing I made that the most people use? A core service within AWS. Very insane scale.

Is it - what is the thing I made that I think will be the most intrinsically "beneficial" to society? Probably https://contractrates.fyi I've done a lot of freelancing myself and there really doesn't seem to be any single community or hub for freelancers that isn't trying to squeeze every last dollar out of them. I'm trying to make a thing that is legitimately helpful and completely free.

Definitely All About Berlin. A few years ago, I started documenting how to deal with German bureaucracy as a foreigner. The website grew and grew until it became a well-known resource for immigrants. It has become my full-time job at some point in 2020.

It's been a little over 5 years since I started, and I'm still super stoked about my work. I still enjoy doing the research, rewriting guides a dozen times, and answering reader mail. People seem really grateful for it, and it means a lot to me.

I use your site often. Thank you for creating it, it's a great resource!
The second generation Web UI of a Series A startup in 2011 that went on to be acquired for $1B in 2020. I have another promising personal project in the works I'm hoping overtakes it.
For 10 years until recently a statistics research system that was the primary tool for keeping granular measurements on the health of the US economy.
Is there a place to read more about that?
Myself. Came from a dysfunctional family, enormous debt and have survived lots of trauma to reach a decent position + decent net worth.
This is a very underrated comment
Way to go stranger internet friend! Glad to see not only that you've overcome what you say you have, but also that it's a point of pride. Keep it up!
I worked on the epitaxy for vcsels that go into iphones for the facial recognition. Not that impactful but cool to know that the stuff I worked on is in use all around me.
Built Video Hub App that almost 5,000 people have purchased. I was a math teacher, became a web dev 6 years ago, built this 5 years ago. Most proceeds go to charity. Very minor by comparison to others, but I'm just starting out ;)

https://videohubapp.com/ && https://github.com/whyboris/Video-Hub-App

What I did that is most impactful is that I've been giving at least 10% of my income to cost-effective charities for over 10 years now (see Giving What We Can - thousands of others do the same). This amounts to almost $100,000 given to charity which translates to thousands of people protected from malaria for many years of their lives.

Very cool! Thanks for sharing.
What was your app build with if you dont mind me asking
It's Electron (Chromium & Node) running Angular. Has FFmpeg under the hood to generate screenshots. The full code is in the repo - see link above :)
I built a blog in 1999, very small impact, but it was the most impactful thing I've built. I wanted to build a website to be Slashdot for librarians, and it was quite popular for years. I ended up starting my own webhosting business, and changed my entire career path. So it mostly impacted me, but I think there were some small ripple effects.
Worked on software used in cash registers owned by Target, Walmart, the US Postal Service, and various large European and Asian equivalents. Comparing the previous model's UI to the new one was similar to the jump from command line UIs to GUIs, in that they were easier to understand without having to know a bunch of obscure commands. The company did a lot of work to ensure they were also fast to use like the old text-based ones. It really made the obscure cases easier for cashiers with little training to handle.
I like to write personal open source projects to learn a language / learn a statistical concept to its core. To learn Python, I build a missing-value imputation package. This one hit it (to my standards) pretty big. 500k downloads so far, but as someone who uses it daily, I’m most proud of the fact that it’s still the best at what it does[1]: https://github.com/AnotherSamWilson/miceforest

[1] according to my personal benchmarking/use cases and anecdotal experience, no promises.

Nothing groundbreaking. But during my few years in game dev I built a relaxing game that had a spiritual component to it. Was one of my first games so.. plenty of flaws from a game design perspective. But one day I got an email from a player thanking me because the game helped immensely during a difficult time. Made my day... actually, I still think about once in a while. So, I guess you can say it was impactful for one ;)
Did a lot of work on Wikipedia with media, usability, and internationalization. As with all such things that merely facilitate volunteers, it’s hard to say what’s mine or put dollar values on it. But it’s touched at least a billion lives, and facilitated a large fraction of a media library that will likely outlive me.

I’ve worked on minor stuff that was foundational to Google’s commercial offerings, but I think that isn’t as high impact and probably someone else would have done that as well or better. For the Wikipedia stuff, for good or ill, I owned some of those decisions.

Wikipedia could not work without that sort of work. Same with Open Street Map and all the little contributions to the map. It adds up to a lot.
About 25 years ago, with a group of friends: https://www.srcf.net/

It was what you'd call a community-run webhost, but at a time when such things weren't common. The main innovation was making it easy for multiple people to administer and hand over websites: we'd noticed that student society websites tended to get lost or rebuilt every year, because they were run under people's personal accounts which stopped working when they graduated.

Thank you! The SRCF is incredibly useful. Long may it continue.
A nodejs closed caption converter. I’m not a developer but can get along just fine for most of my projects.

Funniest part was, I open sourced it. Then a few years and an acquisition later the parent company tried to sell us a tool for converting caption files based off my own code.

https://github.com/jasonrojas/node-captions

I'd love to hear more details about how that interaction went!
My friend and I in the room who just laughed, we said "Oh this is cool, what are you using to parse the caption files?" They mentioned my project and I said "Yeah I am the maintainer....." pretty sure nothing else was really said about it after that... Not as fun as you probably hoped but for me it was fantastic.
How did you feel about that from a licensing perspective?

Not trying to bait a copyleft vs permissive argument, I'm genuinely interested.

I honestly just laughed it off and chalked it up to a really fun experience. If someone finds my code useful in some way I guess it proves I did something decently. If they sell it and make $ off of it well yeah it wouldn't be ideal but hey, It's open source, I made it so people can use it.
Probably this JavaScript function I posted on my blog in 2003 https://simonwillison.net/2003/Mar/25/getElementsBySelector/
Wow. You were the original querySelector. It's funny how you forget that somebody actually sat down and wrote these things into existence at some point. Thanks!
Even more impressive to me is writing things into existence without the benefit of being able to dig in to the underlying browser tech, and only being able to use the public (at the time) DOM APIs like getElementById, etc.
Wow, 10 years before document.querySelectorAll()!
> Wow, 10 years before document.querySelectorAll()

querySelectorAll wouldn't ever appear without jQuery which got its idea from Simon's idea.

And even then querySelectorAll was so poorly implemented that it didn't even have any useful helper methods.

He's understating, perhaps on purpose.

Datasette, Django, and Lanyrd.

To be fair the original question was "most" impactful thing...
Ten years ago I was reading [0] and I remember your name was mentioned somewhere. Here is a quote:

> Locating elements by their class name is a widespread technique popularized by Simon Willison (http://simon.incutio.com) in 2003 and originally written by Andrew Hayward (http://www.mooncalf.me.uk)

[0] Page 91 from "Pro JavaScript Techniques" by John Resig.

Hey Simon, thanks for creating Django with Adrian. I was deeply interested in programming from a young age but learning Django in my teens sparked a passion for web development that has yet to feign so many years later! Appreciate all your contributions to this space.
OMG.

My most impactful thing I've done outside of paid work is a website running on Django. I could live without queryBySelector or their descendants, but not without Django.

Thank you, Simon.

What a coincidence. Just yesterday i've used getElementsBySelector for the first time while making a greasemonkey script.
I like seeing this. At the time I remember thinking we needed something like this, and why doesn’t the browser have it already?

Then thinking, I suppose you could do it by (exactly the method you used), but never actually doing it because if it were that simple, someone would have already done it.

Actually, seeing the date, I realize this predates me even leaving high-school, which makes it even more atrocious that I never knew of it!