How are you using ChatGPT internally at your company?

129 points by open1414 ↗ HN
I am curious how other people are using the API in their company. I've mostly just used it to help write up generic emails in my personal life.

125 comments

[ 3.2 ms ] story [ 208 ms ] thread
Not much, really. OpenAI blocks my company's VPN so I can't even get to ChatGPT.
You mean your company blocks it, or has OpenAI black listed particular VPNs?
OpenAI blocks all VPNs. Some get through regardless, those seem to be the exception.
The list of those that successfully connect is very interesting information.
a few people use it as a general-purpose SQL query generator, i personally use it for debugging, and i have the impression that some people are using it to draft emails
Extremely good at turning JSON into a Go struct. Just in general, as someone who has spent years writing Python, it’s helped me fill in gaps with Go. This is a killer feature for GPT.. if you’re proficient in one language it can help you rapidly get up to speed in another.
Surprisingly GoLand has this build in. Just copy Json into a .go file and it'll prompt you if it should convert it to a struct.
unsurprisingly, the thing built for translating languages is really good at translating languages
Coding aid for unittests. Debugging aid for languages / frameworks I'm not particularly familiar with. Work that requires reformatting. Translating from rough drafts to more polished / professional language. Learning more about domains I don't have much expertise in where I need specific conceptual questions answered.
We use it a lot at my job. A lot of tasks that used to hour long minor tasks are great for generating with ChatGPT and getting them done in a few minutes

Prompts like these

1. Generate me a build pipeline using GitHub actions that builds a java project with docker and posts JUnit test results to a PR

2. Write me a python program that copies all the Cloudwatch dashboards my production AWS account, replace all the instances of the word ‘prod’ and replace with ‘qa’ and and post the results to this AWS account.

These are two things I’ve done recently that aren’t particularly enjoyable but necessary parts of any software work.

I'm wearing a lot of hats at the moment since we're still in startup mode so the list is pretty varied:

- I ask it to create list of questions that different personas might want to answer with our reports section. I then ask it to categorize those questions & to then provide suggestions for graphs & dynamic filters that would help answer those questions.

- I ask it for help translating emails and documents for international customers.

- I ask it to create markdown, formatted spec documents with really verbose context. Helps me as sort of a foundation for feature sprint kickoffs.

- I ask it to take internal documentation and to simplify it so that we're able to use it for public facing help center documentation.

- I use it as my first resource for asking questions about SQL queries, React patterns, explaining different things eg SVG properties and how to manipulate them. I gut check things with Google when I feel like it might be hallucinating but generally it does really well ~ 90% of the time. Saves lots of time compared to going to Google first.

- I ask it for help writing tests or help refactoring code

- I asked it for help in creating some policy & procedures docs that we needed for compliance. Essentially gives you a decent template to then build from & customize.

- Lots of other things. It replaced Google for so many things in my daily workflow. It also helps a lot when you're not feeling creative and you need some ideas.

> I gut check things with Google when I feel like it might be hallucinating but generally it does really well ~ 90% of the time. Saves lots of time compared to going to Google first.

I was asking chatGPT give me boilerplate for Fabricjs Object today and it added a random object property which was nowhere to be found on official docs. At first I thought it was amazing to get a real looking code but upon testing I was confused how to take this.

(comment deleted)
A few directors have sent emails lettings folks know it's ok to experiment with as long as they dont send passwords or PII.

I had it draft a thorny recursive SQL query for me one time (which I did write some extensive automated tests to validate)

Your directors are more creative than mine. Our CyberSecurity had ChatGPT non functional within days of it being released publicly. Apparently it's too much of a risk, or some nonsense.
I understand the frustration but I have sympathy for your security team. As a former security engineer you'd be shocked at the nonsense I had to clean up from our devs.
we built our own AI chat, it’s not that hard. It’s wired up to our internal data, with nlp search, and a few tools using swagger.
Sounds like a fun project. Are you following some existing documentation? Curious to know about the process. Must have good compute power.
Using for academic research. It is especially useful for translating long strings of numbers in classical Chinese sources into Arabic numbers. It's not perfect, but well over 90% accurate and saves much tedium.
I find that when it writes code, I can't trust its output. I handle that by being Grumpy Old Programmer: I eyeball it closely and ask myself about error handling, assumptions, off-by-one errors, is it confusing the 1.1 API with 2.0, is it efficient or naive, and all the other questions that happen in a code review.

So you're pushing 100 Chinese numbers through ChatGPT to get Arabic equivalents. What do you then do to ensure the quality of output is high? Do you eyeball the list and go "hm, seems plausible"? Spot checks? Is there some context around the lists that means erroneous translations will be quite obvious to the trained eye?

I'm always curious what QA looks like in other fields.

I'm working with historical documents from the 18th century, and will likely be the last person to look at them for a decade or so, and consequently need to be correct. I translate them quickly manually, then use ChatGPT to check my efforts. It tends to catch my errors (about 1 in 20) and I catch its predictable mistakes (easy to see), which occur about 1 time in 10. The type of mistakes it makes (inventing a number in the 1000s position instead of using a 0) are ones I am unlikely to make, and vice versa (I am usually off by one due to a typo). So a strange, but serviceable team.
I’m a company of one, and I use it every day, multiple times a day as a coding assistant. I’m using the excellent Code Genie (sp?) plug-in to VSC which puts a chat window directly in VSC and does cool things like allow you to highlight blocks of code and ask contextual questions / refactors / bug checks, etc.

I would say my efficiency is up ~20% since starting to use it, and my Google searches & StackOverflow visits are probably down 80-90%. At least with respect to this corner of the internet, they are both in mortal danger.

(comment deleted)
Just curious how the data flow works. Are you sending information to both places, CGenie and OpenAI? Full disclosure, I have never used CGenie. I know you can turn off data collection at OpenAI, can you do the same with them?
The VSC extension is just a conduit to the OpenAI API. You use your own API key. I haven’t dug into the exact data flow, however, so I can’t speak to whether the extension is collecting any or what data itself.
Lmao, OpenAI is the bigger threat here than some random dude who made an extension.
How do you measure productivity?
How long it takes me to build new features for my application, fix bugs, and in general get things done.
I believe this is the extension: https://github.com/ai-genie/chatgpt-vscode
Thank you - yep that’s the one. Sorry I was on mobile and going by memory.
Quick question: How does Code Genie get responses from the GPT API so quickly? I'm developing an app right now and it takes 40 seconds to query gpt-3.5-turbo.
Were you able to stop using Copilot with that extension? I'm waiting for Copilot X and my Copilot use is very minor..
Aparently refactoring the BE from JS to TS, I'm not involved in the effort though so dont know the details.
Copywriting content creation, job postings, translation, rough drafting code. So far it's all topical usage by employees but we've already got plans to do much deeper product integration in the future.

Letting people get a free taste directly with ChatGPT was definitely a smart move from OpenAI. The execs are already on board because of it.

I use it to help kickoff the narrative form of rfp responses. It’s not a direct copy and paste but helps get started with questions like “why choose this platform over another”.
I’m running a global pilot to see how we can effectively use it for internal data at a multinational investment bank
Gonna be tough when window size is 32k max. Maybe fine tuning is where you are at?
Surely you need to keep the data inside your own system and can’t send it to OpenAI, right?
OpenAI changed the terms, they dont use it anymore.
I'm curious about this too. What sort of pilot are you running? How (if at all) did you get permission to upload data?
I don't use it, it returns mostly incorrect code that makes me realize it's not worth it. I'm more productive and write better code ignoring ChatGPT 95% of the time.
What do you use it for 5% of the time then?
(comment deleted)
not OP, but I can guess: shell scripts. its great for 'i have this shape text/files and i need this other shape'.
My experience is that it is also pretty good a debugging its own mistakes too.
I find it is really useful for giving me a base to start from, especially when it’s writing code for tools that I am not very comfortable with. It usually won’t spit out the ultimate solution on the first try, but it can give me an idea of how to modify what it gave to do exactly what I want, in way less time than actually writing it.
Did you try GPT4? The quality are far better.
my comment will probably get flagged or downvoted or whatever, but yeah agreed.

I literally cannot understand how people code that need gpt as an assistant for writing code. If I can reason about it, I can write it faster then the feedback loop takes for prompting.

I agree with your experience, and am curious as to what the difference between the two scenarios is.
I always wanted to do this very specific in Django. I don't work with Python,so even though I knew what I want to do,but my skills weren't there to create working code. So I thought I'll throw the problem at chatGPT. The generated code had a couple of flaws, but I managed to fix them in 15 min or so and got a working result. The code also gave me some interesting perspective on how some things could be implemented.
That’s interesting since I threw some questions at it about Django and I didn’t think it gave very idiomatic patterns for it.
What it generated in Django was very simple and likely far from the quality an experienced engineer would come up with, but at my knowledge level that was enough.
If you iterate and ask it to provide more idiomatic patterns, it will!
It's for new things: new languages, frameworks, libraries. When you're not fluent, it can be a helpful hand for a beginner, or someone who has to do a lot things that they are not expert in, like a one man band in a sole enterprise or corner of a startup.

It can increase efficiency for generalists. For deep work, it's less useful.

I agree. That so far the super specialist can do better. But they will also find useful when they need to cross the domain that are good at with something that they are yet a beginner. Also, for mechanical things, it is amazing. Like, for helping solving a conflict of a patch with a context, or editing lots of parts in a code with something that it would require multiple regexps.
The use case where it's really good is boilerplate code that you may not remember. For example, I haven't written React code for years now. I know what good React code looks like when I see it because I've worked with it before, but I wouldn't be able to implement something from scratch without googling or copying stuff from Github. I just don't remember the libraries and best practices off the top of my head.

When I ask ChatGPT to do it for me it gives me an excellent starting point. Sure, there will be bugs, but because I know what I want I can spot and fix them immediately. It's much faster to adjust ChatGPT's code than it is to Google around for starting points.

Another example are shell scripts. I only touch bash once every few months and I keep forgetting the syntax for certain operations. Asking ChatGPT to give me a starting point is much faster than googling and visiting 20 StackOverflow posts for what I want.

But I agree with you that for day-to-day work on the same codebase where you have all the context, ChatGPT usually isn't worth it.

Try to use for s context that you are not too good yet.
No offense, but I wouldn't hire you based on your resistance to learning new technology.

You haven't spent enough time with GPT-4 and CoPilot to understand how LLMs can save you time. There is a reason why the world's top engineers like Andrej Kaparthy[1] and Guido van Rossum[2] are using these tools, they save a ton of time and work when used correctly.

[1] https://twitter.com/karpathy/status/1608895189078380544

[2] https://www.youtube.com/watch?v=_KjSkGgaJ1k

Personally I'm using these tools for coding, research, and writing. Anyone who doesn't understand how much they can accelerate these tasks when used effectively are going to get left in the dust. I've spoken to colleagues who don't seem to get it as well, it's strange to me
I've had the same experience and agree. I've talked to engineers who initially have the same standoff-ish opinion, then after a few weeks of using the tools end up changing their minds and adopting them.
For a personal project it helped me work through an area of the code that would have otherwise been a mental blocker for me because I wasn’t sure where to start.

At work I’ve been using it a bit to improve feature/design concepts. It’s helped me come up with some unique improvements (and some really boring and generic ones too.)

If you're able to, would love to hear about what the problem was that you hit a mental block on and how ChatGPT helped you figure out where to start.
One good idea I have is, since it’s a generative model, instead of asking it mechanical or electrical engineering questions, ask it to make a program to calculate something. And slowly ask it to improve upon.
I'd say 80% of usage is focused on engineering tasks, while the rest are product/sales/customer success/marketing/HR.

The biggest issue we've seen is that folks don't really know how to use it. We created a Slack channel to share examples, encourage people to try it, and help each other out, which seems to be increasing usage (and memes).

Full disclosure: I built a ChatGPT for Teams tool with a friend, so most of the usage is sharing links/collaborating with that tool.

Yes. It is a good clue engine. If I can’t solve a problem it will give me something to try. Sometimes misses the mark. Sometimes finds something I hadn’t thought of.

Also great for asking how to in Python questions and explaining ML concepts. Danger is I wont learn Python properly but just remember the prompts!

Not allowed, because the privacy is non-existant, the licensing is questionable, Microsoft sees everything, and the responses are often wrong and require more work to verify. The risks are greater than the reward.
Anything I put into ChatGPT I scrub the crap out of. I'm sure in the near future MSFT/OpenAI will figure out my redactions but until then...
I use ChatGPT for a wide variety of tasks throughout my day, but my favorite use case is generating one-off utilities quickly. A recent example of this was when I needed to move and reorganize approximately 1 million files from one hard drive to another over a six-week period. Unfortunately, the destination hard drive began to malfunction – I could access metadata, but file transfers to and from the drive would fail almost immediately.

With ChatGPT's assistance, I was able to create a utility that scanned the 1 million+ files on the faulty destination drive and then re-copied those files from the original source drive to a new destination drive, all while maintaining the updated directory and file structure.

I'm not in tech like most of y'all. I help out my dad with his consulting company for mostly public agencies. The other day a group we're working with wanted my dad to write some media notes for the unveiling of a project that's been in the works for a while. I gave chatgpt a quick prompt of what the project is, who the audience is, how it's important for a certain demographic and for the community, etc. My dad edited it and sent it over to the leader of this group for his speech the next day. Even though it was edited, I laughed because a chatgpt quote that wasn't edited made it on to the government's website for a pretty big announcement.

Other than that I used it this morning while editing a report we hired a team to create. It was helpful to reword some sentences that weren't very clear before sending it off to the client.

Other than that, I mostly use it to brainstorm ideas/give me related concepts to something I'm working on.

Also, not work related, but last week I used chatgpt to create an opening message for a dating app. I knew the gist of a joke I wanted to say related to this woman's interests, but had chatgpt word it for me. There was a lot more to our conversations, but she did at least respond to the opener and we got the conversation rolling. We actually went on a date this weekend, where I had to rely on my own brain's inefficient language model! It went pretty well though.

Made me curious, did you disclose to her on your date that the opening line was -enhanced- with AI?
Haha good question. I...did not. I feel a bit weird about that but I like to overshare, so it will definitely come out. She was talking about how she uses chatgpt to help write abstracts for her engineering PhD papers. Hopefully she won't take issue with it and think I'm not genuine, etc. I think it will be fine though based on our other conversations.

I did actually do something somewhat similar with another girl. She was a nursing student who used chatgpt for statistics homework (as well as to cheat on exams!). After we hung out I sent her a simple chatgpt generated message along the lines of thanks for hanging out, had a great time, should do it again, etc. Then immediately after I sent a message saying that I had asked chatgpt what to say to someone after a date. She seemed to think that was funny...although we never did hang out again (for other reasons).