Recent searches
Search options
Administered by:
Woah: this is a Mac app that tees your system audio to Whisper and enables you to pass chunks of the text it to GPT-4 with one click.
If you hate leetcode-style interviews, you’re in luck because this is their death knell. #leetcode #interview #gpt4 #llm
GPT-4 has limitations, but this is something it’s exceptional at. It nails my standard interview question first try with 100% correct python for the fastest possible algorithm, and answers follow up questions admirably.
@brandonhorst are you going to stick with this question, or are you thinking of revisiting?
@mattiem Well right now it doesn’t matter because my company is on a hiring freeze of indeterminate length. But I’m not sure what options I have - I have a tough time imagining a programming problem that could be solved by an entry level programmer in 45 minutes but could not be trivially solved by GPT-4.
Maybe the solution is to frame the question in a sexual way so the system will refuse to answer. I’m sure HR would be supportive.
@mattiem To clarify, it’s not that it can answer the problem because it’s seen it before - this question is not on the public internet as far as we can tell (or else it’d be banned). It just knows how to solve it.
@brandonhorst that was my assumption, but good clarifications. Was this question being solved live, or did the candidate typically have time to solve it in private?
Regardless, I think this is super interesting. I think a lot about interviewing but I haven’t yet given much attention to this particular problem.
@mattiem We do whiteboard coding, which moved online with the pandemic and may or may not go back. Doing take-home style questions fixes this problem because using tools is the whole point.
@brandonhorst Maybe some new interview questions should be about composing AI written code into something larger and finding/fixing bugs in generated code. Based on my experience so far, AI can boost our productivity, but it still needs us to create a complete feature (for now).
@dougburns I would love that. That innovation will have to come from the startups though, the current interview style is too engrained in the big ones.
@brandonhorst Yeah, I've been there and agree. Related, in the near term I feel like small companies are going to have an even bigger productivity advantage over medium to large companies that are slow to accept/adopt AI assisted coding. I was skeptical at first, but after giving it a try I feel like it's a true force multiplier.
@brandonhorst A DS&A style question is arguably an extremely simple problem for GPT-4 since there is a finite number of patterns and an abundance of source material online to train the models. I personally prefer to provide candidates with a design spec and have them implement it since that is what they will most likely be doing on a daily basis. To make it more realistic, I might add a new requirement after the fact to see how they refactor the solution to accommodate the change.
@ajrobinson Yeah, this will have to be the way that things move.
I think in general the industry will be split between “tool-free coding” and “tool-assisted coding”, and the difference will be so great that it’ll have to be explicit which one is which. The biggest side-effect of this will be that remote interviews will probably become impossible.