cswork / libraryOpen practice workspace

Articles · OpenAI

OpenAI Residency Preparation: Build Coding and Research Evidence Before Applying

Prepare for OpenAI Residency with a reproducible coding project, controlled research experiment, and concise evidence memo. Check official application status.

The OpenAI Residency is a six-month, full-time program for people who can grow into AI research and engineering. If you are preparing before an application opens, build evidence of how you code, investigate an uncertain result, and decide what to try next. A compact, reproducible experiment tells that story better than a list of courses or an impressive demo with no baseline. The official Residency page says the 2026 application is closed as of this article's September 27, 2026 check; it does not announce a next opening or a fixed interview sequence.

This guide turns the program's public signals into a portfolio rehearsal. It is preparation advice, not an OpenAI requirement or an account of a particular candidate's interview.

Start with the official boundary

OpenAI describes the Residency as a route for exceptional builders and researchers from varied backgrounds, including quantitative and scientific fields, who can make a rapid contribution. It emphasizes demonstrated ability, learning, and research potential rather than one prescribed degree. The program is full-time for six months. The public page describes an adaptive selection process but does not promise a universal take-home, a specific algorithm question, or a calendar for the next cohort. Check the page when you are ready to apply; program facts and openings can change.

That boundary matters. A generic “OpenAI Residency interview questions” list can give false confidence if it invents rounds. You can, however, prepare the evidence that would let you discuss your actual work under many formats: a working codebase, a narrowly stated question, a control, a measurement, mistakes you found, and a decision you defended. Your previous discipline can be an advantage when it yields a method, not merely a credential.

Do not present the project below as a task assigned by OpenAI. It is a self-directed practice artifact. Likewise, a strong portfolio is no guarantee of selection. The useful test is whether another engineer could reproduce and challenge your conclusion without hearing your pitch.

Convert broad signals into observable artifacts

Choose artifacts that make a claim falsifiable. A repository proves little if its README only says “implemented a model.” A notebook that runs but silently downloads changed data is hard to evaluate. A polished graph without a baseline cannot distinguish engineering effort from actual improvement.

Public signal to demonstrateObservable artifactWhat a reviewer can challenge
Build quickly and carefullySmall working repository with one-command setup and testsDoes the code run from a clean environment?
Research judgmentOne explicit hypothesis and a baselineWould a simpler explanation fit the result?
Quantitative reasoningNamed metric, split, and uncertaintyIs the gain bigger than ordinary variation?
Learning from failureError slices and an abandoned ideaDid the next experiment respond to evidence?
CommunicationOne-page decision memoAre claims narrower than the data support?

This is an evidence matrix, not an official scoring sheet. Pick two or three rows you can demonstrate well rather than claiming all of them with vague prose. If you are moving from physics, mathematics, neuroscience, or another field, translate your previous work into the same format: problem, method, check, limitation, decision. The field name alone is not the evidence.

Build one end-to-end experiment

Use a question small enough to answer in days, not a grand challenge such as “improve reasoning.” For example: Does a simple retrieval step improve answers to a fixed set of factual questions compared with a no-retrieval baseline, and on which question types does it fail? Use data you can lawfully share or a clearly documented public dataset. If an API, model, or dataset cannot be reproduced by others, include a minimal local or mocked path that still verifies the pipeline logic.

Write the measurement contract before tuning. Define the eligible questions, train/development/test separation if any, the primary metric, and the error taxonomy. A good first baseline may be a plain answer generator with identical prompts and model settings except for retrieval. If you change the prompt, model, evaluator, and retrieval simultaneously, you cannot attribute an observed difference. Keep a run manifest with data version, configuration, random seed where applicable, model identifier, and timestamp.

Here is an illustrative report skeleton—not a result from OpenAI:

Question: Does top-3 retrieval improve grounded factual answers?
Dataset: 120 licensed questions, frozen before final evaluation
Baseline: same model without retrieved passages
Treatment: same model plus top-3 passages from a frozen corpus
Primary metric: human-checked factual correctness on a held-out set
Guardrail: unsupported claims per answer
Slices: direct fact, multi-hop, ambiguous entity, missing-in-corpus
Decision: keep, revise, or reject retrieval based on the slice results

For the practice version, perhaps you discover that retrieval helps direct facts but increases unsupported claims on ambiguous entities. Do not flatten that into “retrieval improved accuracy.” Show the denominators, examples of both correct and incorrect answers, and why your proposed next step targets the failing slice. If labels are subjective, write a rubric and double-review a subset; report disagreement rather than hiding it. If the dataset is tiny, describe the result as a probe rather than a generalizable performance gain.

Make the code easy to inspect

Keep the repository boring in the best way. A reader should find README.md, a dependency lock or pinned environment, a script for data preparation, a baseline run, an evaluation run, and tests for the highest-risk transformations. Separate exploration notebooks from the reusable pipeline. Document external model calls and costs, but never commit keys or private data. Provide a small fixture so basic tests work without a paid account.

Test invariants, not only successful execution. The evaluation set must be disjoint from any examples used for prompt tuning. Every question needs a stable ID. Every output record should include the condition and configuration that produced it. A missing answer must not silently disappear from the denominator. An evaluator failure must not become a zero-quality label without being recorded as a pipeline failure. These details demonstrate coding maturity because they protect the interpretation of the experiment.

A useful repository entry point is a dry run that prints counts at each boundary: source rows, eligible rows, assigned condition, completed calls, valid scored answers, and excluded failures. Add one deliberate corrupt row to a test fixture and show that the pipeline rejects it. That proof is usually more informative than a screenshot of a high score. It also gives you a natural technical story if someone asks how you debugged the project.

Explain the decision, not just the result

Your memo should fit on one page. Lead with the question and your best-supported answer. Then give the design, a small table of results with denominators, the main failure pattern, threats to validity, and the next experiment. Include one paragraph on what you would not conclude. “Treatment won 67/100 versus baseline 61/100” is not automatically a meaningful improvement: the difference may depend on evaluator noise, paired-question variation, or one category dominating the test set. Show the paired comparisons and investigate disagreement.

The memo can say, for example: “Retrieval appears useful for direct lookup questions but not yet for ambiguous entities; I would improve entity resolution and re-evaluate on a frozen holdout before shipping.” That is stronger research communication than calling the system “state of the art.” A negative result can be valuable when it narrows a hypothesis and demonstrates an honest next step. Do not retrofit the hypothesis after seeing the results without saying so.

If the work used an assistant or another collaborator, state which parts were yours. Explain how you checked generated code and where the assistant was wrong. A clear provenance note protects your credibility and gives you material for a deeper conversation. It also makes it easier to distinguish your actual reasoning from polished artifacts assembled by someone else.

Rehearse the technical conversation

Prepare to open the project and defend a concrete choice. Why was this the baseline? What would happen if the corpus changed? Which examples leaked into development? Why is the metric aligned with user harm? Where could the evaluator be fooled? What would you do if the treatment improved average accuracy but doubled unsupported claims? These questions are practice prompts derived from the artifact, not a claim about OpenAI's interview script.

Answer by tracing evidence. If asked about a failure, name the input, expected behavior, observed behavior, first broken boundary, fix, and regression test. If asked for an extension, say which invariant it must preserve. Avoid treating a one-off notebook result as a deployable system; explain the missing monitoring, privacy, cost, latency, and rollback work. The goal is to demonstrate that you can move between code, measurement, and judgment.

Try the same explanation at three levels: a two-minute overview, a ten-minute experiment walkthrough, and a code-level audit. The short version should state the question, result, and caveat. The longer version should explain allocation, evaluation, and failure analysis. The code audit should show where IDs, configurations, and exclusions are recorded. Consistency across all three is a stronger signal than rehearsed slogans.

If you are changing fields

Do not disguise your prior field or inflate AI experience. Identify the transferable method you already used—experimental controls, numerical debugging, large-scale software, mathematical modeling, or careful qualitative labeling—and show it operating in the new project. A scientist can describe how they detected confounding; an engineer can describe how they made a pipeline reproducible; a designer-researcher can describe how they defined a defensible human-label rubric. Each still needs to show enough coding fluency for the artifact to stand independently.

Avoid a portfolio of five shallow clones. One well-documented project plus a small second probe may show range more convincingly. Include an explicit “what I learned” section: the wrong initial assumption, the observation that changed your mind, and the new decision. That makes learning visible without turning the application into a personal essay. It also prevents a career pivot from sounding like enthusiasm without demonstrated execution.

Before you apply

Re-run the repository from a clean checkout. Ask someone unfamiliar with it to follow the README and reproduce your main table. Check that private data and credentials are absent. Tighten the memo until every claim has a cited measurement, an example, or an explicit uncertainty. Then use the application form that is current at the time; do not assume a previously reported deadline or interview exercise still applies.

Your strongest preparation is not a secret list of questions. It is an artifact that survives inspection: working code, a controlled comparison, a failure you can explain, and a next decision that follows from evidence.

Sources and Further Reading

Research note: Official program status and linked practice destinations were checked September 27, 2026. The project and examples are original preparation exercises, not OpenAI selection requirements.