cswork / libraryOpen practice workspace

Interview guides · Synthesia

Synthesia Software Engineer Interview Guide

Synthesia Software Engineer interview guide: reported rounds, questions and how candidates describe the process.

The 60-second brief

As a Software Engineer at Synthesia, you are at the forefront of the generative AI revolution, building the world's leading AI video generation platform. Your work directly impacts how millions of users create high-quality video content without the need for cameras, studios, or traditional film crews. You will be responsible for designing, developing, and scaling complex systems that power real-time video editing, collaborative creation, and highly efficient rendering pipelines. The engineering team at Synthesia tackles unique technical challenges that span across sophisticated client-side web applications, high-throughput media processing queues, and real-time collaboration engines.

This guide is scoped to a Software Engineer candidate at Synthesia.

Focus areas

  • System Design
  • Take-home Assignments
  • Architecture / Architectural Thinking

The Synthesia interview process

Synthesia candidates report 6 rounds over 4-6 weeks. The stages below are what candidates describe, not a published process.

Application Review

Initial review of candidate applications to assess qualifications and fit.

What to demonstrate

  • Initial review of candidate applications to assess qualifications and fit
  • Depth in System Design

How to prepare

  • Be able to walk your CV end to end in two minutes, and say why this company specifically.
  • Have your salary expectations, notice period and location constraints ready, and ask for the rest of the loop in writing.

Recruiter Call

A conversation with a recruiter to discuss the role and candidate's background.

What to demonstrate

  • A conversation with a recruiter to discuss the role and candidate's background
  • Depth in System Design

How to prepare

  • Be able to walk your CV end to end in two minutes, and say why this company specifically.
  • Have your salary expectations, notice period and location constraints ready, and ask for the rest of the loop in writing.

Technical Phone Interview

A remote interview focusing on hands-on development skills and technical knowledge.

What to demonstrate

  • A remote interview focusing on hands-on development skills and technical knowledge
  • Depth in System Design

How to prepare

  • Answer aloud and timed: How would you optimize content delivery and caching strategies for large media assets across a global user base?
  • Answer aloud and timed: Why did you choose this specific framework or state management approach for your solution?

Take-Home Assignment

Candidates complete a coding task to demonstrate their coding quality and architecture skills.

What to demonstrate

  • Candidates complete a coding task to demonstrate their coding quality and architecture skills
  • Depth in System Design

How to prepare

  • Answer aloud and timed: How would you refactor your take-home code to support infinite scroll instead of standard pagination?
  • Answer aloud and timed: What are the performance implications and potential compatibility issues of grayscaling images client-side in the browser?

System Design Interview

An interview focused on real-world system design and architecture discussions.

What to demonstrate

  • An interview focused on real-world system design and architecture discussions
  • Depth in System Design

How to prepare

  • Answer aloud and timed: How would you write comprehensive integration tests for the HTTP server and in-memory queue you implemented?
  • Answer aloud and timed: If you had to scale your take-home solution to handle millions of active users, what would be the first bottleneck you would address?

Final Leadership Conversations

Conversations with leadership to assess cultural alignment and final fit.

What to demonstrate

  • Conversations with leadership to assess cultural alignment and final fit
  • Depth in System Design

How to prepare

  • Answer aloud and timed: Tell me about a high-impact technical project you owned from end to end. What were the success metrics and key takeaways?
  • Answer aloud and timed: How do you balance the need for high-quality code and comprehensive testing with tight product deadlines?

Where candidates lose points

Set Up a Clean Local Workspace

Since the take-home assignment requires you to set up the project from scratch, ensure you have a clean, working boilerplate and local development environment ready to go.

Prioritize Code Structure Over Polish

During the take-home, focus heavily on clean folder structures, modular design, and testability. A well-structured, partially completed task with excellent tests often performs better than a fully completed but messy solution.

Be Ready to Defend Your Tradeoffs

In your debrief, expect the interviewers to challenge your technical choices. Do not get defensive; instead, clearly explain the tradeoffs you considered and acknowledge alternative approaches.

Prepare Practical STAR Stories

For behavioral and leadership rounds, prepare concrete examples of projects you owned, tight deadlines you met, or technical disagreements you resolved, using the STAR (Situation, Task, Action, Result) framework.

Questions & practice

Archive a resource graph without breaking live references or recursing

Medium · graph traversal · topological order · tenant isolation

Resources reference other resources within a tenant; for the largest tenant the reference table holds up to 2,000,000 nodes and 8,000,000 edges. Archiving a resource must archive everything reachable from it that nothing outside the set still references, refuse when a live external referrer exists, and terminate when references form cycles, which they legitimately do. Produce the archive order and the refusal list, targeting O(V+E). Say what stops the traversal crossing a tenant boundary, and why recursion is the wrong control structure at this size.

Approach

  1. Load the subgraph with the tenant predicate on both endpoints of the edge, not only on the side you started from. Scoping the left table alone is the classic cross-tenant leak: one mis-entered edge then pulls another tenant's resources into the traversal and, worse, into the archive.
  2. Traverse iteratively with an explicit stack. A 2,000,000-node graph can hold a chain deep enough to exhaust a native stack in the low tens of thousands of frames, and that failure is a process crash rather than an error you can return.
  3. Treat cycles as data rather than corruption: compute strongly connected components with Tarjan in O(V+E) using its own explicit stack, then condense. The condensation is a DAG, so a topological order over it gives the archive order, and every member of a component archives in one transaction because no order within a cycle is valid.
  4. Decide refusals with reverse edges. A candidate is archivable only if every in-edge originates inside the candidate set, so build the transpose or count in-degrees restricted to the visited set, and emit each blocked resource with the id of the external referrer, which is the only part of the answer an operator can act on.

Follow-up

  • The graph is read in one query and the archive writes a minute later. What can change in between, and how do you make the write safe?
  • The candidate set is 400,000 resources. Is that one transaction, and if not, what does a half-finished archive look like to a reader?

Merge partitioned event streams into one ordered feed with bounded lateness

Hard · k-way merge · watermarks · out-of-order streams

The read-model service consumes 64 log partitions carrying about 4,000 events per second in total. Each partition is ordered within itself, but partitions drift by up to 30 seconds, and the activity feed must present a tenant's events in occurred_at order. Produce the merge. State its complexity, the buffer it requires in events and in bytes, what happens when one partition is idle, and what you do with an event that arrives after you have already emitted its position. Payloads average 1 KB.

Approach

  1. Merge with a min-heap over the 64 partition heads keyed on (occurred_at, event_id): O(log P) per event and O(n log P) overall. The tie-break on event_id is what makes the output deterministic when two partitions carry the same millisecond, which matters because the feed is paginated and a non-deterministic order reorders pages under the reader.
  2. Emitting the heap head is only correct once every partition has produced everything up to that timestamp, so the emit condition is a watermark: the minimum across partitions of the highest occurred_at seen, less the allowed lateness. Events are held until the watermark passes them, which is what turns individually ordered streams into a jointly ordered one.
  3. Size the buffer from the lateness rather than guessing: 4,000 events per second times 30 seconds is 120,000 buffered events, and at 1 KB each about 120 MB of heap. That number is the real price of the ordering guarantee and belongs in front of whoever asked for it.
  4. Handle the idle partition explicitly, because it fails the feed rather than corrupting it: a partition with no traffic never advances its own maximum, so the watermark freezes and output stops entirely. Either every partition emits a periodic idle marker carrying the broker's current time, or the watermark falls back to wall clock for a partition silent beyond a threshold.

Follow-up

  • The lateness budget is raised to five minutes. What is the new buffer, and what besides memory changes?
  • The consumer restarts. Where does it resume from, and what does the feed look like for the first 30 seconds?

Canonicalise a request body into a stable idempotency fingerprint

Medium · parsing · canonicalisation · hashing

idempotency_key.request_fingerprint is a SHA-256 over the method, path and canonicalised body, and a retry whose fingerprint differs must be rejected with 422 rather than served the stored response. Write the canonicaliser. Bodies are JSON up to 256 KB nested at most 32 levels; clients vary key order, whitespace and unicode escaping, and some send 64-bit ids as JSON numbers. Produce a deterministic byte string such that semantically identical bodies match and any semantic difference does not. State your complexity and name two normalisations you refuse to perform.

Approach

  1. Parse once into a tree, then re-serialise under fixed rules: object keys sorted, array order preserved, one escaping convention, no insignificant whitespace. Parsing is O(n) and sorting keys is O(k log k) per object, so O(n log n) overall with O(depth) stack, and the 32-level cap is enforced during parsing because hostile nesting is how a canonicaliser becomes a stack overflow.
  2. Sort keys by their UTF-8 bytes and say why the obvious implementation is wrong in some runtimes: a default string comparison that orders by UTF-16 code units places surrogate pairs, meaning code points from U+10000 up, below U+E000 to U+FFFF, which is not UTF-8 byte order, so two services written in different languages disagree on the same document.
  3. Do not re-encode numbers through a double. IEEE-754 binary64 represents integers exactly only up to 2^53, so normalising a 19-digit id through a float changes it, and 1 against 1.0 cannot be reconciled without deciding whether they are the same value. Preserve the literal token, and require ids as strings at the API boundary if you want them comparable.
  4. Reject duplicate keys rather than picking one. JSON permits them and parsers disagree, most keeping the last, so any choice you make ties the fingerprint to a parser detail that the code handling the request does not necessarily share.

Follow-up

  • A client sends the same logical request with an extra field your API ignores. Same key, different fingerprint, so you return 422. Is that the right answer?
  • Where does the fingerprint get computed relative to request decompression and the body-size limit?

Denormalise tenant onto revisions and backfill it live

Hard · denormalisation · online migration · backfill

resource_revision (revision_id, resource_id, version, actor_user_id, change_kind, patch, request_id, created_at) has 400M rows and no tenant column; tenant_id lives only on resource. Two reads need it: a tenant-scoped audit feed ordered by created_at DESC, and an offboarding purge. Both join back to resource today. Justify adding tenant_id to resource_revision against those two reads, name the anomaly the copy introduces and the constraint that prevents it, then give the ordered migration for a live table taking 1.2k writes/second — the lock each step takes, how the backfill is batched, and where each step stops being reversible. PostgreSQL 16.

Approach

  1. Justify from the access path rather than from taste. Without the column, the audit feed either scans resource_revision by created_at and discards other tenants' rows, or resolves the tenant's resource_ids first and probes with them — both proportional to the tenant's whole history rather than to one page. With (tenant_id, created_at DESC, revision_id DESC) it is a seek that stops at 50 rows, and the purge becomes a ranged delete instead of a join.
  2. Name the cost exactly: a second copy of a fact can disagree with the first. Make the disagreement unwritable rather than documented — add UNIQUE (resource_id, tenant_id) on resource so it can serve as a foreign-key target, then FOREIGN KEY (resource_id, tenant_id) REFERENCES resource (resource_id, tenant_id) on the revision table. A revision can then only ever carry its parent's tenant.
  3. Step one, expand: ALTER TABLE resource_revision ADD COLUMN tenant_id BIGINT NULL, with no default, so it is a catalogue change and no rewrite. It still needs ACCESS EXCLUSIVE for an instant, and that instant queues behind the longest open transaction on the table while every later query queues behind it — set lock_timeout to 2s and retry rather than wait.
  4. Step two, dual-write: deploy the writer that populates tenant_id on every new revision while reads still use the join. Reversible by redeploying the previous build, because nothing reads the column yet.

Follow-up

  • The backfill is half finished and a rollback is required. What state is the table in, and what does the previous build do with a half-populated column?
  • How do you verify the backfill actually finished, given rows are still being inserted while it runs?

Explain why the owner filter ignores the listing index

Medium · composite index · query plans · sort elimination

The only index on resource is (tenant_id, status, updated_at DESC, resource_id DESC). A new endpoint returns one user's resources across all statuses, newest created first: WHERE tenant_id = $1 AND owner_user_id = $2 ORDER BY created_at DESC LIMIT 20. On a tenant with 2M rows it takes 900 ms and EXPLAIN shows a sort above a large scan. Explain precisely why the existing index cannot serve it, give the index that can, and state which of these the new index still will not help: owner_user_id alone across tenants; the same query ordered by updated_at. PostgreSQL 16.

Approach

  1. Separate the two jobs an index does. For filtering, a composite btree is seekable only on a left prefix, so with no predicate on status the scan can at best range over tenant_id and test owner_user_id per row; PostgreSQL 16 has no btree skip scan to jump the unconstrained column.
  2. For ordering, the index is sorted by (status, updated_at) within a tenant and not by created_at, so the LIMIT cannot stop early: every matching row is read and then sorted. That is the 'Sort Method: top-N heapsort' line, and it is why the plan reads 2M rows to answer with 20.
  3. Derive the replacement from the access path — equality, equality, then the ordering column: CREATE INDEX CONCURRENTLY ON resource (tenant_id, owner_user_id, created_at DESC). The scan seeks to the (tenant, owner) range and walks 20 entries in order, so the Sort node disappears along with the row-read.
  4. Treat INCLUDE (title, status) as conditional, not free. An index-only scan still visits the heap for any row whose page is not marked all-visible, so on a table taking 1.2k writes/second the win depends on autovacuum keeping the visibility map current, and the wider index costs more on every insert.

Follow-up

  • 90% of rows are status='active'. Would a partial index WHERE status = 'active' change your answer, and for which of the three queries?
  • A dashboard runs this for 40 owners in one page load. What changes about the design?

How would you design a real-time collaborative video editing platform where multiple users can edit the same t

Medium · System Design & Architecture

How would you design a real-time collaborative video editing platform where multiple users can edit the same timeline simultaneously?

Approach

  1. Fix the scope first: who calls this, how often, and what they do when it fails.
  2. Name the read and write paths separately; they rarely have the same bottleneck.
  3. Choose a partition key and say what query it makes expensive.
  4. State the consistency you need, and where you are willing to be stale.

Follow-up

  • What breaks first when traffic grows ten times?
  • How does this behave when that dependency is down for an hour?

Design a scalable processing queue that handles heavy video rendering tasks and gracefully handles retries for

Medium · System Design & Architecture

Design a scalable processing queue that handles heavy video rendering tasks and gracefully handles retries for failed requests.

Approach

  1. Fix the scope first: who calls this, how often, and what they do when it fails.
  2. Name the read and write paths separately; they rarely have the same bottleneck.
  3. Choose a partition key and say what query it makes expensive.
  4. State the consistency you need, and where you are willing to be stale.

Follow-up

  • What breaks first when traffic grows ten times?
  • How does this behave when that dependency is down for an hour?

How would you structure the state management for a highly interactive, canvas-based image or video editor in t

Medium · System Design & Architecture

How would you structure the state management for a highly interactive, canvas-based image or video editor in the browser?

Approach

  1. Fix the scope first: who calls this, how often, and what they do when it fails.
  2. Name the read and write paths separately; they rarely have the same bottleneck.
  3. Choose a partition key and say what query it makes expensive.
  4. State the consistency you need, and where you are willing to be stale.

Follow-up

  • What breaks first when traffic grows ten times?
  • How does this behave when that dependency is down for an hour?

Discuss the architectural tradeoffs between using a NoSQL database like MongoDB versus a relational database f

Medium · System Design & Architecture

Discuss the architectural tradeoffs between using a NoSQL database like MongoDB versus a relational database for a collaborative content creation application.

Approach

  1. Fix the scope first: who calls this, how often, and what they do when it fails.
  2. Name the read and write paths separately; they rarely have the same bottleneck.
  3. Choose a partition key and say what query it makes expensive.
  4. State the consistency you need, and where you are willing to be stale.

Follow-up

  • What breaks first when traffic grows ten times?
  • How does this behave when that dependency is down for an hour?

How would you optimize content delivery and caching strategies for large media assets across a global user bas

Medium · System Design & Architecture

How would you optimize content delivery and caching strategies for large media assets across a global user base?

Approach

  1. Fix the scope first: who calls this, how often, and what they do when it fails.
  2. Name the read and write paths separately; they rarely have the same bottleneck.
  3. Choose a partition key and say what query it makes expensive.
  4. State the consistency you need, and where you are willing to be stale.

Follow-up

  • What breaks first when traffic grows ten times?
  • How does this behave when that dependency is down for an hour?

Why did you choose this specific framework or state management approach for your solution?

Medium · Take-Home Debrief & Code Quality

Approach

  1. Clarify what is being asked and what a complete answer contains.
  2. State your assumptions explicitly before working the problem.
  3. Say what you would check first and why it is the highest-information step.
  4. Work from the requirement backwards to the design.

Follow-up

  • What assumption would you test first?
  • How would you know your answer was wrong?

How would you refactor your take-home code to support infinite scroll instead of standard pagination?

Medium · Take-Home Debrief & Code Quality

Approach

  1. Say who the caller is and what they do when the call fails halfway.
  2. Define the identity of a request so a retry cannot double-apply it.
  3. Separate accepted, pending, failed and confirmed; they are different facts.
  4. Design the error taxonomy before the success shape; callers branch on it.

Follow-up

  • What happens if the caller retries after a timeout?
  • How does a client discover it is on an old version of this contract?

What are the performance implications and potential compatibility issues of grayscaling images client-side in

Medium · Take-Home Debrief & Code Quality

What are the performance implications and potential compatibility issues of grayscaling images client-side in the browser?

Approach

  1. Clarify what is being asked and what a complete answer contains.
  2. State your assumptions explicitly before working the problem.
  3. Say what you would check first and why it is the highest-information step.
  4. Work from the requirement backwards to the design.

Follow-up

  • What assumption would you test first?
  • How would you know your answer was wrong?

How would you write comprehensive integration tests for the HTTP server and in-memory queue you implemented?

Medium · Take-Home Debrief & Code Quality

Approach

  1. Say who the caller is and what they do when the call fails halfway.
  2. Define the identity of a request so a retry cannot double-apply it.
  3. Separate accepted, pending, failed and confirmed; they are different facts.
  4. Design the error taxonomy before the success shape; callers branch on it.

Follow-up

  • What happens if the caller retries after a timeout?
  • How does a client discover it is on an old version of this contract?

If you had to scale your take-home solution to handle millions of active users, what would be the first bottle

Medium · Take-Home Debrief & Code Quality

If you had to scale your take-home solution to handle millions of active users, what would be the first bottleneck you would address?

Approach

  1. Clarify what is being asked and what a complete answer contains.
  2. State your assumptions explicitly before working the problem.
  3. Say what you would check first and why it is the highest-information step.
  4. Work from the requirement backwards to the design.

Follow-up

  • What assumption would you test first?
  • How would you know your answer was wrong?

One log partition stops advancing while the others drain

Easy · poison message · head-of-line blocking · consumer lag

Search results for a subset of tenants are hours stale; the rest are current. The projection consumer reports lag of zero on 15 of 16 partitions and 400,000 on one. Its error rate is flat and its CPU is idle. outbox_event has no pending rows older than a second, so the relay has published everything it holds. Identify the mechanism, give the ordered checks, and state what you do in the first ten minutes versus what you change permanently.

Approach

  1. Read the lag distribution first. A slow consumer lags everywhere; zero on fifteen partitions and 400,000 on one is not throughput. Idle CPU on the stuck partition means the consumer is not advancing its offset at all, which points at one message it cannot get past rather than at a rate problem.
  2. Exonerate the producer before touching the consumer. No pending outbox rows older than a second means the relay published, so the event exists in the log. This separates never sent from sent and never applied, which are different code paths and usually different owners.
  3. Read the message at the stuck offset and the handler's log lines for its event_id. A flat error rate with no progress has two explanations and you must distinguish them: the handler is throwing and the retry loop is swallowing it, or the handler is blocking on something and never returning. Idle CPU with no error lines favours the second.
  4. Mitigate before diagnosing further. Move the offending event to a dead-letter store and commit the offset past it. Adding consumers does nothing here, because a partition is consumed by exactly one member of the group, and the blast radius is every aggregate hashed to that partition, not only the aggregate that produced the bad event.

Follow-up

  • The dead-lettered event carried aggregate_version 7 and the projection had applied 6. What must the replay do differently if 8 and 9 landed in the meantime?
  • How do you show staleness to the user while the partition is behind, given the API already returns the projection's watermark?

Suggested practice checklist

Built from the rounds and topics Synthesia candidates report.

Day 1 — Map the Synthesia loop

  • Write out the reported sequence: Application Review, Recruiter Call, Technical Phone Interview, Take-Home Assignment, System Design Interview, Final Leadership Conversations.
  • For each round, write one sentence on what it is judging, from the description above, and mark the one you are least ready for.

Deliverable: A one-page map of the 6 reported rounds, with the weakest marked.

Day 2 — Work System Design

  • Spend the session on System Design, which Synthesia candidates report being tested on.
  • Write one worked example in System Design and time yourself on it.

Deliverable: One timed worked example in System Design.

Day 3 — Work Take-home Assignments

  • Spend the session on Take-home Assignments, which Synthesia candidates report being tested on.
  • Write one worked example in Take-home Assignments and time yourself on it.

Deliverable: One timed worked example in Take-home Assignments.

Day 4 — Work Architecture / Architectural Thinking

  • Spend the session on Architecture / Architectural Thinking, which Synthesia candidates report being tested on.
  • Write one worked example in Architecture / Architectural Thinking and time yourself on it.

Deliverable: One timed worked example in Architecture / Architectural Thinking.

Day 5 — Answer out loud: System Design & Architecture

  • Answer aloud, timed: How would you design a real-time collaborative video editing platform where multiple users can edit the same timeline simultaneously?
  • Answer aloud, timed: Design a scalable processing queue that handles heavy video rendering tasks and gracefully handles retries for failed requests.

Deliverable: Spoken answers to 2 reported System Design & Architecture question(s), under time.

Day 6 — Answer out loud: Take-Home Debrief & Code Quality

  • Answer aloud, timed: Why did you choose this specific framework or state management approach for your solution?
  • Answer aloud, timed: How would you refactor your take-home code to support infinite scroll instead of standard pagination?

Deliverable: Spoken answers to 2 reported Take-Home Debrief & Code Quality question(s), under time.

Day 7 — Answer out loud: Behavioral & Leadership

  • Answer aloud, timed: Tell me about a high-impact technical project you owned from end to end. What were the success metrics and key takeaways?
  • Answer aloud, timed: How do you balance the need for high-quality code and comprehensive testing with tight product deadlines?

Deliverable: Spoken answers to 2 reported Behavioral & Leadership question(s), under time.

Behavioural preparation

Behavioural rounds judge the decision you made and what it cost.

Tell me about a high-impact technical project you owned from end to end. What were the success metrics and key

Medium · Behavioral & Leadership

Tell me about a high-impact technical project you owned from end to end. What were the success metrics and key takeaways?

Approach

  1. Pick a story where you made the decision, not one where you watched it.
  2. State the situation in two sentences and spend the rest on the reasoning.
  3. Give the blast radius: what could have broken, and what you measured.
  4. Name the disagreement and how you resolved it with evidence.

Follow-up

  • What would you do differently if you ran that again?
  • How did you know your change caused the improvement?

How do you balance the need for high-quality code and comprehensive testing with tight product deadlines?

Medium · Behavioral & Leadership

Approach

  1. Pick a story where you made the decision, not one where you watched it.
  2. State the situation in two sentences and spend the rest on the reasoning.
  3. Give the blast radius: what could have broken, and what you measured.
  4. Name the disagreement and how you resolved it with evidence.

Follow-up

  • What would you do differently if you ran that again?
  • How did you know your change caused the improvement?

Describe a situation where you had a strong technical disagreement with a teammate or lead. How did you resolv

Medium · Behavioral & Leadership

Describe a situation where you had a strong technical disagreement with a teammate or lead. How did you resolve it?

Approach

  1. Pick a story where you made the decision, not one where you watched it.
  2. State the situation in two sentences and spend the rest on the reasoning.
  3. Give the blast radius: what could have broken, and what you measured.
  4. Name the disagreement and how you resolved it with evidence.

Follow-up

  • What would you do differently if you ran that again?
  • How did you know your change caused the improvement?

How do you approach mentoring junior engineers and promoting engineering best practices within your team?

Medium · Behavioral & Leadership

Approach

  1. Pick a story where you made the decision, not one where you watched it.
  2. State the situation in two sentences and spend the rest on the reasoning.
  3. Give the blast radius: what could have broken, and what you measured.
  4. Name the disagreement and how you resolved it with evidence.

Follow-up

  • What would you do differently if you ran that again?
  • How did you know your change caused the improvement?

Can you share an experience where a project you were leading did not go as planned, and how you managed the ou

Medium · Behavioral & Leadership

Can you share an experience where a project you were leading did not go as planned, and how you managed the outcome?

Approach

  1. Pick a story where you made the decision, not one where you watched it.
  2. State the situation in two sentences and spend the rest on the reasoning.
  3. Give the blast radius: what could have broken, and what you measured.
  4. Name the disagreement and how you resolved it with evidence.

Follow-up

  • What would you do differently if you ran that again?
  • How did you know your change caused the improvement?