Skip to content

Commit

Permalink
Update eager.md
Browse files Browse the repository at this point in the history
  • Loading branch information
JackCaoG committed Jul 18, 2024
1 parent 9773b39 commit 0265915
Showing 1 changed file with 1 addition and 3 deletions.
4 changes: 1 addition & 3 deletions docs/eager.md
Original file line number Diff line number Diff line change
Expand Up @@ -79,9 +79,7 @@ step_fn = torch_xla.experimental.compile(step_fn)
```
In training we asked user to refactor the `step_fn` out because it is usually better to compile the model's forward, backward and optimizer together. The long term goal is to also use `torch.compile` for training but right now we recommend user to use `torch_xla.experimental.compile`(for perfomrance reason).

## Performance

# Benchmark
## Benchmark

I run a 2 layer decoder only model training(it is pretty much just a llama2) with fake data on a single chip of v4-8 for 300 steps. Below is the number I observed.

Expand Down

0 comments on commit 0265915

Please sign in to comment.