Code

Llama 3.1 Configs and Code#1208

Code

Merged

joecummings merged 20 commits intopytorch:mainpytorch/torchtune:mainfrom joecummings:update-weights-4-llamajoecummings/torchtune:update-weights-4-llamaCopy head branch name to clipboardJul 23, 2024

+1,530-35

Commits

Commits on Jul 22, 2024

• Update weights and docs

  joecummings

  committed
  6745533

  Copy full SHA for 6745533

• Set default back to disk logger

  joecummings

  committed
  5749192

  Copy full SHA for 5749192

• Merge remote-tracking branch 'upstream/main' into update-weights-4-llama

  joecummings

  committed
  cd66ccb

  Copy full SHA for cd66ccb

• Merge remote-tracking branch 'upstream/main' into update-weights-4-llama

  joecummings

  committed
  86e5389

  Copy full SHA for 86e5389

Commits on Jul 23, 2024

• Update download commands

  joecummings

  committed
  495de02

  Copy full SHA for 495de02

• Add scaling

  joecummings

  committed
  1934adb

  Copy full SHA for 1934adb

• Merge branch 'update-weights-4-llama' of github.com:joecummings/torchtune into update-weights-4-llama

  joecummings

  committed
  2e72449

  Copy full SHA for 2e72449

• Update paths in README

  joecummings

  committed
  28ce5a8

  Copy full SHA for 28ce5a8

• Update docs

  joecummings

  committed
  c2813fc

  Copy full SHA for c2813fc

• 3.1 not 3

  joecummings

  committed
  efeda47

  Copy full SHA for efeda47

• Merge remote-tracking branch 'upstream/main' into update-weights-4-llama

  joecummings

  committed
  a8554f0

  Copy full SHA for a8554f0

• Update docs

  joecummings

  committed
  5007e69

  Copy full SHA for 5007e69

• Update README comment

  joecummings

  committed
  8aaa975

  Copy full SHA for 8aaa975

• Fix linting

  joecummings

  committed
  935fd0f

  Copy full SHA for 935fd0f

• Update README comment

  joecummings

  committed
  d1ace8c

  Copy full SHA for d1ace8c

• Add meta device hack and pass lints

  joecummings

  committed
  290aa68

  Copy full SHA for 290aa68

• Merge remote-tracking branch 'upstream/main' into update-weights-4-llama

  joecummings

  committed
  0fe2e89

  Copy full SHA for 0fe2e89

• Add warning about kv cache for long context models

  joecummings

  committed
  d7ec9cc

  Copy full SHA for d7ec9cc

• Update docstrings

  joecummings

  committed
  b5eb93f

  Copy full SHA for b5eb93f

• Last one

  joecummings

  committed
  22c90de

  Copy full SHA for 22c90de