Groq

Groq currently provides free API access to the models they host. Among these, the Llama 3 70B model is particularly effective when used with PapertLab, offering code editing capabilities comparable to GPT-3.5. To get started, you'll need to obtain a Groq API key.

Adding API Keys via PapertLab Settings

Instead of setting the API key through environment variables, you can also add your Groq API key directly through PapertLab’s settings page:

  1. Open PapertLab and Access Settings: Start PapertLab and navigate to the settings page.

  2. Find the API Section: Locate the section dedicated to API key management.

  3. Input Your API Key: Enter your Groq API key in the designated field.

  4. Save Your Settings: After entering the key, save your settings. PapertLab will now be configured to use the Groq models with your provided API key.

By following these instructions, you can easily integrate the Llama 3 70B model with PapertLab, leveraging its powerful code editing features. Whether you prefer using the command line or the user-friendly settings page, PapertLab provides the flexibility you need to connect and use Groq’s AI models effectively.

Steps to Use Llama 3 70B with PapertLab

  1. Install PapertLab: Make sure PapertLab is installed on your system. If it’s not already installed, you can do so easily using pip:

    python -m pip install papert-lab

  2. Set Your Groq API Key:

    • Mac/Linux:

      export GROQ_API_KEY=<your-api-key>

    • Windows:

      setx GROQ_API_KEY <your-api-key>

      (Note: After using setx, restart your shell for the changes to take effect.)

  3. Using PapertLab with the Llama 3 70B Model:

    • To use the Llama 3 70B model, specify it when launching PapertLab:

      papertlab --model groq/llama3-70b-8192

  4. Listing Available Groq Models: To view other models offered by Groq, list them with the following command:

    papertlab --models groq/
PreviousGeminiNextOllama

Last updated