MIDI Agent Docs

MIDI Agent Plugin Documentation

Overview

The MIDI Agent plugin is a powerful tool designed to enhance your music production workflow by leveraging artificial intelligence for MIDI generation and manipulation directly within your Digital Audio Workstation (DAW). This plugin allows you to generate original MIDI melodies, harmonies, and rhythms using text prompts, convert audio to MIDI, and complete existing MIDI sequences, all powered by state-of-the-art AI models.

Installation and Activation

MIDI Agent is available as VST3/AU/AAX/Standalone. Run the installer and choose which formats to install — you don't need a DAW to use the Standalone App.

  1. Download: Get the installer for your OS from your account page.
  2. Install: Run the installer and select the Standalone App and plugin formats you need. Default install paths:
    • Standalone App:
    • C:\Program Files\MIDI Agent\MIDI Agent.exe
    • /Applications/MIDI Agent.app
    • VST3:
    • C:\Program Files\Common Files\VST3
    • /Library/Audio/Plug-Ins/VST3
    • AU (macOS):
    • /Library/Audio/Plug-Ins/Components
    • AAX (Pro Tools):
    • C:\Program Files\Common Files\Avid\Audio\Plug-Ins
    • /Library/Application Support/Avid/Audio/Plug-Ins
  3. Launch MIDI Agent: Open the Standalone App from the Start Menu or Applications folder, or launch your DAW and load MIDI Agent on a MIDI or Instrument track.
  4. License: Enter your license key in the settings panel.
  5. Verify: Click "Save" to verify your license online.
  6. Add API keys: Add your API keys or subscribe to our MIDI Agent Pro plan to use ours.
  7. Start generating: Select an API provider (or MIDI Agent for Pro subscribers), select a model, type a prompt, and hit send to begin generating music! When using the Standalone App, drag the generated .mid file directly into any DAW.

Key Features

  • AI-Powered MIDI Generation: Generate unique and inspiring MIDI patterns using text prompts.
  • Audio to MIDI Conversion: Convert audio recordings into MIDI data.
  • MIDI Completion: Expand and enhance existing MIDI sequences.
  • Flexible AI Model Selection: Choose from various AI providers:
  • Musical Parameter Controls: Fine-tune key, scale, notation type, and more.
  • Cross-Platform Compatibility: Available as a VST3/AU/AAX/Standalone on Windows and macOS.
  • Dark/Light Theme: Choose your preferred visual theme.

User Interface and Controls

API Settings

  • Provider Selection: Choose from multiple AI providers
  • Model Selection: Pick specific AI models
  • API Key Management: Enter and save your API keys

Music Parameters

Left Column

  • Key Selection
  • Notation Type
  • Length (bars)

Right Column

  • Scale Selection
  • Note Length
  • Genre

Workflow and Usage

MIDI Agent is designed to seamlessly integrate with your DAW workflow:

  1. Install the VST plugin in your DAW
  2. Configure your API keys in the settings panel
  3. Create a new MIDI track and add the MIDI Agent plugin
  4. Use the plugin interface to generate or modify MIDI
  5. Drag the generated MIDI into your DAW channel or save it to your files

Best Practices

Crafting Effective Music Generation Prompts

  • Give specific musical directions
  • Describe note patterns and rhythms (e.g., "alternate between long held notes and quick staccato runs")
  • Specify melodic movement (e.g., "create a melody that starts low, climbs for two beats, then falls back")
  • Include rhythmic instructions (e.g., "use syncopated rhythms with emphasis on offbeats")
  • Define harmonic elements (e.g., "use a I-vi-IV-V progression with seventh chords" or "use 4 voices in each chord")
  • Avoid vague style or genre references, be more specific ex. "power chords for an electric guitar in a rock song"

MIDI Continuation Parameters

  • Start with short generations (1-2 bars) and iterate quickly to find the right direction
  • For best results, provide 1-2 bars of input MIDI to establish your idea
  • Once you have a good short pattern, extend it to create longer phrases
  • Experiment with different prompts and parameters to see what works best for your input file

Audio to MIDI Best Practices

For optimal transcription results:

  • Use high-quality audio recordings
  • Ensure clear separation between instruments (minimal bleeding and reverb)
  • Use files shorter than 30 seconds and with small file sizes for best results
  • Works best with:
    • Solo piano recordings
    • Clean guitar recordings
    • Well-separated multi-track recordings
    • Acoustic instruments with minimal effects
  • Avoid or use with caution:
    • Heavily processed or distorted audio
    • Live recordings with significant ambient noise
    • Complex orchestral pieces with many overlapping parts
    • Audio with heavy compression or limiting

General Tips

  • Use the strongest models available — we recommend the latest models from Anthropic (Claude) and Google (Gemini) for best results
  • Customize for your genre — experiment with custom instructions in the settings panel specific to your musical style
  • Provide examples — add MIDI file examples for your genre/preferences in the settings panel to help steer outputs for specific tasks
  • Start new conversations frequently — longer conversation histories can lead to context rot, where stale context builds up and model performance degrades
  • Break down complex tasks — divide large tasks into smaller steps, generate one part at a time, and evaluate each result before extending it

Troubleshooting

Common Issues

API Connection Issues

  • Verify your API key is correctly entered in settings
  • Check your internet connection
  • Ensure you have sufficient API credits

Plugin Not Loading

  • Verify you installed the correct VST3/AU/AAX/Standalone format for your workflow
  • Try rescanning your plugin folder
  • Check if your system meets the minimum requirements
  • If you don't use a DAW, open the Standalone App instead (Start Menu on Windows, /Applications/MIDI Agent.app on macOS)

Pro Tools Users (AAX)

  • Confirm the AAX plugin is installed at C:\Program Files\Common Files\Avid\Audio\Plug-Ins (Windows) or /Library/Application Support/Avid/Audio/Plug-Ins (macOS)
  • Relaunch Pro Tools and let the first-launch plugin scan complete
  • MIDI Agent appears on Instrument tracks

Standalone App Workflow

  • The Standalone App lets you generate MIDI without a DAW
  • Drag the generated .mid file directly into any DAW timeline or MIDI track
  • If a DAW doesn't accept direct drag-and-drop, use Save MIDI as a fallback
  • Tempo and transport use MIDI Agent defaults — there's no DAW playhead

macOS Compatibility Issues

  • Older macOS versions may have trouble recognizing the plugin - upgrade to the latest macOS version
  • If you installed both AU and VST3 versions and the plugin doesn't show up, try installing only one format
  • Some DAWs on macOS may conflict when both plugin formats are present

Logic Pro Users

  • The plugin is found in the MIDI FX slot, which is above the instrument and audio effect slots on a software instrument channel strip

Upgrading to MIDI Agent Pro

  • If upgrading to MIDI Agent Pro while the plugin is open, restart the plugin for the subscription to be recognized

MIDI Generation Issues

  • Try using more specific prompts
  • Adjust the temperature and other parameters
  • Make sure your prompt follows the best practices

Audio to MIDI Problems

  • Use high-quality audio recordings
  • Ensure the audio is not clipping
  • Try processing one instrument at a time

Error Messages

"API Key Invalid"

Double-check your API key in the settings panel. Make sure there are no extra spaces.

"Rate Limit Exceeded"

Wait a few minutes and try again, or upgrade your API plan for higher limits.

"Generation Failed"

Try adjusting your prompt or parameters. If the issue persists, check the API status.

Getting Help

If you're still experiencing issues:

  • Check our documentation for updates
  • Contact us through the contact form
  • Include detailed information about your setup and the issue