- Home
- AI Sound Effect Generators
- FoleyCrafter
On the recordRead 10 Oct 202622 facts
FoleyCrafter
On the record
- Base model
- FoleyCrafter is built on a pretrained text-to-audio generator, and the project page says the T2A model remains fixed during the framework's training.foleycrafter.github.io · read 9 Oct 2026
- Checkpoints
- The repository says checkpoints download automatically when running `inference.py` and also documents manual downloads.github.com · read 9 Oct 2026
- Code and models
- The project provides its models and code through its GitHub repository.github.com · read 9 Oct 2026
- Dependencies
- The repository setup instructions use a Conda environment and Git LFS to download checkpoints.github.com · read 9 Oct 2026
- Hosted demo
- The linked Hugging Face Space is paused, and its page says users can ask its authors to restart it.huggingface.co · read 10 Oct 2026
- How to run
- The repository documents a Gradio interface launched with `python app.py --share` and command-line inference through `inference.py`.github.com · read 9 Oct 2026
- Implementation
- The framework has a Gradio interface and command-line inference usage.github.com · read 10 Oct 2026
- Integrations
- The project is built upon Auffusion, CondFoleyGen, and SpecVQGAN.github.com · read 10 Oct 2026
- Intended use
- The project describes sound effects as useful for cinema and gaming to enhance realism, impact, and emotional depth.github.com · read 10 Oct 2026
- License
- The repository lists an Apache-2.0 license and advises commercial users to check the Auffusion license as well.github.com · read 10 Oct 2026
- Makers
- The project page lists authors affiliated with Shanghai AI Laboratory and the Chinese University of Hong Kong, Shenzhen.foleycrafter.github.io · read 9 Oct 2026
- Prompt control
- Text prompts can be used to control video-to-audio generation according to user intent.foleycrafter.github.io · read 9 Oct 2026
- Prompt controls
- Text prompts support controllable video-to-audio generation, and the project demonstrates both positive and negative prompts.github.com · read 10 Oct 2026
- Prompt options
- The command-line interface includes prompt and negative-prompt options, a random seed, temporal alignment controls, input and checkpoint paths, and an output path.github.com · read 9 Oct 2026
- Purpose
- FoleyCrafter is a text-based video-to-audio generation framework that produces high-quality audio semantically relevant and temporally synchronized with input video.foleycrafter.github.io · read 10 Oct 2026
- Semantic alignment
- Its semantic adapter conditions audio generation on video features to produce sounds relevant to the visual content.foleycrafter.github.io · read 10 Oct 2026
- Setup
- The README provides a Conda environment setup and says model checkpoints can be downloaded automatically by running inference.py.github.com · read 10 Oct 2026
- Sound generation
- The framework uses a pretrained text-to-audio model to generate sound effects for video.foleycrafter.github.io · read 10 Oct 2026
